Noise is good

原创 2016年05月31日 11:03:49

由来

噪声是信号处理和图像处理中很让人厌烦的东西,往往我们想方设法去消除噪声或者减弱噪声,恢复原来的信号或者图像。可是,在矩阵运算过程中,
我们可能会遇到一些特殊的矩阵,计算复杂度如噪声毛刺一般,比周围领域内的计算复杂度许多。(病态系统)这就象simplex algorithm算法一样,按照常规思维看的话
需要O(m^2n)的计算复杂度,可是往往我们实验结果是线性的。这是为什么呢?这可以用smoothedcomplexity来解释。

matlab病态矩阵实验

构造病态矩阵 A,例如 n = 5 时 A 如下

 1     0     0     0     1
-1     1     0     0     1
-1    -1     1     0     1
-1    -1    -1     1     1
-1    -1    -1    -1     1

Test Code

% The script for ill-conditioned system example.
% date: 2015-11-22
% author: Clython

n = 80;
b = randn(n,1);

A = tril(ones(n) - ones(n)*2 + 2*eye(n));
A(:,end) = 1;
x = A\b;
disp('The ill-condition error :');
disp(norm(A*x - b));

% add noise to the matrix A
A = A + rand(n,n,'double');
x = A\b;
disp('After add noise to matrix A error:');
disp(norm(A*x - b));

Test Result

The ill-condition error :
7.2116

After add noise to matrix A error:
7.6684e-14

结论

噪声有时也是好的,可以噪声对原有的病态系统进行平滑,取得意想不到效果。

Why the Simplex Algorithm Usually Takes Polynomial Time

ABSTRACT
We introduce the smoothed analysis of algorithms, which is a hybrid of the worst-case and average-case analysis of algorithms. Essentially , we study the performance of algorithms under small random perturbations of their inputs. We show that the shadow vertex simplex algorithm has polynomial smoothed complexity.

Somothed Analysis of Algorithm

这篇文章对单精度算法的时间复杂度进行了分析和解释,为什么实际使用的单精度算法非常好。

版权声明:本文为博主原创文章,未经博主允许不得转载。 举报

相关文章推荐

[HbFS-]Red is good

http://www.gdfzoj.com/oj/problem/470 桌面上有R张红牌和B张黑牌,随机打乱顺序后放在桌面上,开始一张一张地翻牌,翻到红牌得到1美元,黑牌则付出1美元。可以随时停止...

Greedy is Good

作者:supernova 出处:http://community.topcoder.com/tc?module=Static&d1=tutorials&d2=greedyAlg John ...
  • JDPlus
  • JDPlus
  • 2014-02-16 11:24
  • 1505

精选:深入理解 Docker 内部原理及网络配置

网络绝对是任何系统的核心,对于容器而言也是如此。Docker 作为目前最火的轻量级容器技术,有很多令人称道的功能,如 Docker 的镜像管理。然而,Docker的网络一直以来都比较薄弱,所以我们有必要深入了解Docker的网络知识,以满足更高的网络需求。

[CodeForces]-672B-Different is Good

[CodeForces]-672B-Different is Good 原题: B - Different is Good Time Limit:2000MS Memory Limit:...

gdfzoj #470 Red is good(数学期望)

gdfzoj #470

CodeForces 672B Different is Good

CodeForces 672B Different is Goodtime limit per test:2 seconds memory limit per test:256 megabytes ...

What is a Good Library!

Cell libraries determine the overall performance of the synthesized logic. A good cell library will...

Making AI Fun: When Good Enough is Good Enough

Making good artificial intelligence for computer opponents is difficult. Programming a game like dra...

ldd(1) is good but objdump(1) is better(转)

Micro post to know shared libraries needed by a ELF binary. We can know them using the common ldd(1)...

Codeforces 672B Different is Good【水题】

B. Different is Good time limit per test 2 seconds memory limit per test 256 megabytes in...

oracle临时表 is very good

当缓存中间数据时候,需要创建一个临时表,其实oracle本身在这方面就已经考虑很全了,除非有些高级应用,我再考虑自己创建临时表。目前所有使用Oracle作为数据库支撑平台的应用,大部分数据量比较庞大的...
返回顶部
收藏助手
不良信息举报
您举报文章:深度学习:神经网络中的前向传播和反向传播算法推导
举报原因:
原因补充:

(最多只允许输入30个字)