4a1 | - | - | - | - | - | - |
- | - | - | - | 1 | 1 | |
- | - | - | - | 1 | - | |
- | - | - | - | - | 1 | |
- | - | - | - | - | - | |
- | - | - | - | - | - |
(A,B)---6*30*2---(0,1)(1,0)
做一个网络分类A和B,让B全是0,A为结构4a1,保持这个顺序不断的循环往复。当收敛误差为7e-4,收敛199次平均需要迭代6902.28次。
迭代次数的顺序取决于结构加法,在行列可自由变换的条件下因为
4a1-1可以得到3a1和3a3,如果某次迭代次数的排序中3a1的顺序就是1,3a3的顺序就是3,则用3点结构标定4a1,4a1迭代次数顺序的位置为(1+3)/2=2.
所谓迭代就是权重的形成过程,如果迭代次数有如此规律,那权重是否也与4a1-1的结构有关?
迭代 | 1 | 迭代 | 2 | 迭代 | ||||||||||||||||
- | - | - | - | - | - | 6902.28 | - | - | - | - | - | - | 36671.14 | - | - | - | - | - | - | 38440.27 |
- | - | - | - | 1 | 1 | - | - | - | - | - | 1 | - | - | - | - | 1 | - | |||
- | - | - | - | 1 | - | - | - | - | - | 1 | - | - | - | - | - | 1 | - | |||
- | - | - | - | - | 1 | - | - | - | - | - | 1 | - | - | - | - | - | 1 | |||
- | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |||
- | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |||
3 | 迭代 | 4 | 迭代 | |||||||||||||||||
- | - | - | - | - | - | 29372.49 | - | - | - | - | - | - | 28334.88 | |||||||
- | - | - | - | 1 | 1 | - | - | - | - | 1 | 1 | |||||||||
- | - | - | - | - | - | - | - | - | - | 1 | - | |||||||||
- | - | - | - | - | 1 | - | - | - | - | - | - | |||||||||
- | - | - | - | - | - | - | - | - | - | - | - | |||||||||
- | - | - | - | - | - | - | - | - | - | - | - | |||||||||
将4a1-1的4个结构具体展开,在某次收敛中结构1的权重为
这权重6*30的部分只有两列,右高左低,30*2的部分就是正负间隔
结构2某次收敛的权重,左高右低,也只有两列
结构3的权重左低右高,但高度差比结构1大
结构4的权重左高右低
结构4a1的权重
这权重也是有两列,两列高度相当。
现在把结构1,2,3,4的权重w1,w2,w3,w4相加得到权重w5
把w5代入分类4a1的原始网络,作为初始权重,实测表明仅需3次迭代就能收敛。
所以仅就这几个结构来说
4a1的收敛权重几乎就是4a1-1结构收敛权重的和。
W5的6*30部分数据
1 | 0.099 | 0.069 | -0.068 | -0.102 | -1.778 | -1.96019 |
2 | 0.216 | -0.183 | -0.197 | -0.214 | -2.19563 | -2.50814 |
3 | -0.07 | 0.01 | 0.135 | 0.023 | 1.456455 | -0.34379 |
4 | 0.094 | -0.011 | 0.04 | 0.075 | -1.62985 | -2.07942 |
5 | -0.098 | -0.133 | -0.08 | -0.106 | -3.83357 | -3.94324 |
6 | -0.198 | -0.141 | -0.062 | -0.022 | -1.08913 | -1.92879 |
7 | -0.244 | -0.018 | -0.121 | 0.026 | 1.608489 | 0.329102 |
8 | 0.008 | -0.191 | -0.026 | -0.113 | -0.87505 | -0.40056 |
9 | 0.111 | 0.031 | -0.046 | -0.022 | -0.4013 | 0.858905 |
10 | -0.078 | -0.28 | 0.12 | 6.94E-18 | 2.570196 | 2.213015 |
11 | 0.025 | -0.037 | 0.057 | 0.123 | -2.51322 | -0.37003 |
12 | 0.125 | 0.06 | -0.147 | 0.032 | 0.974471 | 1.307728 |
13 | 0.057 | -0.16 | 0.107 | -0.074 | -2.5777 | -2.64172 |
14 | 0.1 | -0.117 | 0.11 | -0.078 | -1.09287 | -0.46247 |
15 | -0.159 | 0.171 | 0.011 | 0.091 | -3.86627 | -1.54553 |
16 | -0.149 | -0.23 | -0.039 | -0.001 | 1.866513 | 0.579119 |
17 | -0.035 | 0.046 | 0.012 | -0.141 | 4.495039 | 4.890506 |
18 | 0.073 | 0.043 | -0.084 | -0.007 | -1.14246 | -2.22337 |
19 | 0.055 | -0.203 | 0.074 | -0.17 | 3.408362 | 2.576297 |
20 | -0.258 | 0.04 | -0.127 | 0.079 | -0.83834 | -0.51427 |
21 | -0.155 | 0.032 | 0.089 | 0.09 | 0.695908 | 0.718848 |
22 | -0.134 | -0.127 | 0.26 | 0.108 | 0.110317 | 0.756874 |
23 | 0.022 | -0.08 | 0.225 | -0.036 | 0.914259 | 0.841089 |
24 | -0.129 | 0.026 | -0.088 | -0.209 | 1.658184 | 1.926132 |
25 | 0.066 | -0.033 | -0.216 | -0.019 | 0.178686 | 0.618191 |
26 | -0.079 | -0.187 | -0.004 | -0.028 | -0.42528 | -1.59042 |
27 | 0.075 | -0.22 | 0.028 | -0.103 | -0.23232 | -0.75088 |
28 | 0.102 | 0.05 | 0.109 | 0.01 | -0.94211 | -1.09273 |
29 | -0.115 | -0.17 | 0.143 | -0.089 | 3.091096 | 3.040419 |
30 | -0.002 | -0.069 | 0.053 | 0.144 | -1.8598 | -0.32205 |