深度学习框架tensorflow实战（构建完整Cifar分类模型）

最新推荐文章于 2021-04-26 20:57:19 发布

wujiekd

最新推荐文章于 2021-04-26 20:57:19 发布

阅读量324

点赞数 2

分类专栏： Tensorflow一

本文链接：https://blog.csdn.net/weixin_43999137/article/details/96442139

版权

Tensorflow一专栏收录该内容

8 篇文章 0 订阅

订阅专栏

提前了解~~

tensorflow中的LRN函数详解：https://blog.csdn.net/banana1006034246/article/details/75204013

基于前面的分析，可以比较深刻地掌握了神经网络的含义了，现在我们构建一个完整的Cifar分类模型，前提是得用前面那份博客把我们获得的RGB图像转化为灰度图像并且将其缩小到24乘以24

设置参数

x = tf.placeholder(tf.float32, [None, 24 * 24])
y = tf.placeholder(tf.float32, [None, len(names)])
W1 = tf.Variable(tf.random_normal([5, 5, 1, 64]))     #设置第一层卷积层参数，卷积核大小
b1 = tf.Variable(tf.random_normal([64]))
W2 = tf.Variable(tf.random_normal([5, 5, 64, 64]))    #设置第一层卷积层参数，卷积核大小
b2 = tf.Variable(tf.random_normal([64]))
W3 = tf.Variable(tf.random_normal([6*6*64, 1024]))    #接下来两个全连接层
b3 = tf.Variable(tf.random_normal([1024]))
W_out = tf.Variable(tf.random_normal([1024, len(names)]))
b_out = tf.Variable(tf.random_normal([len(names)]))

卷积函数和池化函数

def conv_layer(x, W, b):
    conv = tf.nn.conv2d(x, W, strides=[1, 1, 1, 1], padding='SAME')
    conv_with_b = tf.nn.bias_add(conv, b)
    conv_out = tf.nn.relu(conv_with_b)
    return conv_out


def maxpool_layer(conv, k=2):
    return tf.nn.max_pool(conv, ksize=[1, k, k, 1], strides=[1, k, k, 1], padding='SAME')

把上面的参数和函数集合到该模型当中

def model():
    x_reshaped = tf.reshape(x, shape=[-1, 24, 24, 1])   #把x转换一下

    conv_out1 = conv_layer(x_reshaped, W1, b1)
    maxpool_out1 = maxpool_layer(conv_out1)
    #提出了LRN层，对局部神经元的活动创建竞争机制，使得其中响应比较大的值变得相对更大，并抑制其他反馈较小的神经元，增强了模型的泛化能力。
    #推荐阅读http://blog.csdn.net/banana1006034246/article/details/75204013
    norm1 = tf.nn.lrn(maxpool_out1, 4, bias=1.0, alpha=0.001 / 9.0, beta=0.75)
    conv_out2 = conv_layer(norm1, W2, b2)
    norm2 = tf.nn.lrn(conv_out2, 4, bias=1.0, alpha=0.001 / 9.0, beta=0.75)
    maxpool_out2 = maxpool_layer(norm2)

    maxpool_reshaped = tf.reshape(maxpool_out2, [-1, W3.get_shape().as_list()[0]])
    local = tf.add(tf.matmul(maxpool_reshaped, W3), b3)
    local_out = tf.nn.relu(local)

    out = tf.add(tf.matmul(local_out, W_out), b_out)
    return out

计算最少损失

learning_rate = 0.001
model_op = model()

cost = tf.reduce_mean(
    tf.nn.softmax_cross_entropy_with_logits(logits=model_op, labels=y)
)
train_op = tf.train.AdamOptimizer(learning_rate=learning_rate).minimize(cost)

correct_pred = tf.equal(tf.argmax(model_op, 1), tf.argmax(y, 1))
accuracy = tf.reduce_mean(tf.cast(correct_pred, tf.float32))

执行

有个地方需要注意，因为minst数据集获取标签时就用了one_hot编码，但Cifar不是，所以我们得调用one_hot函数

with tf.Session() as sess:
    sess.run(tf.global_variables_initializer())
    onehot_labels = tf.one_hot(labels, len(names), axis=-1)
    olearning_rate = 0.001
model_op = model()

cost = tf.reduce_mean(
    tf.nn.softmax_cross_entropy_with_logits(logits=model_op, labels=y)
)
train_op = tf.train.AdamOptimizer(learning_rate=learning_rate).minimize(cost)

correct_pred = tf.equal(tf.argmax(model_op, 1), tf.argmax(y, 1))
accuracy = tf.reduce_mean(tf.cast(correct_pred, tf.float32))nehot_vals = sess.run(onehot_labels)
    batch_size = 64
    print('batch size', batch_size)
    for j in range(0, 1000):
        avg_accuracy_val = 0.
        batch_count = 0.
        for i in range(0, len(data), batch_size):
            batch_data = data[i:i+batch_size, :]
            batch_onehot_vals = onehot_vals[i:i+batch_size, :]
            _, accuracy_val = sess.run([train_op, accuracy], feed_dict={x: batch_data, y: batch_onehot_vals})
            avg_accuracy_val += accuracy_val
            batch_count += 1.
        avg_accuracy_val /= batch_count
        print('Epoch {}. Avg accuracy {}'.format(j, avg_accuracy_val))

输出~~~~

建议没有GPU的不用轻易尝试，我用的是学校的阿里云服务器特斯拉的都跑了差不多1个多小时~~~~

batch size 64
Epoch 0. Avg accuracy 0.22490409207161124
Epoch 1. Avg accuracy 0.27775335677749363
Epoch 2. Avg accuracy 0.2989530051150895
Epoch 3. Avg accuracy 0.31140105498721227
Epoch 4. Avg accuracy 0.32366927749360613
Epoch 5. Avg accuracy 0.33122202685422
Epoch 6. Avg accuracy 0.3412523976982097
Epoch 7. Avg accuracy 0.3487052429667519
Epoch 8. Avg accuracy 0.3607336956521739
Epoch 9. Avg accuracy 0.36429028132992325
Epoch 10. Avg accuracy 0.36850623401534527
Epoch 11. Avg accuracy 0.3734015345268542
Epoch 12. Avg accuracy 0.38141384271099743
Epoch 13. Avg accuracy 0.38726822250639387
Epoch 14. Avg accuracy 0.39022538363171355
Epoch 15. Avg accuracy 0.39570012787723785
Epoch 16. Avg accuracy 0.40017583120204603
Epoch 17. Avg accuracy 0.39981617647058826
Epoch 18. Avg accuracy 0.40513107416879796
Epoch 19. Avg accuracy 0.4108855498721228
Epoch 20. Avg accuracy 0.4133232097186701
Epoch 21. Avg accuracy 0.4110453964194373
Epoch 22. Avg accuracy 0.4207960358056266
Epoch 23. Avg accuracy 0.4186580882352941
Epoch 24. Avg accuracy 0.42225463554987214
Epoch 25. Avg accuracy 0.4290281329923274
Epoch 26. Avg accuracy 0.43548193734015345
Epoch 27. Avg accuracy 0.44027733375959077
Epoch 28. Avg accuracy 0.42764945652173914
Epoch 29. Avg accuracy 0.4374800191815857
Epoch 30. Avg accuracy 0.4466512148337596
Epoch 31. Avg accuracy 0.434522858056266
Epoch 32. Avg accuracy 0.4510669757033248
Epoch 33. Avg accuracy 0.45674152813299235
Epoch 34. Avg accuracy 0.45522298593350385
Epoch 35. Avg accuracy 0.46537324168797956
Epoch 36. Avg accuracy 0.4524656329923274
Epoch 37. Avg accuracy 0.4618566176470588
Epoch 38. Avg accuracy 0.46351502557544755
Epoch 39. Avg accuracy 0.46525335677749363
Epoch 40. Avg accuracy 0.47306585677749363
Epoch 41. Avg accuracy 0.4679108056265985
Epoch 42. Avg accuracy 0.4765824808184143
Epoch 43. Avg accuracy 0.47991927749360613
Epoch 44. Avg accuracy 0.4804587595907928
Epoch 45. Avg accuracy 0.47346547314578
Epoch 46. Avg accuracy 0.48137787723785164
Epoch 47. Avg accuracy 0.48399536445012786
Epoch 48. Avg accuracy 0.4804787404092072
Epoch 49. Avg accuracy 0.49116847826086957
Epoch 50. Avg accuracy 0.4843350383631714
Epoch 51. Avg accuracy 0.48235693734015345
Epoch 52. Avg accuracy 0.4981218030690537
Epoch 53. Avg accuracy 0.4986413043478261
Epoch 54. Avg accuracy 0.4774016943734015
Epoch 55. Avg accuracy 0.4991008631713555
Epoch 56. Avg accuracy 0.5031369884910486
Epoch 57. Avg accuracy 0.500619405370844
Epoch 58. Avg accuracy 0.5092511189258312
Epoch 59. Avg accuracy 0.49896099744245526
Epoch 60. Avg accuracy 0.5146259590792839
Epoch 61. Avg accuracy 0.5047354539641944
Epoch 62. Avg accuracy 0.515744884910486
Epoch 63. Avg accuracy 0.5180027173913043
Epoch 64. Avg accuracy 0.5110893542199488
Epoch 65. Avg accuracy 0.5235174232736572
Epoch 66. Avg accuracy 0.5140864769820972
Epoch 67. Avg accuracy 0.5028172953964194
Epoch 68. Avg accuracy 0.5198809143222506
Epoch 69. Avg accuracy 0.5236373081841432
Epoch 70. Avg accuracy 0.5264945652173914
Epoch 71. Avg accuracy 0.5260150255754475
Epoch 72. Avg accuracy 0.5228980179028133
Epoch 73. Avg accuracy 0.5283128196930946
Epoch 74. Avg accuracy 0.5162044437340153
Epoch 75. Avg accuracy 0.5286125319693095
Epoch 76. Avg accuracy 0.5278932225063938
Epoch 77. Avg accuracy 0.5375439578005116
Epoch 78. Avg accuracy 0.5293118606138107
Epoch 79. Avg accuracy 0.5470348465473146
Epoch 80. Avg accuracy 0.5332680626598465
Epoch 81. Avg accuracy 0.5315696930946292
Epoch 82. Avg accuracy 0.5439977621483376
Epoch 83. Avg accuracy 0.5269341432225064
Epoch 84. Avg accuracy 0.5242167519181585
Epoch 85. Avg accuracy 0.541979699488491
Epoch 86. Avg accuracy 0.5350663363171355
Epoch 87. Avg accuracy 0.5439977621483376
Epoch 88. Avg accuracy 0.5310102301790282
Epoch 89. Avg accuracy 0.550411604859335
Epoch 90. Avg accuracy 0.5494725063938619
Epoch 91. Avg accuracy 0.5461357097186701
Epoch 92. Avg accuracy 0.5410805626598465
Epoch 93. Avg accuracy 0.5503117007672634
Epoch 94. Avg accuracy 0.5590233375959079
Epoch 95. Avg accuracy 0.5428588554987213
Epoch 96. Avg accuracy 0.5467351342710998
Epoch 97. Avg accuracy 0.5483935421994884
Epoch 98. Avg accuracy 0.5535485933503836
Epoch 99. Avg accuracy 0.5514506074168798
Epoch 100. Avg accuracy 0.5509311061381074
Epoch 101. Avg accuracy 0.5517902813299232
Epoch 102. Avg accuracy 0.5665561061381074
Epoch 103. Avg accuracy 0.5545076726342711
Epoch 104. Avg accuracy 0.5601622442455243
Epoch 105. Avg accuracy 0.5585437979539642
Epoch 106. Avg accuracy 0.5573249680306905
Epoch 107. Avg accuracy 0.560082320971867
Epoch 108. Avg accuracy 0.5726702365728901
Epoch 109. Avg accuracy 0.5640784846547314
Epoch 110. Avg accuracy 0.5710717710997443
Epoch 111. Avg accuracy 0.5713515025575447
Epoch 112. Avg accuracy 0.5562859654731458
Epoch 113. Avg accuracy 0.5795835997442456
Epoch 114. Avg accuracy 0.5875759271099744
Epoch 115. Avg accuracy 0.5723105818414322
Epoch 116. Avg accuracy 0.5725303708439897
Epoch 117. Avg accuracy 0.5573849104859335
Epoch 118. Avg accuracy 0.5637787723785166
Epoch 119. Avg accuracy 0.5639386189258312
Epoch 120. Avg accuracy 0.5670955882352942
Epoch 121. Avg accuracy 0.5741088554987213
Epoch 122. Avg accuracy 0.5622202685421995
Epoch 123. Avg accuracy 0.5602821291560103
Epoch 124. Avg accuracy 0.5689937659846548
Epoch 125. Avg accuracy 0.5869565217391305
Epoch 126. Avg accuracy 0.590832800511509
Epoch 127. Avg accuracy 0.5965473145780051
Epoch 128. Avg accuracy 0.609315057544757
Epoch 129. Avg accuracy 0.59375
Epoch 130. Avg accuracy 0.5974264705882353
Epoch 131. Avg accuracy 0.598405530690537
Epoch 132. Avg accuracy 0.5826007033248082
Epoch 133. Avg accuracy 0.5710717710997443
Epoch 134. Avg accuracy 0.5843989769820972
Epoch 135. Avg accuracy 0.5838794757033248
Epoch 136. Avg accuracy 0.5835797634271099
Epoch 137. Avg accuracy 0.5700927109974424
Epoch 138. Avg accuracy 0.5718909846547314
Epoch 139. Avg accuracy 0.5796835038363172
Epoch 140. Avg accuracy 0.5815816815856778
Epoch 141. Avg accuracy 0.5768462276214834
Epoch 142. Avg accuracy 0.585378037084399
Epoch 143. Avg accuracy 0.5873161764705882
Epoch 144. Avg accuracy 0.5828604539641944
Epoch 145. Avg accuracy 0.5869365409207161
Epoch 146. Avg accuracy 0.6005634590792839
Epoch 147. Avg accuracy 0.5995244565217391
Epoch 148. Avg accuracy 0.5994245524296675
Epoch 149. Avg accuracy 0.6058184143222506
Epoch 150. Avg accuracy 0.6165880754475703
Epoch 151. Avg accuracy 0.6157688618925832
Epoch 152. Avg accuracy 0.6254395780051151
Epoch 153. Avg accuracy 0.6240009590792839
Epoch 154. Avg accuracy 0.617247442455243
Epoch 155. Avg accuracy 0.6137707800511509
Epoch 156. Avg accuracy 0.6088954603580563
Epoch 157. Avg accuracy 0.6104339833759591
Epoch 158. Avg accuracy 0.6035206202046036
Epoch 159. Avg accuracy 0.5892543158567775
Epoch 160. Avg accuracy 0.595488331202046
Epoch 161. Avg accuracy 0.5950287723785166
Epoch 162. Avg accuracy 0.6003436700767263
Epoch 163. Avg accuracy 0.5961277173913043
Epoch 164. Avg accuracy 0.5968070652173914
Epoch 165. Avg accuracy 0.5902533567774936
Epoch 166. Avg accuracy 0.6015425191815856
Epoch 167. Avg accuracy 0.6011628836317136
Epoch 168. Avg accuracy 0.6020820012787724
Epoch 169. Avg accuracy 0.6065776854219949
Epoch 170. Avg accuracy 0.609375
Epoch 171. Avg accuracy 0.6276774296675192
Epoch 172. Avg accuracy 0.6270580242966752
Epoch 173. Avg accuracy 0.6336916560102301
Epoch 174. Avg accuracy 0.6470987851662404
Epoch 175. Avg accuracy 0.6355698529411765
Epoch 176. Avg accuracy 0.6402054028132992
Epoch 177. Avg accuracy 0.6507952365728901
Epoch 178. Avg accuracy 0.6439617966751918
Epoch 179. Avg accuracy 0.6319733056265985
Epoch 180. Avg accuracy 0.618546195652174
Epoch 181. Avg accuracy 0.6065976662404092
Epoch 182. Avg accuracy 0.6071371483375959
Epoch 183. Avg accuracy 0.6005434782608695
Epoch 184. Avg accuracy 0.6104140025575447
Epoch 185. Avg accuracy 0.6104339833759591
Epoch 186. Avg accuracy 0.611173273657289
Epoch 187. Avg accuracy 0.6142503196930946
Epoch 188. Avg accuracy 0.6138906649616368
Epoch 189. Avg accuracy 0.632193094629156
Epoch 190. Avg accuracy 0.6287164322250639
Epoch 191. Avg accuracy 0.6320132672634271
Epoch 192. Avg accuracy 0.6311740728900256
Epoch 193. Avg accuracy 0.6349704283887468
Epoch 194. Avg accuracy 0.6411445012787724
Epoch 195. Avg accuracy 0.6335118286445013
Epoch 196. Avg accuracy 0.6340712915601023
Epoch 197. Avg accuracy 0.6138107416879796
Epoch 198. Avg accuracy 0.6123121803069054
Epoch 199. Avg accuracy 0.617806905370844
Epoch 200. Avg accuracy 0.6156689578005116
Epoch 201. Avg accuracy 0.6269181585677749
Epoch 202. Avg accuracy 0.6240409207161125
Epoch 203. Avg accuracy 0.631573689258312
Epoch 204. Avg accuracy 0.6351302749360613
Epoch 205. Avg accuracy 0.645280530690537
Epoch 206. Avg accuracy 0.6442015664961637
Epoch 207. Avg accuracy 0.6371283567774936
Epoch 208. Avg accuracy 0.620344469309463
Epoch 209. Avg accuracy 0.6240808823529411
Epoch 210. Avg accuracy 0.6264785805626598
Epoch 211. Avg accuracy 0.6209039322250639
Epoch 212. Avg accuracy 0.6339314258312021
Epoch 213. Avg accuracy 0.631633631713555
Epoch 214. Avg accuracy 0.6295356457800512
Epoch 215. Avg accuracy 0.6275375639386189
Epoch 216. Avg accuracy 0.6333120204603581
Epoch 217. Avg accuracy 0.6401054987212276
Epoch 218. Avg accuracy 0.6479179987212276
Epoch 219. Avg accuracy 0.6596467391304348
Epoch 220. Avg accuracy 0.6792878836317136
Epoch 221. Avg accuracy 0.6762907608695652
Epoch 222. Avg accuracy 0.6833240089514067
Epoch 223. Avg accuracy 0.6756114130434783
Epoch 224. Avg accuracy 0.6782488810741688
Epoch 225. Avg accuracy 0.674292679028133
Epoch 226. Avg accuracy 0.6714554028132992
Epoch 227. Avg accuracy 0.677949168797954
Epoch 228. Avg accuracy 0.665800831202046
Epoch 229. Avg accuracy 0.6647018861892583
Epoch 230. Avg accuracy 0.666480179028133
Epoch 231. Avg accuracy 0.6563499040920716
Epoch 232. Avg accuracy 0.6477381713554987
Epoch 233. Avg accuracy 0.6436820652173914
Epoch 234. Avg accuracy 0.6435222186700768
Epoch 235. Avg accuracy 0.6439617966751918
Epoch 236. Avg accuracy 0.649676310741688
Epoch 237. Avg accuracy 0.637088395140665
Epoch 238. Avg accuracy 0.6429028132992327
Epoch 239. Avg accuracy 0.6560901534526854
Epoch 240. Avg accuracy 0.6591871803069054
Epoch 241. Avg accuracy 0.670196611253197
Epoch 242. Avg accuracy 0.6769101662404092
Epoch 243. Avg accuracy 0.6869205562659847
Epoch 244. Avg accuracy 0.691775895140665
Epoch 245. Avg accuracy 0.700207800511509
Epoch 246. Avg accuracy 0.7060821611253197
Epoch 247. Avg accuracy 0.6986093350383632
Epoch 248. Avg accuracy 0.6889186381074168
Epoch 249. Avg accuracy 0.6982696611253197
Epoch 250. Avg accuracy 0.6936141304347826
Epoch 251. Avg accuracy 0.6832440856777494
Epoch 252. Avg accuracy 0.6726542519181585
Epoch 253. Avg accuracy 0.6722546355498721
Epoch 254. Avg accuracy 0.6681985294117647
Epoch 255. Avg accuracy 0.6565497122762148
Epoch 256. Avg accuracy 0.6546515345268542
Epoch 257. Avg accuracy 0.6467790920716112
Epoch 258. Avg accuracy 0.6450207800511509
Epoch 259. Avg accuracy 0.6571091751918159
Epoch 260. Avg accuracy 0.6633232097186701
Epoch 261. Avg accuracy 0.6742527173913043
Epoch 262. Avg accuracy 0.6753716432225064
Epoch 263. Avg accuracy 0.6800471547314578
Epoch 264. Avg accuracy 0.6872202685421995
Epoch 265. Avg accuracy 0.691656010230179
Epoch 266. Avg accuracy 0.6975503516624041
Epoch 267. Avg accuracy 0.6962715792838875
Epoch 268. Avg accuracy 0.6977101982097187
Epoch 269. Avg accuracy 0.7089993606138107
Epoch 270. Avg accuracy 0.7098984974424553
Epoch 271. Avg accuracy 0.715712915601023
Epoch 272. Avg accuracy 0.7183703644501279
Epoch 273. Avg accuracy 0.7098185741687979
Epoch 274. Avg accuracy 0.6996882992327366
Epoch 275. Avg accuracy 0.6863011508951407
Epoch 276. Avg accuracy 0.66244405370844
Epoch 277. Avg accuracy 0.6550911125319693
Epoch 278. Avg accuracy 0.6620644181585678
Epoch 279. Avg accuracy 0.6663602941176471
Epoch 280. Avg accuracy 0.6712955562659847
Epoch 281. Avg accuracy 0.6801670396419437
Epoch 282. Avg accuracy 0.6920556265984654
Epoch 283. Avg accuracy 0.6983895460358056
Epoch 284. Avg accuracy 0.6994085677749361
Epoch 285. Avg accuracy 0.7051230818414322
Epoch 286. Avg accuracy 0.7120164641943734
Epoch 287. Avg accuracy 0.7140545076726342
Epoch 288. Avg accuracy 0.7159127237851662
Epoch 289. Avg accuracy 0.7167319373401535
Epoch 290. Avg accuracy 0.7190297314578005
Epoch 291. Avg accuracy 0.7094789002557544
Epoch 292. Avg accuracy 0.6844828964194374
Epoch 293. Avg accuracy 0.6711756713554987
Epoch 294. Avg accuracy 0.682604699488491
Epoch 295. Avg accuracy 0.6855818414322251
Epoch 296. Avg accuracy 0.6830842391304348
Epoch 297. Avg accuracy 0.6844429347826086
Epoch 298. Avg accuracy 0.6925151854219949
Epoch 299. Avg accuracy 0.6999280690537084
Epoch 300. Avg accuracy 0.7113171355498721
Epoch 301. Avg accuracy 0.7233256074168798
Epoch 302. Avg accuracy 0.7321771099744245
Epoch 303. Avg accuracy 0.7401094948849105
Epoch 304. Avg accuracy 0.747582320971867
Epoch 305. Avg accuracy 0.7549152813299232
Epoch 306. Avg accuracy 0.7593909846547314
Epoch 307. Avg accuracy 0.7607097186700768
Epoch 308. Avg accuracy 0.7633272058823529
Epoch 309. Avg accuracy 0.7617886828644501
Epoch 310. Avg accuracy 0.7538363171355499
Epoch 311. Avg accuracy 0.7382912404092071
Epoch 312. Avg accuracy 0.7168318414322251
Epoch 313. Avg accuracy 0.7009670716112532
Epoch 314. Avg accuracy 0.6968710038363172
Epoch 315. Avg accuracy 0.6885589833759591
Epoch 316. Avg accuracy 0.6873401534526854
Epoch 317. Avg accuracy 0.6937939578005116
Epoch 318. Avg accuracy 0.6941536125319693
Epoch 319. Avg accuracy 0.6962915601023018
Epoch 320. Avg accuracy 0.6955322890025576
Epoch 321. Avg accuracy 0.6977101982097187
Epoch 322. Avg accuracy 0.6972506393861893
Epoch 323. Avg accuracy 0.6985294117647058
Epoch 324. Avg accuracy 0.70474344629156
Epoch 325. Avg accuracy 0.7081601662404092
Epoch 326. Avg accuracy 0.7126558503836317
Epoch 327. Avg accuracy 0.7182504795396419
Epoch 328. Avg accuracy 0.7227861253196931
Epoch 329. Avg accuracy 0.7270020780051151
Epoch 330. Avg accuracy 0.7311181265984654
Epoch 331. Avg accuracy 0.7350143861892583
Epoch 332. Avg accuracy 0.7369325447570333
Epoch 333. Avg accuracy 0.7423473465473146
Epoch 334. Avg accuracy 0.7475623401534527
Epoch 335. Avg accuracy 0.7529971227621484
Epoch 336. Avg accuracy 0.7601502557544757
Epoch 337. Avg accuracy 0.7650255754475703
Epoch 338. Avg accuracy 0.767303388746803
Epoch 339. Avg accuracy 0.7684422953964194
Epoch 340. Avg accuracy 0.7668238491048593
Epoch 341. Avg accuracy 0.7522178708439897
Epoch 342. Avg accuracy 0.7360134271099744
Epoch 343. Avg accuracy 0.7420875959079284
Epoch 344. Avg accuracy 0.7448649296675192
Epoch 345. Avg accuracy 0.7402493606138107
Epoch 346. Avg accuracy 0.733016304347826
Epoch 347. Avg accuracy 0.733076246803069
Epoch 348. Avg accuracy 0.7351742327365729
Epoch 349. Avg accuracy 0.7383112212276215
Epoch 350. Avg accuracy 0.7430266943734015
Epoch 351. Avg accuracy 0.7461237212276215
Epoch 352. Avg accuracy 0.7491008631713555
Epoch 353. Avg accuracy 0.7523177749360613
Epoch 354. Avg accuracy 0.7538363171355499
Epoch 355. Avg accuracy 0.7568734015345269
Epoch 356. Avg accuracy 0.75943094629156
Epoch 357. Avg accuracy 0.7633072250639387
Epoch 358. Avg accuracy 0.7668837915601023
Epoch 359. Avg accuracy 0.7703804347826086
Epoch 360. Avg accuracy 0.771639226342711
Epoch 361. Avg accuracy 0.7735973465473146
Epoch 362. Avg accuracy 0.7765744884910486
Epoch 363. Avg accuracy 0.7793118606138107
Epoch 364. Avg accuracy 0.7799912084398977
Epoch 365. Avg accuracy 0.7802109974424553
Epoch 366. Avg accuracy 0.7792718989769821
Epoch 367. Avg accuracy 0.7771339514066496
Epoch 368. Avg accuracy 0.7727581521739131
Epoch 369. Avg accuracy 0.767303388746803
Epoch 370. Avg accuracy 0.7685621803069054
Epoch 371. Avg accuracy 0.7719988810741688
Epoch 372. Avg accuracy 0.7768742007672634
Epoch 373. Avg accuracy 0.7824088874680307
Epoch 374. Avg accuracy 0.7850063938618926
Epoch 375. Avg accuracy 0.7899616368286445
Epoch 376. Avg accuracy 0.7906010230179028
Epoch 377. Avg accuracy 0.7920796035805626
Epoch 378. Avg accuracy 0.792659047314578
Epoch 379. Avg accuracy 0.7940177429667519
Epoch 380. Avg accuracy 0.7922394501278772
Epoch 381. Avg accuracy 0.7907209079283888
Epoch 382. Avg accuracy 0.7894421355498721
Epoch 383. Avg accuracy 0.7881034207161125
Epoch 384. Avg accuracy 0.7883431905370843
Epoch 385. Avg accuracy 0.7909606777493606
Epoch 386. Avg accuracy 0.7937579923273658
Epoch 387. Avg accuracy 0.7964753836317136
Epoch 388. Avg accuracy 0.7973745204603581
Epoch 389. Avg accuracy 0.7994725063938619
Epoch 390. Avg accuracy 0.800531489769821
Epoch 391. Avg accuracy 0.8016104539641944
Epoch 392. Avg accuracy 0.8006313938618926
Epoch 393. Avg accuracy 0.8017503196930946
Epoch 394. Avg accuracy 0.7999520460358056
Epoch 395. Avg accuracy 0.7994525255754475
Epoch 396. Avg accuracy 0.8010110294117647
Epoch 397. Avg accuracy 0.8045875959079284
Epoch 398. Avg accuracy 0.8075247762148338
Epoch 399. Avg accuracy 0.8101222826086957
Epoch 400. Avg accuracy 0.811321131713555
Epoch 401. Avg accuracy 0.8125199808184144
Epoch 402. Avg accuracy 0.8127797314578005
Epoch 403. Avg accuracy 0.8145180626598465
Epoch 404. Avg accuracy 0.8164961636828645
Epoch 405. Avg accuracy 0.8187340153452686
Epoch 406. Avg accuracy 0.8202725383631714
Epoch 407. Avg accuracy 0.8218110613810742
Epoch 408. Avg accuracy 0.8247482416879796
Epoch 409. Avg accuracy 0.8279052109974424
Epoch 410. Avg accuracy 0.8295236572890026
Epoch 411. Avg accuracy 0.8305826406649617
Epoch 412. Avg accuracy 0.8332001278772379
Epoch 413. Avg accuracy 0.8340193414322251
Epoch 414. Avg accuracy 0.8371962915601023
Epoch 415. Avg accuracy 0.8373960997442456
Epoch 416. Avg accuracy 0.8382952365728901
Epoch 417. Avg accuracy 0.8402333759590793
Epoch 418. Avg accuracy 0.8379355818414322
Epoch 419. Avg accuracy 0.8388946611253197
Epoch 420. Avg accuracy 0.8399536445012787
Epoch 421. Avg accuracy 0.840093510230179
Epoch 422. Avg accuracy 0.8409926470588235
Epoch 423. Avg accuracy 0.8389346227621484
Epoch 424. Avg accuracy 0.839593989769821
Epoch 425. Avg accuracy 0.8421914961636828
Epoch 426. Avg accuracy 0.8410925511508951
Epoch 427. Avg accuracy 0.8467671035805626
Epoch 428. Avg accuracy 0.8478660485933504
Epoch 429. Avg accuracy 0.8505035166240409
Epoch 430. Avg accuracy 0.8526214833759591
Epoch 431. Avg accuracy 0.8542199488491049
Epoch 432. Avg accuracy 0.8576166879795396
Epoch 433. Avg accuracy 0.8584159207161125
Epoch 434. Avg accuracy 0.8542599104859335
Epoch 435. Avg accuracy 0.8529411764705882
Epoch 436. Avg accuracy 0.853360773657289
Epoch 437. Avg accuracy 0.8541999680306905
Epoch 438. Avg accuracy 0.8596747122762148
Epoch 439. Avg accuracy 0.8641703964194374
Epoch 440. Avg accuracy 0.8663882672634271
Epoch 441. Avg accuracy 0.8687260230179028
Epoch 442. Avg accuracy 0.8676070971867008
Epoch 443. Avg accuracy 0.867307384910486
Epoch 444. Avg accuracy 0.8603740409207161
Epoch 445. Avg accuracy 0.8589753836317136
Epoch 446. Avg accuracy 0.8613730818414322
Epoch 447. Avg accuracy 0.8643502237851662
Epoch 448. Avg accuracy 0.8672874040920716
Epoch 449. Avg accuracy 0.8716232416879796
Epoch 450. Avg accuracy 0.8742806905370843
Epoch 451. Avg accuracy 0.8763187340153452
Epoch 452. Avg accuracy 0.8796355498721228
Epoch 453. Avg accuracy 0.8802749360613811
Epoch 454. Avg accuracy 0.8806146099744245
Epoch 455. Avg accuracy 0.879835358056266
Epoch 456. Avg accuracy 0.88119405370844
Epoch 457. Avg accuracy 0.8758791560102301
Epoch 458. Avg accuracy 0.8758991368286445
Epoch 459. Avg accuracy 0.8773577365728901
Epoch 460. Avg accuracy 0.8793558184143222
Epoch 461. Avg accuracy 0.8817335358056266
Epoch 462. Avg accuracy 0.883431905370844
Epoch 463. Avg accuracy 0.8813139386189258
Epoch 464. Avg accuracy 0.8863690856777494
Epoch 465. Avg accuracy 0.8931026214833759
Epoch 466. Avg accuracy 0.8942415281329923
Epoch 467. Avg accuracy 0.8958599744245525
Epoch 468. Avg accuracy 0.8963994565217391
Epoch 469. Avg accuracy 0.8979379795396419
Epoch 470. Avg accuracy 0.8974384590792839
Epoch 471. Avg accuracy 0.8957600703324808
Epoch 472. Avg accuracy 0.8938419117647058
Epoch 473. Avg accuracy 0.893542199488491
Epoch 474. Avg accuracy 0.8944613171355499
Epoch 475. Avg accuracy 0.8918438299232737
Epoch 476. Avg accuracy 0.8895660166240409
Epoch 477. Avg accuracy 0.8905850383631714
Epoch 478. Avg accuracy 0.8941216432225064
Epoch 479. Avg accuracy 0.9005754475703325
Epoch 480. Avg accuracy 0.9011548913043478
Epoch 481. Avg accuracy 0.902093989769821
Epoch 482. Avg accuracy 0.9039721867007673
Epoch 483. Avg accuracy 0.9056106138107417
Epoch 484. Avg accuracy 0.9052509590792839
Epoch 485. Avg accuracy 0.9049712276214834
Epoch 486. Avg accuracy 0.9075887148337596
Epoch 487. Avg accuracy 0.9082480818414322
Epoch 488. Avg accuracy 0.9030530690537084
Epoch 489. Avg accuracy 0.9025735294117647
Epoch 490. Avg accuracy 0.9042119565217391
Epoch 491. Avg accuracy 0.9088075447570333
Epoch 492. Avg accuracy 0.9123441496163683
Epoch 493. Avg accuracy 0.9182584718670077
Epoch 494. Avg accuracy 0.9191176470588235
Epoch 495. Avg accuracy 0.9218949808184144
Epoch 496. Avg accuracy 0.9208959398976982
Epoch 497. Avg accuracy 0.923733216112532
Epoch 498. Avg accuracy 0.9249520460358056
Epoch 499. Avg accuracy 0.9239330242966752
Epoch 500. Avg accuracy 0.9249520460358056
Epoch 501. Avg accuracy 0.9225943094629157
Epoch 502. Avg accuracy 0.9216951726342711
Epoch 503. Avg accuracy 0.9250519501278772
Epoch 504. Avg accuracy 0.9245724104859335
Epoch 505. Avg accuracy 0.9253716432225064
Epoch 506. Avg accuracy 0.924912084398977
Epoch 507. Avg accuracy 0.9293877877237852
Epoch 508. Avg accuracy 0.9334438938618926
Epoch 509. Avg accuracy 0.9341032608695652
Epoch 510. Avg accuracy 0.9338834718670077
Epoch 511. Avg accuracy 0.934343030690537
Epoch 512. Avg accuracy 0.9388187340153452
Epoch 513. Avg accuracy 0.9385589833759591
Epoch 514. Avg accuracy 0.9395979859335039
Epoch 515. Avg accuracy 0.9394781010230179
Epoch 516. Avg accuracy 0.942395300511509
Epoch 517. Avg accuracy 0.9407768542199488
Epoch 518. Avg accuracy 0.9420156649616368
Epoch 519. Avg accuracy 0.9434143222506394
Epoch 520. Avg accuracy 0.9426350703324808
Epoch 521. Avg accuracy 0.9403372762148338
Epoch 522. Avg accuracy 0.9426350703324808
Epoch 523. Avg accuracy 0.9437140345268542
Epoch 524. Avg accuracy 0.9431745524296675
Epoch 525. Avg accuracy 0.9462515984654731
Epoch 526. Avg accuracy 0.946611253196931
Epoch 527. Avg accuracy 0.9465712915601023
Epoch 528. Avg accuracy 0.9452725383631714
Epoch 529. Avg accuracy 0.9478700447570333
Epoch 530. Avg accuracy 0.9467710997442456
Epoch 531. Avg accuracy 0.9460717710997443
Epoch 532. Avg accuracy 0.9483296035805626
Epoch 533. Avg accuracy 0.9475903132992327
Epoch 534. Avg accuracy 0.9493086636828645
Epoch 535. Avg accuracy 0.9497882033248082
Epoch 536. Avg accuracy 0.9492287404092071
Epoch 537. Avg accuracy 0.9474704283887468
Epoch 538. Avg accuracy 0.9481297953964194
Epoch 539. Avg accuracy 0.951946131713555
Epoch 540. Avg accuracy 0.951826246803069
Epoch 541. Avg accuracy 0.9506673593350383
Epoch 542. Avg accuracy 0.9501078964194374
Epoch 543. Avg accuracy 0.9541839833759591
Epoch 544. Avg accuracy 0.9533248081841432
Epoch 545. Avg accuracy 0.9566016624040921
Epoch 546. Avg accuracy 0.9526654411764706
Epoch 547. Avg accuracy 0.9558623721227621
Epoch 548. Avg accuracy 0.9551630434782609
Epoch 549. Avg accuracy 0.956281969309463
Epoch 550. Avg accuracy 0.9552629475703325
Epoch 551. Avg accuracy 0.9573009910485933
Epoch 552. Avg accuracy 0.959638746803069
Epoch 553. Avg accuracy 0.9585997442455243
Epoch 554. Avg accuracy 0.9573809143222506
Epoch 555. Avg accuracy 0.9610973465473146
Epoch 556. Avg accuracy 0.9595588235294118
Epoch 557. Avg accuracy 0.9631353900255755
Epoch 558. Avg accuracy 0.9642343350383632
Epoch 559. Avg accuracy 0.960997442455243
Epoch 560. Avg accuracy 0.9667519181585678
Epoch 561. Avg accuracy 0.9637947570332481
Epoch 562. Avg accuracy 0.9668518222506394
Epoch 563. Avg accuracy 0.965832800511509
Epoch 564. Avg accuracy 0.9651934143222506
Epoch 565. Avg accuracy 0.9662523976982097
Epoch 566. Avg accuracy 0.9666719948849105
Epoch 567. Avg accuracy 0.967071611253197
Epoch 568. Avg accuracy 0.966891783887468
Epoch 569. Avg accuracy 0.965832800511509
Epoch 570. Avg accuracy 0.9685302109974424
Epoch 571. Avg accuracy 0.9710477941176471
Epoch 572. Avg accuracy 0.9692894820971867
Epoch 573. Avg accuracy 0.9711476982097187
Epoch 574. Avg accuracy 0.9680906329923273
Epoch 575. Avg accuracy 0.9694293478260869
Epoch 576. Avg accuracy 0.9696491368286445
Epoch 577. Avg accuracy 0.9700687340153452
Epoch 578. Avg accuracy 0.9733256074168798
Epoch 579. Avg accuracy 0.9726062979539642
Epoch 580. Avg accuracy 0.9731058184143222
Epoch 581. Avg accuracy 0.971667199488491
Epoch 582. Avg accuracy 0.9715473145780051
Epoch 583. Avg accuracy 0.9736253196930946
Epoch 584. Avg accuracy 0.9711077365728901
Epoch 585. Avg accuracy 0.9728260869565217
Epoch 586. Avg accuracy 0.9741648017902813
Epoch 587. Avg accuracy 0.9708679667519181
Epoch 588. Avg accuracy 0.9740648976982097
Epoch 589. Avg accuracy 0.9753636508951407
Epoch 590. Avg accuracy 0.9737851662404092
Epoch 591. Avg accuracy 0.9711476982097187
Epoch 592. Avg accuracy 0.9748041879795396
Epoch 593. Avg accuracy 0.9737851662404092
Epoch 594. Avg accuracy 0.9743446291560103
Epoch 595. Avg accuracy 0.9761029411764706
Epoch 596. Avg accuracy 0.9735653772378516
Epoch 597. Avg accuracy 0.9758631713554987
Epoch 598. Avg accuracy 0.9746243606138107
Epoch 599. Avg accuracy 0.9746843030690537
Epoch 600. Avg accuracy 0.9767223465473146
Epoch 601. Avg accuracy 0.9757832480818415
Epoch 602. Avg accuracy 0.9763227301790282
Epoch 603. Avg accuracy 0.9762028452685422
Epoch 604. Avg accuracy 0.9757233056265985
Epoch 605. Avg accuracy 0.9753037084398977
Epoch 606. Avg accuracy 0.9786005434782609
Epoch 607. Avg accuracy 0.9766424232736572
Epoch 608. Avg accuracy 0.9772018861892583
Epoch 609. Avg accuracy 0.974884111253197
Epoch 610. Avg accuracy 0.9768422314578005
Epoch 611. Avg accuracy 0.9762428069053708
Epoch 612. Avg accuracy 0.9797794117647058
Epoch 613. Avg accuracy 0.977921195652174
Epoch 614. Avg accuracy 0.9744645140664961
Epoch 615. Avg accuracy 0.9792599104859335
Epoch 616. Avg accuracy 0.9800391624040921
Epoch 617. Avg accuracy 0.9766624040920716
Epoch 618. Avg accuracy 0.974704283887468
Epoch 619. Avg accuracy 0.9784606777493606
Epoch 620. Avg accuracy 0.9798793158567775
Epoch 621. Avg accuracy 0.9791999680306905
Epoch 622. Avg accuracy 0.9768622122762148
Epoch 623. Avg accuracy 0.9785605818414322
Epoch 624. Avg accuracy 0.9792399296675192
Epoch 625. Avg accuracy 0.9774816176470589
Epoch 626. Avg accuracy 0.980778452685422
Epoch 627. Avg accuracy 0.976502557544757
Epoch 628. Avg accuracy 0.9799392583120204
Epoch 629. Avg accuracy 0.97965952685422
Epoch 630. Avg accuracy 0.9784806585677749
Epoch 631. Avg accuracy 0.9791200447570333
Epoch 632. Avg accuracy 0.9788802749360613
Epoch 633. Avg accuracy 0.9825367647058824
Epoch 634. Avg accuracy 0.9782009271099744
Epoch 635. Avg accuracy 0.9794397378516624
Epoch 636. Avg accuracy 0.980838395140665
Epoch 637. Avg accuracy 0.98127797314578
Epoch 638. Avg accuracy 0.9786205242966752
Epoch 639. Avg accuracy 0.9818773976982097
Epoch 640. Avg accuracy 0.9800191815856778
Epoch 641. Avg accuracy 0.980778452685422
Epoch 642. Avg accuracy 0.9821571291560103
Epoch 643. Avg accuracy 0.9795596227621484
Epoch 644. Avg accuracy 0.9809382992327366
Epoch 645. Avg accuracy 0.9780011189258312
Epoch 646. Avg accuracy 0.982696611253197
Epoch 647. Avg accuracy 0.9812979539641944
Epoch 648. Avg accuracy 0.9820172634271099
Epoch 649. Avg accuracy 0.9811780690537084
Epoch 650. Avg accuracy 0.979539641943734
Epoch 651. Avg accuracy 0.981397858056266
Epoch 652. Avg accuracy 0.9801990089514067
Epoch 653. Avg accuracy 0.9850943094629157
Epoch 654. Avg accuracy 0.9821571291560103
Epoch 655. Avg accuracy 0.9804987212276215
Epoch 656. Avg accuracy 0.9823569373401535
Epoch 657. Avg accuracy 0.9802389705882353
Epoch 658. Avg accuracy 0.9837955562659847
Epoch 659. Avg accuracy 0.9823569373401535
Epoch 660. Avg accuracy 0.9823169757033248
Epoch 661. Avg accuracy 0.9809982416879796
Epoch 662. Avg accuracy 0.9825367647058824
Epoch 663. Avg accuracy 0.9828964194373402
Epoch 664. Avg accuracy 0.9840553069053708
Epoch 665. Avg accuracy 0.983196131713555
Epoch 666. Avg accuracy 0.9820772058823529
Epoch 667. Avg accuracy 0.9814178388746803
Epoch 668. Avg accuracy 0.9839753836317136
Epoch 669. Avg accuracy 0.9822969948849105
Epoch 670. Avg accuracy 0.9818973785166241
Epoch 671. Avg accuracy 0.9841152493606138
Epoch 672. Avg accuracy 0.9840553069053708
Epoch 673. Avg accuracy 0.9833160166240409
Epoch 674. Avg accuracy 0.9835557864450127
Epoch 675. Avg accuracy 0.983076246803069
Epoch 676. Avg accuracy 0.9841352301790282
Epoch 677. Avg accuracy 0.9854339833759591
Epoch 678. Avg accuracy 0.9838754795396419
Epoch 679. Avg accuracy 0.9835757672634271
Epoch 680. Avg accuracy 0.9815377237851662
Epoch 681. Avg accuracy 0.9832360933503836
Epoch 682. Avg accuracy 0.9846347506393862
Epoch 683. Avg accuracy 0.9816975703324808
Epoch 684. Avg accuracy 0.9865529092071611
Epoch 685. Avg accuracy 0.9830962276214834
Epoch 686. Avg accuracy 0.9833759590792839
Epoch 687. Avg accuracy 0.9853140984654731
Epoch 688. Avg accuracy 0.9848145780051151
Epoch 689. Avg accuracy 0.9832161125319693
Epoch 690. Avg accuracy 0.9826566496163683
Epoch 691. Avg accuracy 0.9853340792838875
Epoch 692. Avg accuracy 0.984315057544757
Epoch 693. Avg accuracy 0.9850743286445013
Epoch 694. Avg accuracy 0.9846747122762148
Epoch 695. Avg accuracy 0.9846347506393862
Epoch 696. Avg accuracy 0.9858335997442456
Epoch 697. Avg accuracy 0.9841352301790282
Epoch 698. Avg accuracy 0.9853140984654731
Epoch 699. Avg accuracy 0.9829963235294118
Epoch 700. Avg accuracy 0.9859734654731458
Epoch 701. Avg accuracy 0.9829563618925832
Epoch 702. Avg accuracy 0.9848545396419437
Epoch 703. Avg accuracy 0.987292199488491
Epoch 704. Avg accuracy 0.9840752877237852
Epoch 705. Avg accuracy 0.9863930626598465
Epoch 706. Avg accuracy 0.982696611253197
Epoch 707. Avg accuracy 0.9867127557544757
Epoch 708. Avg accuracy 0.9850143861892583
Epoch 709. Avg accuracy 0.9856537723785166
Epoch 710. Avg accuracy 0.9849544437340153
Epoch 711. Avg accuracy 0.9841352301790282
Epoch 712. Avg accuracy 0.9851142902813299
Epoch 713. Avg accuracy 0.987352141943734
Epoch 714. Avg accuracy 0.9859135230179028
Epoch 715. Avg accuracy 0.9829363810741688
Epoch 716. Avg accuracy 0.986173273657289
Epoch 717. Avg accuracy 0.9873321611253197
Epoch 718. Avg accuracy 0.9854739450127877
Epoch 719. Avg accuracy 0.9863531010230179
Epoch 720. Avg accuracy 0.9854939258312021
Epoch 721. Avg accuracy 0.984494884910486
Epoch 722. Avg accuracy 0.9862731777493606
Epoch 723. Avg accuracy 0.9870524296675192
Epoch 724. Avg accuracy 0.9854539641943734
Epoch 725. Avg accuracy 0.9864729859335039
Epoch 726. Avg accuracy 0.9848945012787724
Epoch 727. Avg accuracy 0.9862731777493606
Epoch 728. Avg accuracy 0.9870124680306905
Epoch 729. Avg accuracy 0.987531969309463
Epoch 730. Avg accuracy 0.9834958439897699
Epoch 731. Avg accuracy 0.9869325447570333
Epoch 732. Avg accuracy 0.9852941176470589
Epoch 733. Avg accuracy 0.9859135230179028
Epoch 734. Avg accuracy 0.9882312979539642
Epoch 735. Avg accuracy 0.9854140025575447
Epoch 736. Avg accuracy 0.987412084398977
Epoch 737. Avg accuracy 0.9858136189258312
Epoch 738. Avg accuracy 0.987911604859335
Epoch 739. Avg accuracy 0.9855338874680307
Epoch 740. Avg accuracy 0.9865529092071611
Epoch 741. Avg accuracy 0.9849144820971867
Epoch 742. Avg accuracy 0.9872122762148338
Epoch 743. Avg accuracy 0.9865728900255755
Epoch 744. Avg accuracy 0.9882113171355499
Epoch 745. Avg accuracy 0.985733695652174
Epoch 746. Avg accuracy 0.9881513746803069
Epoch 747. Avg accuracy 0.9865728900255755
Epoch 748. Avg accuracy 0.9863531010230179
Epoch 749. Avg accuracy 0.9872722186700768
Epoch 750. Avg accuracy 0.98747202685422
Epoch 751. Avg accuracy 0.9881913363171355
Epoch 752. Avg accuracy 0.9881713554987213
Epoch 753. Avg accuracy 0.9851542519181585
Epoch 754. Avg accuracy 0.987531969309463
Epoch 755. Avg accuracy 0.9874920076726342
Epoch 756. Avg accuracy 0.9875119884910486
Epoch 757. Avg accuracy 0.9855139066496164
Epoch 758. Avg accuracy 0.9886708759590793
Epoch 759. Avg accuracy 0.9882512787723785
Epoch 760. Avg accuracy 0.9863131393861893
Epoch 761. Avg accuracy 0.9870524296675192
Epoch 762. Avg accuracy 0.988531010230179
Epoch 763. Avg accuracy 0.9879315856777494
Epoch 764. Avg accuracy 0.9871523337595908
Epoch 765. Avg accuracy 0.9869125639386189
Epoch 766. Avg accuracy 0.9883911445012787
Epoch 767. Avg accuracy 0.9888906649616368
Epoch 768. Avg accuracy 0.9881513746803069
Epoch 769. Avg accuracy 0.987352141943734
Epoch 770. Avg accuracy 0.9878916240409207
Epoch 771. Avg accuracy 0.9867327365728901
Epoch 772. Avg accuracy 0.9869924872122762
Epoch 773. Avg accuracy 0.9888107416879796
Epoch 774. Avg accuracy 0.986792679028133
Epoch 775. Avg accuracy 0.9859534846547314
Epoch 776. Avg accuracy 0.9878117007672634
Epoch 777. Avg accuracy 0.9884910485933504
Epoch 778. Avg accuracy 0.9883511828644501
Epoch 779. Avg accuracy 0.9876118925831202
Epoch 780. Avg accuracy 0.9881713554987213
Epoch 781. Avg accuracy 0.98747202685422
Epoch 782. Avg accuracy 0.9877517583120204
Epoch 783. Avg accuracy 0.9886309143222506
Epoch 784. Avg accuracy 0.9882912404092071
Epoch 785. Avg accuracy 0.9861932544757033
Epoch 786. Avg accuracy 0.9907089194373402
Epoch 787. Avg accuracy 0.987412084398977
Epoch 788. Avg accuracy 0.9894101662404092
Epoch 789. Avg accuracy 0.9886309143222506
Epoch 790. Avg accuracy 0.9891304347826086
Epoch 791. Avg accuracy 0.9878117007672634
Epoch 792. Avg accuracy 0.9870124680306905
Epoch 793. Avg accuracy 0.9889905690537084
Epoch 794. Avg accuracy 0.990449168797954
Epoch 795. Avg accuracy 0.9871123721227621
Epoch 796. Avg accuracy 0.9889106457800512
Epoch 797. Avg accuracy 0.9868126598465473
Epoch 798. Avg accuracy 0.9901894181585678
Epoch 799. Avg accuracy 0.9880914322250639
Epoch 800. Avg accuracy 0.9876718350383632
Epoch 801. Avg accuracy 0.9902293797953964
Epoch 802. Avg accuracy 0.9865928708439897
Epoch 803. Avg accuracy 0.9893502237851662
Epoch 804. Avg accuracy 0.9880514705882353
Epoch 805. Avg accuracy 0.9887907608695652
Epoch 806. Avg accuracy 0.9885509910485933
Epoch 807. Avg accuracy 0.9879515664961637
Epoch 808. Avg accuracy 0.9907488810741688
Epoch 809. Avg accuracy 0.988031489769821
Epoch 810. Avg accuracy 0.9893502237851662
Epoch 811. Avg accuracy 0.9882712595907929
Epoch 812. Avg accuracy 0.9878916240409207
Epoch 813. Avg accuracy 0.9899096867007673
Epoch 814. Avg accuracy 0.9878117007672634
Epoch 815. Avg accuracy 0.9877717391304348
Epoch 816. Avg accuracy 0.9891903772378516
Epoch 817. Avg accuracy 0.9898297634271099
Epoch 818. Avg accuracy 0.9908088235294118
Epoch 819. Avg accuracy 0.98747202685422
Epoch 820. Avg accuracy 0.9889306265984654
Epoch 821. Avg accuracy 0.9891703964194374
Epoch 822. Avg accuracy 0.9878316815856778
Epoch 823. Avg accuracy 0.9899896099744245
Epoch 824. Avg accuracy 0.9897298593350383
Epoch 825. Avg accuracy 0.9874920076726342
Epoch 826. Avg accuracy 0.9898697250639387
Epoch 827. Avg accuracy 0.9888307225063938
Epoch 828. Avg accuracy 0.9878117007672634
Epoch 829. Avg accuracy 0.9897898017902813
Epoch 830. Avg accuracy 0.9896499360613811
Epoch 831. Avg accuracy 0.9875719309462916
Epoch 832. Avg accuracy 0.9905490728900256
Epoch 833. Avg accuracy 0.9892303388746803
Epoch 834. Avg accuracy 0.9894701086956522
Epoch 835. Avg accuracy 0.9885509910485933
Epoch 836. Avg accuracy 0.9889106457800512
Epoch 837. Avg accuracy 0.9904691496163683
Epoch 838. Avg accuracy 0.9902693414322251
Epoch 839. Avg accuracy 0.9883711636828645
Epoch 840. Avg accuracy 0.9891903772378516
Epoch 841. Avg accuracy 0.9886309143222506
Epoch 842. Avg accuracy 0.9896699168797954
Epoch 843. Avg accuracy 0.9894501278772379
Epoch 844. Avg accuracy 0.9907089194373402
Epoch 845. Avg accuracy 0.9879515664961637
Epoch 846. Avg accuracy 0.9896699168797954
Epoch 847. Avg accuracy 0.9885509910485933
Epoch 848. Avg accuracy 0.9907688618925832
Epoch 849. Avg accuracy 0.9884311061381074
Epoch 850. Avg accuracy 0.9904092071611253
Epoch 851. Avg accuracy 0.9880714514066496
Epoch 852. Avg accuracy 0.9917279411764706
Epoch 853. Avg accuracy 0.9898297634271099
Epoch 854. Avg accuracy 0.9893502237851662
Epoch 855. Avg accuracy 0.9906289961636828
Epoch 856. Avg accuracy 0.9891703964194374
Epoch 857. Avg accuracy 0.9887108375959079
Epoch 858. Avg accuracy 0.9899296675191815
Epoch 859. Avg accuracy 0.9899496483375959
Epoch 860. Avg accuracy 0.9883112212276215
Epoch 861. Avg accuracy 0.9904891304347826
Epoch 862. Avg accuracy 0.9905490728900256
Epoch 863. Avg accuracy 0.9880115089514067
Epoch 864. Avg accuracy 0.989769820971867
Epoch 865. Avg accuracy 0.9894900895140665
Epoch 866. Avg accuracy 0.9899696291560103
Epoch 867. Avg accuracy 0.990389226342711
Epoch 868. Avg accuracy 0.9907488810741688
Epoch 869. Avg accuracy 0.9909886508951407
Epoch 870. Avg accuracy 0.9887308184143222
Epoch 871. Avg accuracy 0.9907688618925832
Epoch 872. Avg accuracy 0.9892902813299232
Epoch 873. Avg accuracy 0.9926070971867008
Epoch 874. Avg accuracy 0.9896898976982097
Epoch 875. Avg accuracy 0.9887507992327366
Epoch 876. Avg accuracy 0.9919677109974424
Epoch 877. Avg accuracy 0.9887707800511509
Epoch 878. Avg accuracy 0.989769820971867
Epoch 879. Avg accuracy 0.9900695332480819
Epoch 880. Avg accuracy 0.9898297634271099
Epoch 881. Avg accuracy 0.9912883631713555
Epoch 882. Avg accuracy 0.988590952685422
Epoch 883. Avg accuracy 0.9912284207161125
Epoch 884. Avg accuracy 0.9903093030690537
Epoch 885. Avg accuracy 0.9897098785166241
Epoch 886. Avg accuracy 0.9888307225063938
Epoch 887. Avg accuracy 0.9898297634271099
Epoch 888. Avg accuracy 0.9916679987212276
Epoch 889. Avg accuracy 0.989030530690537
Epoch 890. Avg accuracy 0.9906289961636828
Epoch 891. Avg accuracy 0.9900495524296675
Epoch 892. Avg accuracy 0.9887707800511509
Epoch 893. Avg accuracy 0.992067615089514
Epoch 894. Avg accuracy 0.9902693414322251
Epoch 895. Avg accuracy 0.9911285166240409
Epoch 896. Avg accuracy 0.9875919117647058
Epoch 897. Avg accuracy 0.9922274616368286
Epoch 898. Avg accuracy 0.9906689578005116
Epoch 899. Avg accuracy 0.9881913363171355
Epoch 900. Avg accuracy 0.9924272698209718
Epoch 901. Avg accuracy 0.9904891304347826
Epoch 902. Avg accuracy 0.9898097826086957
Epoch 903. Avg accuracy 0.9904092071611253
Epoch 904. Avg accuracy 0.9910485933503836
Epoch 905. Avg accuracy 0.9905290920716112
Epoch 906. Avg accuracy 0.9899896099744245
Epoch 907. Avg accuracy 0.9901094948849105
Epoch 908. Avg accuracy 0.9896699168797954
Epoch 909. Avg accuracy 0.9908487851662404
Epoch 910. Avg accuracy 0.9901494565217391
Epoch 911. Avg accuracy 0.9908088235294118
Epoch 912. Avg accuracy 0.9902693414322251
Epoch 913. Avg accuracy 0.9903492647058824
Epoch 914. Avg accuracy 0.9912284207161125
Epoch 915. Avg accuracy 0.9925871163682864
Epoch 916. Avg accuracy 0.9898697250639387
Epoch 917. Avg accuracy 0.99056905370844
Epoch 918. Avg accuracy 0.9920276534526854
Epoch 919. Avg accuracy 0.987911604859335
Epoch 920. Avg accuracy 0.9925871163682864
Epoch 921. Avg accuracy 0.9912284207161125
Epoch 922. Avg accuracy 0.9906889386189258
Epoch 923. Avg accuracy 0.9918678069053708
Epoch 924. Avg accuracy 0.9896699168797954
Epoch 925. Avg accuracy 0.9907089194373402
Epoch 926. Avg accuracy 0.9909287084398977
Epoch 927. Avg accuracy 0.9912883631713555
Epoch 928. Avg accuracy 0.9918278452685422
Epoch 929. Avg accuracy 0.9875919117647058
Epoch 930. Avg accuracy 0.9917878836317136
Epoch 931. Avg accuracy 0.9924872122762148
Epoch 932. Avg accuracy 0.9900295716112532
Epoch 933. Avg accuracy 0.9920076726342711
Epoch 934. Avg accuracy 0.9903692455242967
Epoch 935. Avg accuracy 0.9914482097186701
Epoch 936. Avg accuracy 0.9897098785166241
Epoch 937. Avg accuracy 0.990449168797954
Epoch 938. Avg accuracy 0.9906289961636828
Epoch 939. Avg accuracy 0.9915880754475703
Epoch 940. Avg accuracy 0.9913083439897699
Epoch 941. Avg accuracy 0.989769820971867
Epoch 942. Avg accuracy 0.9918078644501279
Epoch 943. Avg accuracy 0.9924872122762148
Epoch 944. Avg accuracy 0.9901894181585678
Epoch 945. Avg accuracy 0.989210358056266
Epoch 946. Avg accuracy 0.9924872122762148
Epoch 947. Avg accuracy 0.9918078644501279
Epoch 948. Avg accuracy 0.9912084398976982
Epoch 949. Avg accuracy 0.9909087276214834
Epoch 950. Avg accuracy 0.9908088235294118
Epoch 951. Avg accuracy 0.9894900895140665
Epoch 952. Avg accuracy 0.9921875
Epoch 953. Avg accuracy 0.99056905370844
Epoch 954. Avg accuracy 0.9915880754475703
Epoch 955. Avg accuracy 0.9901894181585678
Epoch 956. Avg accuracy 0.9924072890025576
Epoch 957. Avg accuracy 0.9906090153452686
Epoch 958. Avg accuracy 0.991008631713555
Epoch 959. Avg accuracy 0.991628037084399
Epoch 960. Avg accuracy 0.9904092071611253
Epoch 961. Avg accuracy 0.9923673273657289
Epoch 962. Avg accuracy 0.9908487851662404
Epoch 963. Avg accuracy 0.991568094629156
Epoch 964. Avg accuracy 0.9909087276214834
Epoch 965. Avg accuracy 0.9910685741687979
Epoch 966. Avg accuracy 0.9929667519181585
Epoch 967. Avg accuracy 0.9906090153452686
Epoch 968. Avg accuracy 0.9914881713554987
Epoch 969. Avg accuracy 0.9917079603580563
Epoch 970. Avg accuracy 0.9920276534526854
Epoch 971. Avg accuracy 0.992127557544757
Epoch 972. Avg accuracy 0.9921675191815856
Epoch 973. Avg accuracy 0.9894101662404092
Epoch 974. Avg accuracy 0.9931465792838875
Epoch 975. Avg accuracy 0.9893901854219949
Epoch 976. Avg accuracy 0.9924872122762148
Epoch 977. Avg accuracy 0.9890505115089514
Epoch 978. Avg accuracy 0.99380594629156
Epoch 979. Avg accuracy 0.9917079603580563
Epoch 980. Avg accuracy 0.9897298593350383
Epoch 981. Avg accuracy 0.991628037084399
Epoch 982. Avg accuracy 0.9921075767263428
Epoch 983. Avg accuracy 0.9912683823529411
Epoch 984. Avg accuracy 0.9918278452685422
Epoch 985. Avg accuracy 0.9941855818414322
Epoch 986. Avg accuracy 0.988650895140665
Epoch 987. Avg accuracy 0.9930666560102301
Epoch 988. Avg accuracy 0.9914881713554987
Epoch 989. Avg accuracy 0.9911884590792839
Epoch 990. Avg accuracy 0.9926270780051151
Epoch 991. Avg accuracy 0.9912284207161125
Epoch 992. Avg accuracy 0.9920476342710998
Epoch 993. Avg accuracy 0.9922674232736572
Epoch 994. Avg accuracy 0.990888746803069
Epoch 995. Avg accuracy 0.9921675191815856
Epoch 996. Avg accuracy 0.9927669437340153
Epoch 997. Avg accuracy 0.9915481138107417
Epoch 998. Avg accuracy 0.9925271739130435
Epoch 999. Avg accuracy 0.9902493606138107