正则化应用

最新推荐文章于 2024-01-10 01:45:20 发布
最新推荐文章于 2024-01-10 01:45:20 发布
阅读量108 收藏
点赞数
分类专栏： keras
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/wangxf666/article/details/118441869
版权

需不需要正则化看具体的模型，本例中加了不好。和Dropout一样

import numpy as np
from keras.datasets import mnist  # 导入数据集
from keras.utils import np_utils  # Keras里面提供的一个numpy的工具包
from keras.models import Sequential
from keras.layers import Dense
from keras.optimizers import SGD
from keras.regularizers import l2
# 载入数据，从网上下载
(x_train, y_train), (x_test, y_test) = mnist.load_data()
# (60000,28,28)
print('x_shape:', x_train.shape)  # 看数据格式
# (60000)
print('y_shape:', y_train.shape)  # 看数据格式

# (60000,28,28)->(60000,784)
# 转成60000行-1表示列数不确定，会自动判断，255归一化
x_train = x_train.reshape(x_train.shape[0], -1)/255.0
x_test = x_test.reshape(x_test.shape[0], -1)/255.0

# 换one hot格式 10个类
y_train = np_utils.to_categorical(y_train, num_classes=10)
y_test = np_utils.to_categorical(y_test, num_classes=10)

# 创建模型，输入784个神经元，3个隐藏层，输出200,100,10个神经元 偏置设成1
model = Sequential([
    Dense(units=200, input_dim=784, bias_initializer='one', activation='tanh', kernel_regularizer=l2(0.0003)),
    Dense(units=100, bias_initializer='one', activation='tanh', kernel_regularizer=l2(0.0003)),
    Dense(units=10, bias_initializer='one', activation='softmax', kernel_regularizer=l2(0.0003))
                   ])
# 定义优化器，loss function，训练过程中计算准确率
sgd = SGD(lr=0.2)
model.compile(
    optimizer=sgd,
    loss='categorical_crossentropy',  # 使用交叉熵收敛速度比较快
    metrics=['accuracy'],
)

# 训练模型（用的更多） 32张图片，每一次训练32张，60000/32次，
# epochs为训练周期,60000张全都训练一次叫一个周期。
model.fit(x_train, y_train, batch_size=32, epochs=10)
# 评估模型
# 训练集的准确率比测试集的高，是过拟合，处理过拟合用Dropout
loss, accuracy = model.evaluate(x_test,y_test)
print('\ntest loss', loss)
print('test accuracy', accuracy)

loss, accuracy = model.evaluate(x_train, y_train)
print('\ntrain loss', loss)
print('train accuracy', accuracy)

# 保存模型
#model.save('model.h5')

Epoch 1/10
   1/1875 [..............................] - ETA: 0s - loss: 2.8305 - accuracy: 0.0938
  20/1875 [..............................] - ETA: 4s - loss: 2.8706 - accuracy: 0.2375
  41/1875 [..............................] - ETA: 4s - loss: 2.0247 - accuracy: 0.4398
  60/1875 [..............................] - ETA: 4s - loss: 1.6336 - accuracy: 0.5542
  80/1875 [>.............................] - ETA: 4s - loss: 1.3986 - accuracy: 0.6234
 100/1875 [>.............................] - ETA: 4s - loss: 1.2462 - accuracy: 0.6687
 122/1875 [>.............................] - ETA: 4s - loss: 1.1272 - accuracy: 0.7031
 138/1875 [=>............................] - ETA: 4s - loss: 1.0640 - accuracy: 0.7208
 152/1875 [=>............................] - ETA: 4s - loss: 1.0183 - accuracy: 0.7340
 165/1875 [=>............................] - ETA: 4s - loss: 0.9770 - accuracy: 0.7468
 179/1875 [=>............................] - ETA: 4s - loss: 0.9414 - accuracy: 0.7582
 194/1875 [==>...........................] - ETA: 4s - loss: 0.9201 - accuracy: 0.7640
 207/1875 [==>...........................] - ETA: 4s - loss: 0.8922 - accuracy: 0.7723
 224/1875 [==>...........................] - ETA: 4s - loss: 0.8624 - accuracy: 0.7811
 239/1875 [==>...........................] - ETA: 4s - loss: 0.8376 - accuracy: 0.7884
 256/1875 [===>..........................] - ETA: 4s - loss: 0.8158 - accuracy: 0.7941
 272/1875 [===>..........................] - ETA: 4s - loss: 0.7977 - accuracy: 0.7997
 287/1875 [===>..........................] - ETA: 4s - loss: 0.7849 - accuracy: 0.8039
 305/1875 [===>..........................] - ETA: 4s - loss: 0.7692 - accuracy: 0.8084
 323/1875 [====>.........................] - ETA: 4s - loss: 0.7519 - accuracy: 0.8144
 338/1875 [====>.........................] - ETA: 4s - loss: 0.7413 - accuracy: 0.8175
 349/1875 [====>.........................] - ETA: 4s - loss: 0.7351 - accuracy: 0.8196
 361/1875 [====>.........................] - ETA: 4s - loss: 0.7273 - accuracy: 0.8223
 374/1875 [====>.........................] - ETA: 4s - loss: 0.7190 - accuracy: 0.8248
 385/1875 [=====>........................] - ETA: 4s - loss: 0.7128 - accuracy: 0.8269
 395/1875 [=====>........................] - ETA: 4s - loss: 0.7044 - accuracy: 0.8293
 407/1875 [=====>........................] - ETA: 4s - loss: 0.6965 - accuracy: 0.8321
 421/1875 [=====>........................] - ETA: 4s - loss: 0.6861 - accuracy: 0.8349
 435/1875 [=====>........................] - ETA: 4s - loss: 0.6792 - accuracy: 0.8371
 454/1875 [======>.......................] - ETA: 4s - loss: 0.6700 - accuracy: 0.8399
 474/1875 [======>.......................] - ETA: 4s - loss: 0.6598 - accuracy: 0.8432
 494/1875 [======>.......................] - ETA: 4s - loss: 0.6489 - accuracy: 0.8468
 513/1875 [=======>......................] - ETA: 4s - loss: 0.6390 - accuracy: 0.8496
 528/1875 [=======>......................] - ETA: 4s - loss: 0.6331 - accuracy: 0.8509
 542/1875 [=======>......................] - ETA: 4s - loss: 0.6267 - accuracy: 0.8527
 557/1875 [=======>......................] - ETA: 4s - loss: 0.6213 - accuracy: 0.8545
 571/1875 [========>.....................] - ETA: 4s - loss: 0.6155 - accuracy: 0.8563
 587/1875 [========>.....................] - ETA: 4s - loss: 0.6096 - accuracy: 0.8578
 606/1875 [========>.....................] - ETA: 4s - loss: 0.6054 - accuracy: 0.8593
 626/1875 [=========>....................] - ETA: 3s - loss: 0.5995 - accuracy: 0.8610
 645/1875 [=========>....................] - ETA: 3s - loss: 0.5928 - accuracy: 0.8627
 664/1875 [=========>....................] - ETA: 3s - loss: 0.5870 - accuracy: 0.8646
 682/1875 [=========>....................] - ETA: 3s - loss: 0.5816 - accuracy: 0.8663
 702/1875 [==========>...................] - ETA: 3s - loss: 0.5759 - accuracy: 0.8678
 719/1875 [==========>...................] - ETA: 3s - loss: 0.5713 - accuracy: 0.8692
 741/1875 [==========>...................] - ETA: 3s - loss: 0.5666 - accuracy: 0.8705
 763/1875 [===========>..................] - ETA: 3s - loss: 0.5607 - accuracy: 0.8722
 784/1875 [===========>..................] - ETA: 3s - loss: 0.5550 - accuracy: 0.8739
 805/1875 [===========>..................] - ETA: 3s - loss: 0.5507 - accuracy: 0.8753
 816/1875 [============>.................] - ETA: 3s - loss: 0.5486 - accuracy: 0.8761
 821/1875 [============>.................] - ETA: 3s - loss: 0.5477 - accuracy: 0.8765
 833/1875 [============>.................] - ETA: 3s - loss: 0.5452 - accuracy: 0.8771
 851/1875 [============>.................] - ETA: 3s - loss: 0.5427 - accuracy: 0.8782
 869/1875 [============>.................] - ETA: 3s - loss: 0.5382 - accuracy: 0.8796
 886/1875 [=============>................] - ETA: 3s - loss: 0.5343 - accuracy: 0.8809
 899/1875 [=============>................] - ETA: 3s - loss: 0.5312 - accuracy: 0.8819
 912/1875 [=============>................] - ETA: 3s - loss: 0.5285 - accuracy: 0.8827
 927/1875 [=============>................] - ETA: 3s - loss: 0.5257 - accuracy: 0.8837
 943/1875 [==============>...............] - ETA: 2s - loss: 0.5226 - accuracy: 0.8846
 957/1875 [==============>...............] - ETA: 2s - loss: 0.5201 - accuracy: 0.8854
 976/1875 [==============>...............] - ETA: 2s - loss: 0.5172 - accuracy: 0.8862
 997/1875 [==============>...............] - ETA: 2s - loss: 0.5131 - accuracy: 0.8875
1017/1875 [===============>..............] - ETA: 2s - loss: 0.5099 - accuracy: 0.8886
1032/1875 [===============>..............] - ETA: 2s - loss: 0.5077 - accuracy: 0.8892
1053/1875 [===============>..............] - ETA: 2s - loss: 0.5043 - accuracy: 0.8903
1077/1875 [================>.............] - ETA: 2s - loss: 0.5013 - accuracy: 0.8912
1097/1875 [================>.............] - ETA: 2s - loss: 0.4991 - accuracy: 0.8916
1119/1875 [================>.............] - ETA: 2s - loss: 0.4966 - accuracy: 0.8924
1141/1875 [=================>............] - ETA: 2s - loss: 0.4937 - accuracy: 0.8931
1164/1875 [=================>............] - ETA: 2s - loss: 0.4911 - accuracy: 0.8940
1178/1875 [=================>............] - ETA: 2s - loss: 0.4893 - accuracy: 0.8944
1192/1875 [==================>...........] - ETA: 2s - loss: 0.4869 - accuracy: 0.8950
1205/1875 [==================>...........] - ETA: 2s - loss: 0.4853 - accuracy: 0.8955
1217/1875 [==================>...........] - ETA: 2s - loss: 0.4837 - accuracy: 0.8960
1230/1875 [==================>...........] - ETA: 2s - loss: 0.4820 - accuracy: 0.8965
1245/1875 [==================>...........] - ETA: 1s - loss: 0.4801 - accuracy: 0.8970
1259/1875 [===================>..........] - ETA: 1s - loss: 0.4789 - accuracy: 0.8974
1273/1875 [===================>..........] - ETA: 1s - loss: 0.4774 - accuracy: 0.8980
1287/1875 [===================>..........] - ETA: 1s - loss: 0.4754 - accuracy: 0.8986
1302/1875 [===================>..........] - ETA: 1s - loss: 0.4737 - accuracy: 0.8990
1316/1875 [====================>.........] - ETA: 1s - loss: 0.4722 - accuracy: 0.8994
1336/1875 [====================>.........] - ETA: 1s - loss: 0.4709 - accuracy: 0.8998
1355/1875 [====================>.........] - ETA: 1s - loss: 0.4702 - accuracy: 0.9001
1375/1875 [=====================>........] - ETA: 1s - loss: 0.4684 - accuracy: 0.9006
1396/1875 [=====================>........] - ETA: 1s - loss: 0.4667 - accuracy: 0.9011
1415/1875 [=====================>........] - ETA: 1s - loss: 0.4652 - accuracy: 0.9017
1428/1875 [=====================>........] - ETA: 1s - loss: 0.4640 - accuracy: 0.9020
1441/1875 [======================>.......] - ETA: 1s - loss: 0.4624 - accuracy: 0.9024
1453/1875 [======================>.......] - ETA: 1s - loss: 0.4618 - accuracy: 0.9027
1464/1875 [======================>.......] - ETA: 1s - loss: 0.4609 - accuracy: 0.9029
1474/1875 [======================>.......] - ETA: 1s - loss: 0.4603 - accuracy: 0.9030
1488/1875 [======================>.......] - ETA: 1s - loss: 0.4591 - accuracy: 0.9033
1498/1875 [======================>.......] - ETA: 1s - loss: 0.4581 - accuracy: 0.9036
1509/1875 [=======================>......] - ETA: 1s - loss: 0.4575 - accuracy: 0.9038
1518/1875 [=======================>......] - ETA: 1s - loss: 0.4571 - accuracy: 0.9040
1528/1875 [=======================>......] - ETA: 1s - loss: 0.4565 - accuracy: 0.9041
1540/1875 [=======================>......] - ETA: 1s - loss: 0.4554 - accuracy: 0.9045
1553/1875 [=======================>......] - ETA: 1s - loss: 0.4541 - accuracy: 0.9048
1565/1875 [========================>.....] - ETA: 1s - loss: 0.4528 - accuracy: 0.9053
1577/1875 [========================>.....] - ETA: 0s - loss: 0.4521 - accuracy: 0.9055
1592/1875 [========================>.....] - ETA: 0s - loss: 0.4506 - accuracy: 0.9061
1609/1875 [========================>.....] - ETA: 0s - loss: 0.4490 - accuracy: 0.9065
1625/1875 [=========================>....] - ETA: 0s - loss: 0.4479 - accuracy: 0.9070
1634/1875 [=========================>....] - ETA: 0s - loss: 0.4472 - accuracy: 0.9072
1652/1875 [=========================>....] - ETA: 0s - loss: 0.4459 - accuracy: 0.9075
1672/1875 [=========================>....] - ETA: 0s - loss: 0.4439 - accuracy: 0.9082
1685/1875 [=========================>....] - ETA: 0s - loss: 0.4430 - accuracy: 0.9085
1704/1875 [==========================>...] - ETA: 0s - loss: 0.4413 - accuracy: 0.9091
1727/1875 [==========================>...] - ETA: 0s - loss: 0.4396 - accuracy: 0.9097
1751/1875 [===========================>..] - ETA: 0s - loss: 0.4372 - accuracy: 0.9104
1774/1875 [===========================>..] - ETA: 0s - loss: 0.4357 - accuracy: 0.9109
1799/1875 [===========================>..] - ETA: 0s - loss: 0.4345 - accuracy: 0.9113
1824/1875 [============================>.] - ETA: 0s - loss: 0.4327 - accuracy: 0.9119
1850/1875 [============================>.] - ETA: 0s - loss: 0.4312 - accuracy: 0.9123
1875/1875 [==============================] - 6s 3ms/step - loss: 0.4297 - accuracy: 0.9129
Epoch 2/10
   1/1875 [..............................] - ETA: 0s - loss: 0.6798 - accuracy: 0.8438
  26/1875 [..............................] - ETA: 3s - loss: 0.3090 - accuracy: 0.9459
  49/1875 [..............................] - ETA: 3s - loss: 0.3121 - accuracy: 0.9464
  76/1875 [>.............................] - ETA: 3s - loss: 0.3027 - accuracy: 0.9474
 102/1875 [>.............................] - ETA: 3s - loss: 0.3017 - accuracy: 0.9485
 127/1875 [=>............................] - ETA: 3s - loss: 0.3022 - accuracy: 0.9498
 151/1875 [=>............................] - ETA: 3s - loss: 0.2996 - accuracy: 0.9497
 174/1875 [=>............................] - ETA: 3s - loss: 0.2950 - accuracy: 0.9508
 197/1875 [==>...........................] - ETA: 3s - loss: 0.2940 - accuracy: 0.9524
 219/1875 [==>...........................] - ETA: 3s - loss: 0.2962 - accuracy: 0.9521
 244/1875 [==>...........................] - ETA: 3s - loss: 0.2909 - accuracy: 0.9534
 268/1875 [===>..........................] - ETA: 3s - loss: 0.2886 - accuracy: 0.9543
 289/1875 [===>..........................] - ETA: 3s - loss: 0.2900 - accuracy: 0.9539
 312/1875 [===>..........................] - ETA: 3s - loss: 0.2883 - accuracy: 0.9546
 336/1875 [====>.........................] - ETA: 3s - loss: 0.2873 - accuracy: 0.9551
 360/1875 [====>.........................] - ETA: 3s - loss: 0.2860 - accuracy: 0.9549
 384/1875 [=====>........................] - ETA: 3s - loss: 0.2854 - accuracy: 0.9550
 407/1875 [=====>........................] - ETA: 3s - loss: 0.2832 - accuracy: 0.9553
 431/1875 [=====>........................] - ETA: 3s - loss: 0.2819 - accuracy: 0.9555
 451/1875 [======>.......................] - ETA: 3s - loss: 0.2799 - accuracy: 0.9560
 473/1875 [======>.......................] - ETA: 2s - loss: 0.2785 - accuracy: 0.9563
 496/1875 [======>.......................] - ETA: 2s - loss: 0.2777 - accuracy: 0.9564
 519/1875 [=======>......................] - ETA: 2s - loss: 0.2775 - accuracy: 0.9565
 543/1875 [=======>......................] - ETA: 2s - loss: 0.2777 - accuracy: 0.9566
 567/1875 [========>.....................] - ETA: 2s - loss: 0.2773 - accuracy: 0.9565
 592/1875 [========>.....................] - ETA: 2s - loss: 0.2763 - accuracy: 0.9567
 617/1875 [========>.....................] - ETA: 2s - loss: 0.2763 - accuracy: 0.9565
 640/1875 [=========>....................] - ETA: 2s - loss: 0.2755 - accuracy: 0.9566
 664/1875 [=========>....................] - ETA: 2s - loss: 0.2772 - accuracy: 0.9563
 688/1875 [==========>...................] - ETA: 2s - loss: 0.2775 - accuracy: 0.9564
 712/1875 [==========>...................] - ETA: 2s - loss: 0.2769 - accuracy: 0.9565
 736/1875 [==========>...................] - ETA: 2s - loss: 0.2774 - accuracy: 0.9564
 759/1875 [===========>..................] - ETA: 2s - loss: 0.2758 - accuracy: 0.9571
 783/1875 [===========>..................] - ETA: 2s - loss: 0.2749 - accuracy: 0.9573
 808/1875 [===========>..................] - ETA: 2s - loss: 0.2746 - accuracy: 0.9573
 833/1875 [============>.................] - ETA: 2s - loss: 0.2736 - accuracy: 0.9576
 859/1875 [============>.................] - ETA: 2s - loss: 0.2736 - accuracy: 0.9575
 884/1875 [=============>................] - ETA: 2s - loss: 0.2732 - accuracy: 0.9575
 905/1875 [=============>................] - ETA: 2s - loss: 0.2726 - accuracy: 0.9576
 921/1875 [=============>................] - ETA: 2s - loss: 0.2726 - accuracy: 0.9576
 938/1875 [==============>...............] - ETA: 2s - loss: 0.2725 - accuracy: 0.9575
 956/1875 [==============>...............] - ETA: 1s - loss: 0.2727 - accuracy: 0.9573
 974/1875 [==============>...............] - ETA: 1s - loss: 0.2723 - accuracy: 0.9574
 992/1875 [==============>...............] - ETA: 1s - loss: 0.2719 - accuracy: 0.9574
1010/1875 [===============>..............] - ETA: 1s - loss: 0.2713 - accuracy: 0.9576
1027/1875 [===============>..............] - ETA: 1s - loss: 0.2709 - accuracy: 0.9577
1045/1875 [===============>..............] - ETA: 1s - loss: 0.2712 - accuracy: 0.9576
1062/1875 [===============>..............] - ETA: 1s - loss: 0.2707 - accuracy: 0.9577
1079/1875 [================>.............] - ETA: 1s - loss: 0.2707 - accuracy: 0.9576
1097/1875 [================>.............] - ETA: 1s - loss: 0.2702 - accuracy: 0.9578
1115/1875 [================>.............] - ETA: 1s - loss: 0.2702 - accuracy: 0.9579
1132/1875 [=================>............] - ETA: 1s - loss: 0.2702 - accuracy: 0.9579
1153/1875 [=================>............] - ETA: 1s - loss: 0.2700 - accuracy: 0.9580
1180/1875 [=================>............] - ETA: 1s - loss: 0.2694 - accuracy: 0.9583
1206/1875 [==================>...........] - ETA: 1s - loss: 0.2690 - accuracy: 0.9585
1232/1875 [==================>...........] - ETA: 1s - loss: 0.2683 - accuracy: 0.9587
1259/1875 [===================>..........] - ETA: 1s - loss: 0.2682 - accuracy: 0.9587
1285/1875 [===================>..........] - ETA: 1s - loss: 0.2675 - accuracy: 0.9590
1308/1875 [===================>..........] - ETA: 1s - loss: 0.2672 - accuracy: 0.9590
1331/1875 [====================>.........] - ETA: 1s - loss: 0.2673 - accuracy: 0.9588
1357/1875 [====================>.........] - ETA: 1s - loss: 0.2669 - accuracy: 0.9588
1384/1875 [=====================>........] - ETA: 1s - loss: 0.2668 - accuracy: 0.9587
1410/1875 [=====================>........] - ETA: 1s - loss: 0.2661 - accuracy: 0.9589
1434/1875 [=====================>........] - ETA: 0s - loss: 0.2656 - accuracy: 0.9592
1459/1875 [======================>.......] - ETA: 0s - loss: 0.2647 - accuracy: 0.9595
1485/1875 [======================>.......] - ETA: 0s - loss: 0.2647 - accuracy: 0.9594
1513/1875 [=======================>......] - ETA: 0s - loss: 0.2644 - accuracy: 0.9595
1541/1875 [=======================>......] - ETA: 0s - loss: 0.2643 - accuracy: 0.9596
1551/1875 [=======================>......] - ETA: 0s - loss: 0.2644 - accuracy: 0.9595
1566/1875 [========================>.....] - ETA: 0s - loss: 0.2641 - accuracy: 0.9596
1588/1875 [========================>.....] - ETA: 0s - loss: 0.2640 - accuracy: 0.9597
1612/1875 [========================>.....] - ETA: 0s - loss: 0.2642 - accuracy: 0.9597
1635/1875 [=========================>....] - ETA: 0s - loss: 0.2642 - accuracy: 0.9597
1656/1875 [=========================>....] - ETA: 0s - loss: 0.2642 - accuracy: 0.9597
1676/1875 [=========================>....] - ETA: 0s - loss: 0.2641 - accuracy: 0.9597
1699/1875 [==========================>...] - ETA: 0s - loss: 0.2639 - accuracy: 0.9597
1723/1875 [==========================>...] - ETA: 0s - loss: 0.2642 - accuracy: 0.9596
1748/1875 [==========================>...] - ETA: 0s - loss: 0.2639 - accuracy: 0.9598
1766/1875 [===========================>..] - ETA: 0s - loss: 0.2641 - accuracy: 0.9597
1784/1875 [===========================>..] - ETA: 0s - loss: 0.2639 - accuracy: 0.9596
1804/1875 [===========================>..] - ETA: 0s - loss: 0.2639 - accuracy: 0.9596
1826/1875 [============================>.] - ETA: 0s - loss: 0.2639 - accuracy: 0.9595
1837/1875 [============================>.] - ETA: 0s - loss: 0.2638 - accuracy: 0.9596
1853/1875 [============================>.] - ETA: 0s - loss: 0.2638 - accuracy: 0.9596
1875/1875 [==============================] - 4s 2ms/step - loss: 0.2634 - accuracy: 0.9597
Epoch 3/10
   1/1875 [..............................] - ETA: 0s - loss: 0.1625 - accuracy: 1.0000
  19/1875 [..............................] - ETA: 4s - loss: 0.2072 - accuracy: 0.9753
  38/1875 [..............................] - ETA: 5s - loss: 0.2027 - accuracy: 0.9778
  50/1875 [..............................] - ETA: 5s - loss: 0.2090 - accuracy: 0.9787
  61/1875 [..............................] - ETA: 6s - loss: 0.2117 - accuracy: 0.9790
  72/1875 [>.............................] - ETA: 6s - loss: 0.2075 - accuracy: 0.9792
  85/1875 [>.............................] - ETA: 6s - loss: 0.2059 - accuracy: 0.9776
  97/1875 [>.............................] - ETA: 6s - loss: 0.2092 - accuracy: 0.9765
 112/1875 [>.............................] - ETA: 6s - loss: 0.2070 - accuracy: 0.9763
 131/1875 [=>............................] - ETA: 6s - loss: 0.2145 - accuracy: 0.9730
 147/1875 [=>............................] - ETA: 6s - loss: 0.2161 - accuracy: 0.9728
 160/1875 [=>............................] - ETA: 6s - loss: 0.2189 - accuracy: 0.9721
 173/1875 [=>............................] - ETA: 6s - loss: 0.2175 - accuracy: 0.9724
 185/1875 [=>............................] - ETA: 6s - loss: 0.2165 - accuracy: 0.9721
 196/1875 [==>...........................] - ETA: 6s - loss: 0.2196 - accuracy: 0.9708
 207/1875 [==>...........................] - ETA: 6s - loss: 0.2195 - accuracy: 0.9710
 221/1875 [==>...........................] - ETA: 6s - loss: 0.2208 - accuracy: 0.9709
 238/1875 [==>...........................] - ETA: 6s - loss: 0.2236 - accuracy: 0.9703
 246/1875 [==>...........................] - ETA: 6s - loss: 0.2249 - accuracy: 0.9698
 256/1875 [===>..........................] - ETA: 6s - loss: 0.2259 - accuracy: 0.9691
 277/1875 [===>..........................] - ETA: 5s - loss: 0.2235 - accuracy: 0.9701
 302/1875 [===>..........................] - ETA: 5s - loss: 0.2237 - accuracy: 0.9700
 327/1875 [====>.........................] - ETA: 5s - loss: 0.2230 - accuracy: 0.9700
 348/1875 [====>.........................] - ETA: 5s - loss: 0.2235 - accuracy: 0.9697
 369/1875 [====>.........................] - ETA: 5s - loss: 0.2218 - accuracy: 0.9704
 392/1875 [=====>........................] - ETA: 4s - loss: 0.2221 - accuracy: 0.9703
 411/1875 [=====>........................] - ETA: 4s - loss: 0.2211 - accuracy: 0.9706
 426/1875 [=====>........................] - ETA: 4s - loss: 0.2246 - accuracy: 0.9696
 447/1875 [======>.......................] - ETA: 4s - loss: 0.2238 - accuracy: 0.9698
 470/1875 [======>.......................] - ETA: 4s - loss: 0.2247 - accuracy: 0.9695
 494/1875 [======>.......................] - ETA: 4s - loss: 0.2236 - accuracy: 0.9698
 518/1875 [=======>......................] - ETA: 4s - loss: 0.2247 - accuracy: 0.9697
 536/1875 [=======>......................] - ETA: 4s - loss: 0.2248 - accuracy: 0.9696
 561/1875 [=======>......................] - ETA: 3s - loss: 0.2251 - accuracy: 0.9694
 586/1875 [========>.....................] - ETA: 3s - loss: 0.2258 - accuracy: 0.9694
 606/1875 [========>.....................] - ETA: 3s - loss: 0.2255 - accuracy: 0.9697
 626/1875 [=========>....................] - ETA: 3s - loss: 0.2255 - accuracy: 0.9694
 645/1875 [=========>....................] - ETA: 3s - loss: 0.2260 - accuracy: 0.9693
 671/1875 [=========>....................] - ETA: 3s - loss: 0.2261 - accuracy: 0.9694
 696/1875 [==========>...................] - ETA: 3s - loss: 0.2260 - accuracy: 0.9694
 721/1875 [==========>...................] - ETA: 3s - loss: 0.2262 - accuracy: 0.9691
 745/1875 [==========>...................] - ETA: 3s - loss: 0.2258 - accuracy: 0.9692
 771/1875 [===========>..................] - ETA: 3s - loss: 0.2262 - accuracy: 0.9691
 798/1875 [===========>..................] - ETA: 2s - loss: 0.2260 - accuracy: 0.9691
 825/1875 [============>.................] - ETA: 2s - loss: 0.2262 - accuracy: 0.9691
 850/1875 [============>.................] - ETA: 2s - loss: 0.2257 - accuracy: 0.9691
 876/1875 [=============>................] - ETA: 2s - loss: 0.2257 - accuracy: 0.9692
 902/1875 [=============>................] - ETA: 2s - loss: 0.2246 - accuracy: 0.9693
 928/1875 [=============>................] - ETA: 2s - loss: 0.2242 - accuracy: 0.9693
 952/1875 [==============>...............] - ETA: 2s - loss: 0.2237 - accuracy: 0.9694
 978/1875 [==============>...............] - ETA: 2s - loss: 0.2235 - accuracy: 0.9694
1005/1875 [===============>..............] - ETA: 2s - loss: 0.2227 - accuracy: 0.9697
1032/1875 [===============>..............] - ETA: 2s - loss: 0.2229 - accuracy: 0.9695
1059/1875 [===============>..............] - ETA: 2s - loss: 0.2229 - accuracy: 0.9695
1084/1875 [================>.............] - ETA: 2s - loss: 0.2227 - accuracy: 0.9694
1110/1875 [================>.............] - ETA: 1s - loss: 0.2226 - accuracy: 0.9695
1136/1875 [=================>............] - ETA: 1s - loss: 0.2228 - accuracy: 0.9692
1163/1875 [=================>............] - ETA: 1s - loss: 0.2227 - accuracy: 0.9692
1186/1875 [=================>............] - ETA: 1s - loss: 0.2221 - accuracy: 0.9693
1212/1875 [==================>...........] - ETA: 1s - loss: 0.2217 - accuracy: 0.9695
1235/1875 [==================>...........] - ETA: 1s - loss: 0.2221 - accuracy: 0.9693
1254/1875 [===================>..........] - ETA: 1s - loss: 0.2217 - accuracy: 0.9693
1279/1875 [===================>..........] - ETA: 1s - loss: 0.2216 - accuracy: 0.9692
1304/1875 [===================>..........] - ETA: 1s - loss: 0.2214 - accuracy: 0.9693
1331/1875 [====================>.........] - ETA: 1s - loss: 0.2214 - accuracy: 0.9692
1358/1875 [====================>.........] - ETA: 1s - loss: 0.2214 - accuracy: 0.9692
1381/1875 [=====================>........] - ETA: 1s - loss: 0.2214 - accuracy: 0.9692
1405/1875 [=====================>........] - ETA: 1s - loss: 0.2210 - accuracy: 0.9694
1431/1875 [=====================>........] - ETA: 1s - loss: 0.2210 - accuracy: 0.9692
1458/1875 [======================>.......] - ETA: 1s - loss: 0.2206 - accuracy: 0.9692
1485/1875 [======================>.......] - ETA: 0s - loss: 0.2207 - accuracy: 0.9691
1512/1875 [=======================>......] - ETA: 0s - loss: 0.2202 - accuracy: 0.9692
1534/1875 [=======================>......] - ETA: 0s - loss: 0.2203 - accuracy: 0.9691
1559/1875 [=======================>......] - ETA: 0s - loss: 0.2203 - accuracy: 0.9690
1584/1875 [========================>.....] - ETA: 0s - loss: 0.2204 - accuracy: 0.9690
1611/1875 [========================>.....] - ETA: 0s - loss: 0.2203 - accuracy: 0.9689
1635/1875 [=========================>....] - ETA: 0s - loss: 0.2200 - accuracy: 0.9690
1661/1875 [=========================>....] - ETA: 0s - loss: 0.2206 - accuracy: 0.9688
1685/1875 [=========================>....] - ETA: 0s - loss: 0.2201 - accuracy: 0.9689
1711/1875 [==========================>...] - ETA: 0s - loss: 0.2203 - accuracy: 0.9689
1737/1875 [==========================>...] - ETA: 0s - loss: 0.2203 - accuracy: 0.9688
1762/1875 [===========================>..] - ETA: 0s - loss: 0.2202 - accuracy: 0.9689
1787/1875 [===========================>..] - ETA: 0s - loss: 0.2203 - accuracy: 0.9689
1814/1875 [============================>.] - ETA: 0s - loss: 0.2203 - accuracy: 0.9688
1837/1875 [============================>.] - ETA: 0s - loss: 0.2202 - accuracy: 0.9688
1857/1875 [============================>.] - ETA: 0s - loss: 0.2202 - accuracy: 0.9688
1875/1875 [==============================] - 4s 2ms/step - loss: 0.2204 - accuracy: 0.9687
Epoch 4/10
   1/1875 [..............................] - ETA: 0s - loss: 0.2779 - accuracy: 0.9062
  27/1875 [..............................] - ETA: 3s - loss: 0.2098 - accuracy: 0.9664
  55/1875 [..............................] - ETA: 3s - loss: 0.2067 - accuracy: 0.9710
  83/1875 [>.............................] - ETA: 3s - loss: 0.1991 - accuracy: 0.9729
 107/1875 [>.............................] - ETA: 3s - loss: 0.1958 - accuracy: 0.9737
 132/1875 [=>............................] - ETA: 3s - loss: 0.1935 - accuracy: 0.9751
 159/1875 [=>............................] - ETA: 3s - loss: 0.1938 - accuracy: 0.9743
 186/1875 [=>............................] - ETA: 3s - loss: 0.1928 - accuracy: 0.9750
 213/1875 [==>...........................] - ETA: 3s - loss: 0.1922 - accuracy: 0.9751
 236/1875 [==>...........................] - ETA: 3s - loss: 0.1956 - accuracy: 0.9739
 261/1875 [===>..........................] - ETA: 3s - loss: 0.1962 - accuracy: 0.9738
 287/1875 [===>..........................] - ETA: 3s - loss: 0.1947 - accuracy: 0.9742
 312/1875 [===>..........................] - ETA: 3s - loss: 0.1946 - accuracy: 0.9743
 339/1875 [====>.........................] - ETA: 2s - loss: 0.1963 - accuracy: 0.9736
 362/1875 [====>.........................] - ETA: 2s - loss: 0.1961 - accuracy: 0.9736
 386/1875 [=====>........................] - ETA: 2s - loss: 0.1953 - accuracy: 0.9739
 412/1875 [=====>........................] - ETA: 2s - loss: 0.1963 - accuracy: 0.9735
 429/1875 [=====>........................] - ETA: 2s - loss: 0.1964 - accuracy: 0.9733
 454/1875 [======>.......................] - ETA: 2s - loss: 0.1974 - accuracy: 0.9730
 478/1875 [======>.......................] - ETA: 2s - loss: 0.1977 - accuracy: 0.9727
 502/1875 [=======>......................] - ETA: 2s - loss: 0.1985 - accuracy: 0.9724
 528/1875 [=======>......................] - ETA: 2s - loss: 0.1985 - accuracy: 0.9722
 554/1875 [=======>......................] - ETA: 2s - loss: 0.1983 - accuracy: 0.9724
 577/1875 [========>.....................] - ETA: 2s - loss: 0.1985 - accuracy: 0.9725
 598/1875 [========>.....................] - ETA: 2s - loss: 0.1979 - accuracy: 0.9726
 625/1875 [=========>....................] - ETA: 2s - loss: 0.1978 - accuracy: 0.9725
 652/1875 [=========>....................] - ETA: 2s - loss: 0.1986 - accuracy: 0.9721
 676/1875 [=========>....................] - ETA: 2s - loss: 0.1976 - accuracy: 0.9725
 701/1875 [==========>...................] - ETA: 2s - loss: 0.1983 - accuracy: 0.9722
 728/1875 [==========>...................] - ETA: 2s - loss: 0.1977 - accuracy: 0.9724
 749/1875 [==========>...................] - ETA: 2s - loss: 0.1970 - accuracy: 0.9726
 772/1875 [===========>..................] - ETA: 2s - loss: 0.1971 - accuracy: 0.9727
 796/1875 [===========>..................] - ETA: 2s - loss: 0.1967 - accuracy: 0.9729
 822/1875 [============>.................] - ETA: 2s - loss: 0.1965 - accuracy: 0.9729
 849/1875 [============>.................] - ETA: 2s - loss: 0.1967 - accuracy: 0.9728
 876/1875 [=============>................] - ETA: 2s - loss: 0.1964 - accuracy: 0.9729
 903/1875 [=============>................] - ETA: 1s - loss: 0.1960 - accuracy: 0.9730
 928/1875 [=============>................] - ETA: 1s - loss: 0.1957 - accuracy: 0.9729
 955/1875 [==============>...............] - ETA: 1s - loss: 0.1963 - accuracy: 0.9728
 982/1875 [==============>...............] - ETA: 1s - loss: 0.1967 - accuracy: 0.9726
1009/1875 [===============>..............] - ETA: 1s - loss: 0.1971 - accuracy: 0.9722
1031/1875 [===============>..............] - ETA: 1s - loss: 0.1972 - accuracy: 0.9723
1052/1875 [===============>..............] - ETA: 1s - loss: 0.1972 - accuracy: 0.9722
1079/1875 [================>.............] - ETA: 1s - loss: 0.1970 - accuracy: 0.9721
1106/1875 [================>.............] - ETA: 1s - loss: 0.1977 - accuracy: 0.9717
1130/1875 [=================>............] - ETA: 1s - loss: 0.1976 - accuracy: 0.9717
1152/1875 [=================>............] - ETA: 1s - loss: 0.1979 - accuracy: 0.9717
1178/1875 [=================>............] - ETA: 1s - loss: 0.1981 - accuracy: 0.9716
1205/1875 [==================>...........] - ETA: 1s - loss: 0.1979 - accuracy: 0.9718
1232/1875 [==================>...........] - ETA: 1s - loss: 0.1980 - accuracy: 0.9717
1256/1875 [===================>..........] - ETA: 1s - loss: 0.1986 - accuracy: 0.9716
1280/1875 [===================>..........] - ETA: 1s - loss: 0.1987 - accuracy: 0.9716
1306/1875 [===================>..........] - ETA: 1s - loss: 0.1986 - accuracy: 0.9716
1331/1875 [====================>.........] - ETA: 1s - loss: 0.1985 - accuracy: 0.9716
1358/1875 [====================>.........] - ETA: 1s - loss: 0.1986 - accuracy: 0.9716
1383/1875 [=====================>........] - ETA: 0s - loss: 0.1978 - accuracy: 0.9720
1410/1875 [=====================>........] - ETA: 0s - loss: 0.1980 - accuracy: 0.9719
1437/1875 [=====================>........] - ETA: 0s - loss: 0.1981 - accuracy: 0.9720
1461/1875 [======================>.......] - ETA: 0s - loss: 0.1981 - accuracy: 0.9720
1485/1875 [======================>.......] - ETA: 0s - loss: 0.1984 - accuracy: 0.9720
1511/1875 [=======================>......] - ETA: 0s - loss: 0.1982 - accuracy: 0.9721
1539/1875 [=======================>......] - ETA: 0s - loss: 0.1977 - accuracy: 0.9723
1567/1875 [========================>.....] - ETA: 0s - loss: 0.1978 - accuracy: 0.9723
1590/1875 [========================>.....] - ETA: 0s - loss: 0.1976 - accuracy: 0.9723
1615/1875 [========================>.....] - ETA: 0s - loss: 0.1972 - accuracy: 0.9725
1641/1875 [=========================>....] - ETA: 0s - loss: 0.1973 - accuracy: 0.9724
1668/1875 [=========================>....] - ETA: 0s - loss: 0.1970 - accuracy: 0.9725
1696/1875 [==========================>...] - ETA: 0s - loss: 0.1970 - accuracy: 0.9725
1721/1875 [==========================>...] - ETA: 0s - loss: 0.1971 - accuracy: 0.9724
1747/1875 [==========================>...] - ETA: 0s - loss: 0.1970 - accuracy: 0.9724
1775/1875 [===========================>..] - ETA: 0s - loss: 0.1968 - accuracy: 0.9724
1802/1875 [===========================>..] - ETA: 0s - loss: 0.1965 - accuracy: 0.9726
1829/1875 [============================>.] - ETA: 0s - loss: 0.1963 - accuracy: 0.9726
1850/1875 [============================>.] - ETA: 0s - loss: 0.1961 - accuracy: 0.9727
1875/1875 [==============================] - 4s 2ms/step - loss: 0.1960 - accuracy: 0.9728
Epoch 5/10
   1/1875 [..............................] - ETA: 0s - loss: 0.1784 - accuracy: 0.9688
  29/1875 [..............................] - ETA: 3s - loss: 0.1850 - accuracy: 0.9709
  57/1875 [..............................] - ETA: 3s - loss: 0.1858 - accuracy: 0.9715
  76/1875 [>.............................] - ETA: 3s - loss: 0.1895 - accuracy: 0.9700
  99/1875 [>.............................] - ETA: 3s - loss: 0.1842 - accuracy: 0.9735
 126/1875 [=>............................] - ETA: 3s - loss: 0.1831 - accuracy: 0.9740
 153/1875 [=>............................] - ETA: 3s - loss: 0.1861 - accuracy: 0.9734
 178/1875 [=>............................] - ETA: 3s - loss: 0.1813 - accuracy: 0.9752
 206/1875 [==>...........................] - ETA: 3s - loss: 0.1801 - accuracy: 0.9762
 235/1875 [==>...........................] - ETA: 3s - loss: 0.1781 - accuracy: 0.9767
 262/1875 [===>..........................] - ETA: 3s - loss: 0.1791 - accuracy: 0.9760
 288/1875 [===>..........................] - ETA: 3s - loss: 0.1796 - accuracy: 0.9760
 315/1875 [====>.........................] - ETA: 3s - loss: 0.1799 - accuracy: 0.9758
 342/1875 [====>.........................] - ETA: 2s - loss: 0.1790 - accuracy: 0.9762
 366/1875 [====>.........................] - ETA: 2s - loss: 0.1784 - accuracy: 0.9763
 391/1875 [=====>........................] - ETA: 2s - loss: 0.1778 - accuracy: 0.9765
 418/1875 [=====>........................] - ETA: 2s - loss: 0.1782 - accuracy: 0.9767
 446/1875 [======>.......................] - ETA: 2s - loss: 0.1789 - accuracy: 0.9765
 474/1875 [======>.......................] - ETA: 2s - loss: 0.1802 - accuracy: 0.9755
 501/1875 [=======>......................] - ETA: 2s - loss: 0.1799 - accuracy: 0.9760
 523/1875 [=======>......................] - ETA: 2s - loss: 0.1796 - accuracy: 0.9759
 548/1875 [=======>......................] - ETA: 2s - loss: 0.1804 - accuracy: 0.9753
 576/1875 [========>.....................] - ETA: 2s - loss: 0.1794 - accuracy: 0.9755
 604/1875 [========>.....................] - ETA: 2s - loss: 0.1798 - accuracy: 0.9755
 630/1875 [=========>....................] - ETA: 2s - loss: 0.1801 - accuracy: 0.9755
 658/1875 [=========>....................] - ETA: 2s - loss: 0.1807 - accuracy: 0.9754
 685/1875 [=========>....................] - ETA: 2s - loss: 0.1807 - accuracy: 0.9754
 713/1875 [==========>...................] - ETA: 2s - loss: 0.1799 - accuracy: 0.9758
 742/1875 [==========>...................] - ETA: 2s - loss: 0.1802 - accuracy: 0.9755
 763/1875 [===========>..................] - ETA: 2s - loss: 0.1805 - accuracy: 0.9753
 788/1875 [===========>..................] - ETA: 2s - loss: 0.1806 - accuracy: 0.9753
 816/1875 [============>.................] - ETA: 2s - loss: 0.1810 - accuracy: 0.9750
 844/1875 [============>.................] - ETA: 1s - loss: 0.1813 - accuracy: 0.9749
 865/1875 [============>.................] - ETA: 1s - loss: 0.1815 - accuracy: 0.9750
 887/1875 [=============>................] - ETA: 1s - loss: 0.1814 - accuracy: 0.9751
 914/1875 [=============>................] - ETA: 1s - loss: 0.1814 - accuracy: 0.9751
 942/1875 [==============>...............] - ETA: 1s - loss: 0.1815 - accuracy: 0.9750
 970/1875 [==============>...............] - ETA: 1s - loss: 0.1815 - accuracy: 0.9750
 996/1875 [==============>...............] - ETA: 1s - loss: 0.1815 - accuracy: 0.9750
1023/1875 [===============>..............] - ETA: 1s - loss: 0.1813 - accuracy: 0.9750
1052/1875 [===============>..............] - ETA: 1s - loss: 0.1809 - accuracy: 0.9750
1080/1875 [================>.............] - ETA: 1s - loss: 0.1810 - accuracy: 0.9751
1105/1875 [================>.............] - ETA: 1s - loss: 0.1811 - accuracy: 0.9751
1127/1875 [=================>............] - ETA: 1s - loss: 0.1811 - accuracy: 0.9752
1152/1875 [=================>............] - ETA: 1s - loss: 0.1814 - accuracy: 0.9753
1180/1875 [=================>............] - ETA: 1s - loss: 0.1814 - accuracy: 0.9753
1208/1875 [==================>...........] - ETA: 1s - loss: 0.1808 - accuracy: 0.9754
1228/1875 [==================>...........] - ETA: 1s - loss: 0.1808 - accuracy: 0.9753
1251/1875 [===================>..........] - ETA: 1s - loss: 0.1803 - accuracy: 0.9756
1279/1875 [===================>..........] - ETA: 1s - loss: 0.1799 - accuracy: 0.9758
1308/1875 [===================>..........] - ETA: 1s - loss: 0.1799 - accuracy: 0.9758
1336/1875 [====================>.........] - ETA: 1s - loss: 0.1797 - accuracy: 0.9758
1362/1875 [====================>.........] - ETA: 0s - loss: 0.1795 - accuracy: 0.9758
1389/1875 [=====================>........] - ETA: 0s - loss: 0.1801 - accuracy: 0.9756
1416/1875 [=====================>........] - ETA: 0s - loss: 0.1803 - accuracy: 0.9754
1444/1875 [======================>.......] - ETA: 0s - loss: 0.1803 - accuracy: 0.9753
1466/1875 [======================>.......] - ETA: 0s - loss: 0.1801 - accuracy: 0.9754
1490/1875 [======================>.......] - ETA: 0s - loss: 0.1801 - accuracy: 0.9754
1517/1875 [=======================>......] - ETA: 0s - loss: 0.1803 - accuracy: 0.9752
1545/1875 [=======================>......] - ETA: 0s - loss: 0.1800 - accuracy: 0.9753
1573/1875 [========================>.....] - ETA: 0s - loss: 0.1800 - accuracy: 0.9753
1599/1875 [========================>.....] - ETA: 0s - loss: 0.1801 - accuracy: 0.9752
1627/1875 [=========================>....] - ETA: 0s - loss: 0.1807 - accuracy: 0.9750
1652/1875 [=========================>....] - ETA: 0s - loss: 0.1807 - accuracy: 0.9750
1679/1875 [=========================>....] - ETA: 0s - loss: 0.1806 - accuracy: 0.9751
1705/1875 [==========================>...] - ETA: 0s - loss: 0.1803 - accuracy: 0.9752
1730/1875 [==========================>...] - ETA: 0s - loss: 0.1806 - accuracy: 0.9752
1757/1875 [===========================>..] - ETA: 0s - loss: 0.1805 - accuracy: 0.9753
1785/1875 [===========================>..] - ETA: 0s - loss: 0.1804 - accuracy: 0.9753
1811/1875 [===========================>..] - ETA: 0s - loss: 0.1803 - accuracy: 0.9753
1835/1875 [============================>.] - ETA: 0s - loss: 0.1803 - accuracy: 0.9753
1862/1875 [============================>.] - ETA: 0s - loss: 0.1802 - accuracy: 0.9753
1875/1875 [==============================] - 4s 2ms/step - loss: 0.1803 - accuracy: 0.9754
Epoch 6/10
   1/1875 [..............................] - ETA: 0s - loss: 0.1531 - accuracy: 1.0000
  29/1875 [..............................] - ETA: 3s - loss: 0.1587 - accuracy: 0.9849
  53/1875 [..............................] - ETA: 3s - loss: 0.1536 - accuracy: 0.9847
  75/1875 [>.............................] - ETA: 3s - loss: 0.1530 - accuracy: 0.9846
  99/1875 [>.............................] - ETA: 3s - loss: 0.1588 - accuracy: 0.9814
 127/1875 [=>............................] - ETA: 3s - loss: 0.1605 - accuracy: 0.9788
 155/1875 [=>............................] - ETA: 3s - loss: 0.1612 - accuracy: 0.9790
 180/1875 [=>............................] - ETA: 3s - loss: 0.1643 - accuracy: 0.9785
 207/1875 [==>...........................] - ETA: 3s - loss: 0.1625 - accuracy: 0.9795
 235/1875 [==>...........................] - ETA: 3s - loss: 0.1618 - accuracy: 0.9799
 263/1875 [===>..........................] - ETA: 3s - loss: 0.1623 - accuracy: 0.9799
 291/1875 [===>..........................] - ETA: 3s - loss: 0.1625 - accuracy: 0.9792
 316/1875 [====>.........................] - ETA: 2s - loss: 0.1635 - accuracy: 0.9788
 339/1875 [====>.........................] - ETA: 2s - loss: 0.1635 - accuracy: 0.9792
 354/1875 [====>.........................] - ETA: 3s - loss: 0.1640 - accuracy: 0.9793
 374/1875 [====>.........................] - ETA: 3s - loss: 0.1644 - accuracy: 0.9792
 402/1875 [=====>........................] - ETA: 2s - loss: 0.1651 - accuracy: 0.9793
 426/1875 [=====>........................] - ETA: 2s - loss: 0.1646 - accuracy: 0.9797
 449/1875 [======>.......................] - ETA: 2s - loss: 0.1641 - accuracy: 0.9798
 477/1875 [======>.......................] - ETA: 2s - loss: 0.1639 - accuracy: 0.9797
 505/1875 [=======>......................] - ETA: 2s - loss: 0.1654 - accuracy: 0.9790
 534/1875 [=======>......................] - ETA: 2s - loss: 0.1655 - accuracy: 0.9791
 559/1875 [=======>......................] - ETA: 2s - loss: 0.1658 - accuracy: 0.9791
 586/1875 [========>.....................] - ETA: 2s - loss: 0.1656 - accuracy: 0.9789
 615/1875 [========>.....................] - ETA: 2s - loss: 0.1667 - accuracy: 0.9787
 643/1875 [=========>....................] - ETA: 2s - loss: 0.1685 - accuracy: 0.9779
 670/1875 [=========>....................] - ETA: 2s - loss: 0.1688 - accuracy: 0.9779
 690/1875 [==========>...................] - ETA: 2s - loss: 0.1685 - accuracy: 0.9781
 713/1875 [==========>...................] - ETA: 2s - loss: 0.1680 - accuracy: 0.9782
 739/1875 [==========>...................] - ETA: 2s - loss: 0.1683 - accuracy: 0.9780
 767/1875 [===========>..................] - ETA: 2s - loss: 0.1691 - accuracy: 0.9776
 793/1875 [===========>..................] - ETA: 2s - loss: 0.1683 - accuracy: 0.9779
 818/1875 [============>.................] - ETA: 2s - loss: 0.1686 - accuracy: 0.9776
 845/1875 [============>.................] - ETA: 2s - loss: 0.1698 - accuracy: 0.9773
 873/1875 [============>.................] - ETA: 1s - loss: 0.1701 - accuracy: 0.9772
 899/1875 [=============>................] - ETA: 1s - loss: 0.1700 - accuracy: 0.9773
 926/1875 [=============>................] - ETA: 1s - loss: 0.1704 - accuracy: 0.9773
 954/1875 [==============>...............] - ETA: 1s - loss: 0.1700 - accuracy: 0.9775
 982/1875 [==============>...............] - ETA: 1s - loss: 0.1699 - accuracy: 0.9774
1003/1875 [===============>..............] - ETA: 1s - loss: 0.1698 - accuracy: 0.9774
1028/1875 [===============>..............] - ETA: 1s - loss: 0.1700 - accuracy: 0.9772
1055/1875 [===============>..............] - ETA: 1s - loss: 0.1705 - accuracy: 0.9771
1083/1875 [================>.............] - ETA: 1s - loss: 0.1703 - accuracy: 0.9772
1108/1875 [================>.............] - ETA: 1s - loss: 0.1700 - accuracy: 0.9772
1135/1875 [=================>............] - ETA: 1s - loss: 0.1697 - accuracy: 0.9773
1158/1875 [=================>............] - ETA: 1s - loss: 0.1696 - accuracy: 0.9774
1180/1875 [=================>............] - ETA: 1s - loss: 0.1697 - accuracy: 0.9773
1202/1875 [==================>...........] - ETA: 1s - loss: 0.1696 - accuracy: 0.9772
1222/1875 [==================>...........] - ETA: 1s - loss: 0.1700 - accuracy: 0.9772
1248/1875 [==================>...........] - ETA: 1s - loss: 0.1697 - accuracy: 0.9773
1275/1875 [===================>..........] - ETA: 1s - loss: 0.1702 - accuracy: 0.9773
1301/1875 [===================>..........] - ETA: 1s - loss: 0.1706 - accuracy: 0.9770
1323/1875 [====================>.........] - ETA: 1s - loss: 0.1704 - accuracy: 0.9771
1349/1875 [====================>.........] - ETA: 1s - loss: 0.1702 - accuracy: 0.9771
1377/1875 [=====================>........] - ETA: 0s - loss: 0.1708 - accuracy: 0.9769
1402/1875 [=====================>........] - ETA: 0s - loss: 0.1705 - accuracy: 0.9769
1425/1875 [=====================>........] - ETA: 0s - loss: 0.1702 - accuracy: 0.9770
1452/1875 [======================>.......] - ETA: 0s - loss: 0.1701 - accuracy: 0.9770
1480/1875 [======================>.......] - ETA: 0s - loss: 0.1701 - accuracy: 0.9771
1507/1875 [=======================>......] - ETA: 0s - loss: 0.1699 - accuracy: 0.9771
1532/1875 [=======================>......] - ETA: 0s - loss: 0.1700 - accuracy: 0.9771
1558/1875 [=======================>......] - ETA: 0s - loss: 0.1697 - accuracy: 0.9772
1584/1875 [========================>.....] - ETA: 0s - loss: 0.1699 - accuracy: 0.9772
1610/1875 [========================>.....] - ETA: 0s - loss: 0.1702 - accuracy: 0.9772
1635/1875 [=========================>....] - ETA: 0s - loss: 0.1700 - accuracy: 0.9772
1662/1875 [=========================>....] - ETA: 0s - loss: 0.1699 - accuracy: 0.9773
1689/1875 [==========================>...] - ETA: 0s - loss: 0.1697 - accuracy: 0.9774
1715/1875 [==========================>...] - ETA: 0s - loss: 0.1694 - accuracy: 0.9775
1742/1875 [==========================>...] - ETA: 0s - loss: 0.1696 - accuracy: 0.9773
1763/1875 [===========================>..] - ETA: 0s - loss: 0.1695 - accuracy: 0.9774
1789/1875 [===========================>..] - ETA: 0s - loss: 0.1701 - accuracy: 0.9773
1817/1875 [============================>.] - ETA: 0s - loss: 0.1701 - accuracy: 0.9773
1846/1875 [============================>.] - ETA: 0s - loss: 0.1701 - accuracy: 0.9773
1872/1875 [============================>.] - ETA: 0s - loss: 0.1700 - accuracy: 0.9774
1875/1875 [==============================] - 4s 2ms/step - loss: 0.1700 - accuracy: 0.9775
Epoch 7/10
   1/1875 [..............................] - ETA: 1s - loss: 0.1800 - accuracy: 0.9375
  29/1875 [..............................] - ETA: 3s - loss: 0.1513 - accuracy: 0.9828
  53/1875 [..............................] - ETA: 3s - loss: 0.1608 - accuracy: 0.9817
  79/1875 [>.............................] - ETA: 3s - loss: 0.1636 - accuracy: 0.9814
 105/1875 [>.............................] - ETA: 3s - loss: 0.1611 - accuracy: 0.9804
 131/1875 [=>............................] - ETA: 3s - loss: 0.1603 - accuracy: 0.9804
 159/1875 [=>............................] - ETA: 3s - loss: 0.1556 - accuracy: 0.9813
 187/1875 [=>............................] - ETA: 3s - loss: 0.1578 - accuracy: 0.9813
 211/1875 [==>...........................] - ETA: 3s - loss: 0.1573 - accuracy: 0.9813
 239/1875 [==>...........................] - ETA: 3s - loss: 0.1595 - accuracy: 0.9806
 267/1875 [===>..........................] - ETA: 3s - loss: 0.1592 - accuracy: 0.9807
 294/1875 [===>..........................] - ETA: 2s - loss: 0.1585 - accuracy: 0.9811
 311/1875 [===>..........................] - ETA: 3s - loss: 0.1576 - accuracy: 0.9813
 326/1875 [====>.........................] - ETA: 3s - loss: 0.1566 - accuracy: 0.9817
 344/1875 [====>.........................] - ETA: 3s - loss: 0.1564 - accuracy: 0.9816
 369/1875 [====>.........................] - ETA: 3s - loss: 0.1578 - accuracy: 0.9813
 396/1875 [=====>........................] - ETA: 3s - loss: 0.1585 - accuracy: 0.9807
 420/1875 [=====>........................] - ETA: 2s - loss: 0.1584 - accuracy: 0.9807
 447/1875 [======>.......................] - ETA: 2s - loss: 0.1584 - accuracy: 0.9806
 475/1875 [======>.......................] - ETA: 2s - loss: 0.1580 - accuracy: 0.9807
 504/1875 [=======>......................] - ETA: 2s - loss: 0.1590 - accuracy: 0.9803
 529/1875 [=======>......................] - ETA: 2s - loss: 0.1600 - accuracy: 0.9802
 554/1875 [=======>......................] - ETA: 2s - loss: 0.1588 - accuracy: 0.9807
 582/1875 [========>.....................] - ETA: 2s - loss: 0.1589 - accuracy: 0.9807
 610/1875 [========>.....................] - ETA: 2s - loss: 0.1589 - accuracy: 0.9805
 636/1875 [=========>....................] - ETA: 2s - loss: 0.1591 - accuracy: 0.9807
 660/1875 [=========>....................] - ETA: 2s - loss: 0.1593 - accuracy: 0.9805
 687/1875 [=========>....................] - ETA: 2s - loss: 0.1596 - accuracy: 0.9803
 715/1875 [==========>...................] - ETA: 2s - loss: 0.1593 - accuracy: 0.9803
 744/1875 [==========>...................] - ETA: 2s - loss: 0.1588 - accuracy: 0.9805
 770/1875 [===========>..................] - ETA: 2s - loss: 0.1589 - accuracy: 0.9805
 795/1875 [===========>..................] - ETA: 2s - loss: 0.1594 - accuracy: 0.9801
 820/1875 [============>.................] - ETA: 2s - loss: 0.1602 - accuracy: 0.9800
 847/1875 [============>.................] - ETA: 2s - loss: 0.1607 - accuracy: 0.9799
 870/1875 [============>.................] - ETA: 1s - loss: 0.1606 - accuracy: 0.9798
 897/1875 [=============>................] - ETA: 1s - loss: 0.1614 - accuracy: 0.9794
 925/1875 [=============>................] - ETA: 1s - loss: 0.1613 - accuracy: 0.9793
 952/1875 [==============>...............] - ETA: 1s - loss: 0.1612 - accuracy: 0.9793
 979/1875 [==============>...............] - ETA: 1s - loss: 0.1612 - accuracy: 0.9793
1004/1875 [===============>..............] - ETA: 1s - loss: 0.1609 - accuracy: 0.9793
1030/1875 [===============>..............] - ETA: 1s - loss: 0.1609 - accuracy: 0.9794
1058/1875 [===============>..............] - ETA: 1s - loss: 0.1610 - accuracy: 0.9793
1084/1875 [================>.............] - ETA: 1s - loss: 0.1616 - accuracy: 0.9791
1108/1875 [================>.............] - ETA: 1s - loss: 0.1617 - accuracy: 0.9791
1134/1875 [=================>............] - ETA: 1s - loss: 0.1618 - accuracy: 0.9790
1163/1875 [=================>............] - ETA: 1s - loss: 0.1622 - accuracy: 0.9789
1191/1875 [==================>...........] - ETA: 1s - loss: 0.1624 - accuracy: 0.9787
1219/1875 [==================>...........] - ETA: 1s - loss: 0.1623 - accuracy: 0.9787
1242/1875 [==================>...........] - ETA: 1s - loss: 0.1621 - accuracy: 0.9788
1265/1875 [===================>..........] - ETA: 1s - loss: 0.1618 - accuracy: 0.9789
1293/1875 [===================>..........] - ETA: 1s - loss: 0.1617 - accuracy: 0.9790
1320/1875 [====================>.........] - ETA: 1s - loss: 0.1614 - accuracy: 0.9791
1344/1875 [====================>.........] - ETA: 1s - loss: 0.1617 - accuracy: 0.9790
1370/1875 [====================>.........] - ETA: 0s - loss: 0.1615 - accuracy: 0.9791
1397/1875 [=====================>........] - ETA: 0s - loss: 0.1620 - accuracy: 0.9788
1425/1875 [=====================>........] - ETA: 0s - loss: 0.1620 - accuracy: 0.9788
1452/1875 [======================>.......] - ETA: 0s - loss: 0.1624 - accuracy: 0.9786
1478/1875 [======================>.......] - ETA: 0s - loss: 0.1622 - accuracy: 0.9787
1505/1875 [=======================>......] - ETA: 0s - loss: 0.1628 - accuracy: 0.9785
1531/1875 [=======================>......] - ETA: 0s - loss: 0.1631 - accuracy: 0.9784
1558/1875 [=======================>......] - ETA: 0s - loss: 0.1630 - accuracy: 0.9784
1584/1875 [========================>.....] - ETA: 0s - loss: 0.1632 - accuracy: 0.9784
1611/1875 [========================>.....] - ETA: 0s - loss: 0.1633 - accuracy: 0.9783
1638/1875 [=========================>....] - ETA: 0s - loss: 0.1632 - accuracy: 0.9784
1666/1875 [=========================>....] - ETA: 0s - loss: 0.1630 - accuracy: 0.9785
1692/1875 [==========================>...] - ETA: 0s - loss: 0.1629 - accuracy: 0.9784
1718/1875 [==========================>...] - ETA: 0s - loss: 0.1627 - accuracy: 0.9785
1743/1875 [==========================>...] - ETA: 0s - loss: 0.1628 - accuracy: 0.9785
1771/1875 [===========================>..] - ETA: 0s - loss: 0.1628 - accuracy: 0.9785
1797/1875 [===========================>..] - ETA: 0s - loss: 0.1629 - accuracy: 0.9784
1825/1875 [============================>.] - ETA: 0s - loss: 0.1629 - accuracy: 0.9784
1849/1875 [============================>.] - ETA: 0s - loss: 0.1631 - accuracy: 0.9783
1875/1875 [==============================] - 4s 2ms/step - loss: 0.1631 - accuracy: 0.9783
Epoch 8/10
   1/1875 [..............................] - ETA: 0s - loss: 0.1504 - accuracy: 0.9688
  25/1875 [..............................] - ETA: 3s - loss: 0.1571 - accuracy: 0.9825
  50/1875 [..............................] - ETA: 3s - loss: 0.1546 - accuracy: 0.9825
  77/1875 [>.............................] - ETA: 3s - loss: 0.1520 - accuracy: 0.9821
 105/1875 [>.............................] - ETA: 3s - loss: 0.1594 - accuracy: 0.9786
 131/1875 [=>............................] - ETA: 3s - loss: 0.1570 - accuracy: 0.9795
 155/1875 [=>............................] - ETA: 3s - loss: 0.1556 - accuracy: 0.9806
 179/1875 [=>............................] - ETA: 3s - loss: 0.1559 - accuracy: 0.9806
 207/1875 [==>...........................] - ETA: 3s - loss: 0.1568 - accuracy: 0.9805
 232/1875 [==>...........................] - ETA: 3s - loss: 0.1553 - accuracy: 0.9810
 259/1875 [===>..........................] - ETA: 3s - loss: 0.1541 - accuracy: 0.9815
 287/1875 [===>..........................] - ETA: 3s - loss: 0.1546 - accuracy: 0.9813
 315/1875 [====>.........................] - ETA: 3s - loss: 0.1542 - accuracy: 0.9816
 343/1875 [====>.........................] - ETA: 2s - loss: 0.1534 - accuracy: 0.9820
 369/1875 [====>.........................] - ETA: 2s - loss: 0.1534 - accuracy: 0.9820
 395/1875 [=====>........................] - ETA: 2s - loss: 0.1552 - accuracy: 0.9813
 423/1875 [=====>........................] - ETA: 2s - loss: 0.1554 - accuracy: 0.9811
 450/1875 [======>.......................] - ETA: 2s - loss: 0.1560 - accuracy: 0.9806
 477/1875 [======>.......................] - ETA: 2s - loss: 0.1556 - accuracy: 0.9806
 502/1875 [=======>......................] - ETA: 2s - loss: 0.1553 - accuracy: 0.9808
 529/1875 [=======>......................] - ETA: 2s - loss: 0.1550 - accuracy: 0.9810
 555/1875 [=======>......................] - ETA: 2s - loss: 0.1545 - accuracy: 0.9811
 583/1875 [========>.....................] - ETA: 2s - loss: 0.1547 - accuracy: 0.9813
 608/1875 [========>.....................] - ETA: 2s - loss: 0.1547 - accuracy: 0.9813
 632/1875 [=========>....................] - ETA: 2s - loss: 0.1552 - accuracy: 0.9809
 659/1875 [=========>....................] - ETA: 2s - loss: 0.1545 - accuracy: 0.9810
 687/1875 [=========>....................] - ETA: 2s - loss: 0.1546 - accuracy: 0.9810
 712/1875 [==========>...................] - ETA: 2s - loss: 0.1555 - accuracy: 0.9808
 736/1875 [==========>...................] - ETA: 2s - loss: 0.1560 - accuracy: 0.9805
 763/1875 [===========>..................] - ETA: 2s - loss: 0.1558 - accuracy: 0.9805
 790/1875 [===========>..................] - ETA: 2s - loss: 0.1553 - accuracy: 0.9807
 818/1875 [============>.................] - ETA: 2s - loss: 0.1554 - accuracy: 0.9807
 843/1875 [============>.................] - ETA: 1s - loss: 0.1557 - accuracy: 0.9806
 870/1875 [============>.................] - ETA: 1s - loss: 0.1558 - accuracy: 0.9805
 894/1875 [=============>................] - ETA: 1s - loss: 0.1557 - accuracy: 0.9806
 921/1875 [=============>................] - ETA: 1s - loss: 0.1556 - accuracy: 0.9806
 949/1875 [==============>...............] - ETA: 1s - loss: 0.1565 - accuracy: 0.9803
 968/1875 [==============>...............] - ETA: 1s - loss: 0.1562 - accuracy: 0.9804
 992/1875 [==============>...............] - ETA: 1s - loss: 0.1563 - accuracy: 0.9802
1020/1875 [===============>..............] - ETA: 1s - loss: 0.1566 - accuracy: 0.9801
1048/1875 [===============>..............] - ETA: 1s - loss: 0.1564 - accuracy: 0.9802
1073/1875 [================>.............] - ETA: 1s - loss: 0.1564 - accuracy: 0.9802
1100/1875 [================>.............] - ETA: 1s - loss: 0.1567 - accuracy: 0.9799
1128/1875 [=================>............] - ETA: 1s - loss: 0.1562 - accuracy: 0.9801
1156/1875 [=================>............] - ETA: 1s - loss: 0.1559 - accuracy: 0.9801
1183/1875 [=================>............] - ETA: 1s - loss: 0.1564 - accuracy: 0.9801
1207/1875 [==================>...........] - ETA: 1s - loss: 0.1561 - accuracy: 0.9802
1233/1875 [==================>...........] - ETA: 1s - loss: 0.1564 - accuracy: 0.9801
1261/1875 [===================>..........] - ETA: 1s - loss: 0.1565 - accuracy: 0.9800
1288/1875 [===================>..........] - ETA: 1s - loss: 0.1564 - accuracy: 0.9800
1315/1875 [====================>.........] - ETA: 1s - loss: 0.1569 - accuracy: 0.9798
1336/1875 [====================>.........] - ETA: 1s - loss: 0.1571 - accuracy: 0.9798
1363/1875 [====================>.........] - ETA: 0s - loss: 0.1571 - accuracy: 0.9798
1391/1875 [=====================>........] - ETA: 0s - loss: 0.1572 - accuracy: 0.9796
1419/1875 [=====================>........] - ETA: 0s - loss: 0.1572 - accuracy: 0.9796
1442/1875 [======================>.......] - ETA: 0s - loss: 0.1572 - accuracy: 0.9795
1467/1875 [======================>.......] - ETA: 0s - loss: 0.1573 - accuracy: 0.9795
1491/1875 [======================>.......] - ETA: 0s - loss: 0.1577 - accuracy: 0.9794
1519/1875 [=======================>......] - ETA: 0s - loss: 0.1576 - accuracy: 0.9794
1547/1875 [=======================>......] - ETA: 0s - loss: 0.1578 - accuracy: 0.9793
1572/1875 [========================>.....] - ETA: 0s - loss: 0.1575 - accuracy: 0.9794
1598/1875 [========================>.....] - ETA: 0s - loss: 0.1574 - accuracy: 0.9795
1624/1875 [========================>.....] - ETA: 0s - loss: 0.1572 - accuracy: 0.9795
1649/1875 [=========================>....] - ETA: 0s - loss: 0.1574 - accuracy: 0.9795
1676/1875 [=========================>....] - ETA: 0s - loss: 0.1574 - accuracy: 0.9795
1701/1875 [==========================>...] - ETA: 0s - loss: 0.1573 - accuracy: 0.9796
1728/1875 [==========================>...] - ETA: 0s - loss: 0.1575 - accuracy: 0.9795
1756/1875 [===========================>..] - ETA: 0s - loss: 0.1573 - accuracy: 0.9796
1783/1875 [===========================>..] - ETA: 0s - loss: 0.1572 - accuracy: 0.9796
1808/1875 [===========================>..] - ETA: 0s - loss: 0.1574 - accuracy: 0.9796
1834/1875 [============================>.] - ETA: 0s - loss: 0.1577 - accuracy: 0.9795
1861/1875 [============================>.] - ETA: 0s - loss: 0.1579 - accuracy: 0.9794
1875/1875 [==============================] - 4s 2ms/step - loss: 0.1579 - accuracy: 0.9795
Epoch 9/10
   1/1875 [..............................] - ETA: 0s - loss: 0.1625 - accuracy: 0.9688
  27/1875 [..............................] - ETA: 3s - loss: 0.1454 - accuracy: 0.9850
  51/1875 [..............................] - ETA: 3s - loss: 0.1594 - accuracy: 0.9767
  76/1875 [>.............................] - ETA: 3s - loss: 0.1527 - accuracy: 0.9803
 102/1875 [>.............................] - ETA: 3s - loss: 0.1500 - accuracy: 0.9801
 129/1875 [=>............................] - ETA: 3s - loss: 0.1501 - accuracy: 0.9811
 153/1875 [=>............................] - ETA: 3s - loss: 0.1545 - accuracy: 0.9800
 179/1875 [=>............................] - ETA: 3s - loss: 0.1542 - accuracy: 0.9804
 206/1875 [==>...........................] - ETA: 3s - loss: 0.1549 - accuracy: 0.9801
 233/1875 [==>...........................] - ETA: 3s - loss: 0.1545 - accuracy: 0.9803
 259/1875 [===>..........................] - ETA: 3s - loss: 0.1552 - accuracy: 0.9800
 283/1875 [===>..........................] - ETA: 3s - loss: 0.1537 - accuracy: 0.9806
 306/1875 [===>..........................] - ETA: 3s - loss: 0.1522 - accuracy: 0.9812
 332/1875 [====>.........................] - ETA: 3s - loss: 0.1521 - accuracy: 0.9816
 360/1875 [====>.........................] - ETA: 2s - loss: 0.1539 - accuracy: 0.9811
 388/1875 [=====>........................] - ETA: 2s - loss: 0.1536 - accuracy: 0.9813
 413/1875 [=====>........................] - ETA: 2s - loss: 0.1530 - accuracy: 0.9816
 440/1875 [======>.......................] - ETA: 2s - loss: 0.1533 - accuracy: 0.9813
 467/1875 [======>.......................] - ETA: 2s - loss: 0.1519 - accuracy: 0.9819
 495/1875 [======>.......................] - ETA: 2s - loss: 0.1512 - accuracy: 0.9824
 520/1875 [=======>......................] - ETA: 2s - loss: 0.1512 - accuracy: 0.9820
 546/1875 [=======>......................] - ETA: 2s - loss: 0.1502 - accuracy: 0.9825
 573/1875 [========>.....................] - ETA: 2s - loss: 0.1506 - accuracy: 0.9823
 599/1875 [========>.....................] - ETA: 2s - loss: 0.1511 - accuracy: 0.9819
 626/1875 [=========>....................] - ETA: 2s - loss: 0.1517 - accuracy: 0.9818
 650/1875 [=========>....................] - ETA: 2s - loss: 0.1519 - accuracy: 0.9814
 677/1875 [=========>....................] - ETA: 2s - loss: 0.1520 - accuracy: 0.9814
 705/1875 [==========>...................] - ETA: 2s - loss: 0.1531 - accuracy: 0.9809
 733/1875 [==========>...................] - ETA: 2s - loss: 0.1530 - accuracy: 0.9810
 761/1875 [===========>..................] - ETA: 2s - loss: 0.1527 - accuracy: 0.9811
 786/1875 [===========>..................] - ETA: 2s - loss: 0.1523 - accuracy: 0.9813
 813/1875 [============>.................] - ETA: 2s - loss: 0.1525 - accuracy: 0.9812
 841/1875 [============>.................] - ETA: 1s - loss: 0.1525 - accuracy: 0.9813
 868/1875 [============>.................] - ETA: 1s - loss: 0.1527 - accuracy: 0.9811
 893/1875 [=============>................] - ETA: 1s - loss: 0.1526 - accuracy: 0.9812
 920/1875 [=============>................] - ETA: 1s - loss: 0.1530 - accuracy: 0.9809
 948/1875 [==============>...............] - ETA: 1s - loss: 0.1532 - accuracy: 0.9810
 976/1875 [==============>...............] - ETA: 1s - loss: 0.1536 - accuracy: 0.9810
1004/1875 [===============>..............] - ETA: 1s - loss: 0.1537 - accuracy: 0.9810
1030/1875 [===============>..............] - ETA: 1s - loss: 0.1536 - accuracy: 0.9811
1057/1875 [===============>..............] - ETA: 1s - loss: 0.1539 - accuracy: 0.9810
1085/1875 [================>.............] - ETA: 1s - loss: 0.1533 - accuracy: 0.9811
1113/1875 [================>.............] - ETA: 1s - loss: 0.1534 - accuracy: 0.9810
1138/1875 [=================>............] - ETA: 1s - loss: 0.1535 - accuracy: 0.9811
1164/1875 [=================>............] - ETA: 1s - loss: 0.1535 - accuracy: 0.9810
1192/1875 [==================>...........] - ETA: 1s - loss: 0.1538 - accuracy: 0.9809
1220/1875 [==================>...........] - ETA: 1s - loss: 0.1538 - accuracy: 0.9809
1248/1875 [==================>...........] - ETA: 1s - loss: 0.1538 - accuracy: 0.9809
1274/1875 [===================>..........] - ETA: 1s - loss: 0.1537 - accuracy: 0.9809
1301/1875 [===================>..........] - ETA: 1s - loss: 0.1536 - accuracy: 0.9809
1329/1875 [====================>.........] - ETA: 1s - loss: 0.1535 - accuracy: 0.9810
1357/1875 [====================>.........] - ETA: 0s - loss: 0.1533 - accuracy: 0.9811
1382/1875 [=====================>........] - ETA: 0s - loss: 0.1533 - accuracy: 0.9811
1409/1875 [=====================>........] - ETA: 0s - loss: 0.1535 - accuracy: 0.9810
1436/1875 [=====================>........] - ETA: 0s - loss: 0.1538 - accuracy: 0.9810
1463/1875 [======================>.......] - ETA: 0s - loss: 0.1539 - accuracy: 0.9809
1491/1875 [======================>.......] - ETA: 0s - loss: 0.1542 - accuracy: 0.9808
1517/1875 [=======================>......] - ETA: 0s - loss: 0.1541 - accuracy: 0.9807
1543/1875 [=======================>......] - ETA: 0s - loss: 0.1540 - accuracy: 0.9808
1570/1875 [========================>.....] - ETA: 0s - loss: 0.1537 - accuracy: 0.9809
1598/1875 [========================>.....] - ETA: 0s - loss: 0.1535 - accuracy: 0.9810
1623/1875 [========================>.....] - ETA: 0s - loss: 0.1537 - accuracy: 0.9809
1650/1875 [=========================>....] - ETA: 0s - loss: 0.1537 - accuracy: 0.9809
1677/1875 [=========================>....] - ETA: 0s - loss: 0.1543 - accuracy: 0.9807
1705/1875 [==========================>...] - ETA: 0s - loss: 0.1543 - accuracy: 0.9806
1728/1875 [==========================>...] - ETA: 0s - loss: 0.1543 - accuracy: 0.9806
1751/1875 [===========================>..] - ETA: 0s - loss: 0.1543 - accuracy: 0.9805
1776/1875 [===========================>..] - ETA: 0s - loss: 0.1544 - accuracy: 0.9805
1803/1875 [===========================>..] - ETA: 0s - loss: 0.1544 - accuracy: 0.9805
1831/1875 [============================>.] - ETA: 0s - loss: 0.1542 - accuracy: 0.9806
1857/1875 [============================>.] - ETA: 0s - loss: 0.1540 - accuracy: 0.9806
1875/1875 [==============================] - 4s 2ms/step - loss: 0.1542 - accuracy: 0.9805
Epoch 10/10
   1/1875 [..............................] - ETA: 0s - loss: 0.0961 - accuracy: 1.0000
  29/1875 [..............................] - ETA: 3s - loss: 0.1296 - accuracy: 0.9860
  57/1875 [..............................] - ETA: 3s - loss: 0.1316 - accuracy: 0.9868
  82/1875 [>.............................] - ETA: 3s - loss: 0.1307 - accuracy: 0.9867
 108/1875 [>.............................] - ETA: 3s - loss: 0.1382 - accuracy: 0.9844
 135/1875 [=>............................] - ETA: 3s - loss: 0.1403 - accuracy: 0.9838
 163/1875 [=>............................] - ETA: 3s - loss: 0.1439 - accuracy: 0.9829
 190/1875 [==>...........................] - ETA: 3s - loss: 0.1429 - accuracy: 0.9836
 215/1875 [==>...........................] - ETA: 3s - loss: 0.1436 - accuracy: 0.9839
 242/1875 [==>...........................] - ETA: 3s - loss: 0.1455 - accuracy: 0.9837
 270/1875 [===>..........................] - ETA: 3s - loss: 0.1456 - accuracy: 0.9832
 298/1875 [===>..........................] - ETA: 2s - loss: 0.1463 - accuracy: 0.9828
 326/1875 [====>.........................] - ETA: 2s - loss: 0.1451 - accuracy: 0.9832
 352/1875 [====>.........................] - ETA: 2s - loss: 0.1441 - accuracy: 0.9838
 379/1875 [=====>........................] - ETA: 2s - loss: 0.1437 - accuracy: 0.9838
 407/1875 [=====>........................] - ETA: 2s - loss: 0.1456 - accuracy: 0.9829
 434/1875 [=====>........................] - ETA: 2s - loss: 0.1460 - accuracy: 0.9826
 460/1875 [======>.......................] - ETA: 2s - loss: 0.1466 - accuracy: 0.9824
 486/1875 [======>.......................] - ETA: 2s - loss: 0.1464 - accuracy: 0.9828
 514/1875 [=======>......................] - ETA: 2s - loss: 0.1467 - accuracy: 0.9829
 538/1875 [=======>......................] - ETA: 2s - loss: 0.1468 - accuracy: 0.9831
 561/1875 [=======>......................] - ETA: 2s - loss: 0.1469 - accuracy: 0.9832
 588/1875 [========>.....................] - ETA: 2s - loss: 0.1467 - accuracy: 0.9831
 616/1875 [========>.....................] - ETA: 2s - loss: 0.1463 - accuracy: 0.9833
 645/1875 [=========>....................] - ETA: 2s - loss: 0.1468 - accuracy: 0.9831
 670/1875 [=========>....................] - ETA: 2s - loss: 0.1472 - accuracy: 0.9831
 694/1875 [==========>...................] - ETA: 2s - loss: 0.1470 - accuracy: 0.9830
 720/1875 [==========>...................] - ETA: 2s - loss: 0.1473 - accuracy: 0.9829
 747/1875 [==========>...................] - ETA: 2s - loss: 0.1468 - accuracy: 0.9831
 775/1875 [===========>..................] - ETA: 2s - loss: 0.1469 - accuracy: 0.9829
 801/1875 [===========>..................] - ETA: 2s - loss: 0.1475 - accuracy: 0.9828
 827/1875 [============>.................] - ETA: 1s - loss: 0.1473 - accuracy: 0.9828
 851/1875 [============>.................] - ETA: 1s - loss: 0.1478 - accuracy: 0.9827
 878/1875 [=============>................] - ETA: 1s - loss: 0.1478 - accuracy: 0.9828
 903/1875 [=============>................] - ETA: 1s - loss: 0.1482 - accuracy: 0.9826
 930/1875 [=============>................] - ETA: 1s - loss: 0.1485 - accuracy: 0.9824
 958/1875 [==============>...............] - ETA: 1s - loss: 0.1481 - accuracy: 0.9826
 982/1875 [==============>...............] - ETA: 1s - loss: 0.1479 - accuracy: 0.9826
1008/1875 [===============>..............] - ETA: 1s - loss: 0.1480 - accuracy: 0.9825
1032/1875 [===============>..............] - ETA: 1s - loss: 0.1477 - accuracy: 0.9826
1058/1875 [===============>..............] - ETA: 1s - loss: 0.1480 - accuracy: 0.9826
1086/1875 [================>.............] - ETA: 1s - loss: 0.1479 - accuracy: 0.9826
1110/1875 [================>.............] - ETA: 1s - loss: 0.1478 - accuracy: 0.9827
1137/1875 [=================>............] - ETA: 1s - loss: 0.1489 - accuracy: 0.9825
1161/1875 [=================>............] - ETA: 1s - loss: 0.1496 - accuracy: 0.9822
1188/1875 [==================>...........] - ETA: 1s - loss: 0.1501 - accuracy: 0.9821
1214/1875 [==================>...........] - ETA: 1s - loss: 0.1500 - accuracy: 0.9821
1239/1875 [==================>...........] - ETA: 1s - loss: 0.1497 - accuracy: 0.9821
1265/1875 [===================>..........] - ETA: 1s - loss: 0.1496 - accuracy: 0.9822
1290/1875 [===================>..........] - ETA: 1s - loss: 0.1498 - accuracy: 0.9821
1317/1875 [====================>.........] - ETA: 1s - loss: 0.1498 - accuracy: 0.9822
1345/1875 [====================>.........] - ETA: 1s - loss: 0.1494 - accuracy: 0.9824
1372/1875 [====================>.........] - ETA: 0s - loss: 0.1490 - accuracy: 0.9825
1397/1875 [=====================>........] - ETA: 0s - loss: 0.1490 - accuracy: 0.9824
1424/1875 [=====================>........] - ETA: 0s - loss: 0.1489 - accuracy: 0.9824
1450/1875 [======================>.......] - ETA: 0s - loss: 0.1491 - accuracy: 0.9823
1474/1875 [======================>.......] - ETA: 0s - loss: 0.1492 - accuracy: 0.9823
1501/1875 [=======================>......] - ETA: 0s - loss: 0.1498 - accuracy: 0.9820
1526/1875 [=======================>......] - ETA: 0s - loss: 0.1501 - accuracy: 0.9820
1553/1875 [=======================>......] - ETA: 0s - loss: 0.1501 - accuracy: 0.9820
1576/1875 [========================>.....] - ETA: 0s - loss: 0.1500 - accuracy: 0.9820
1602/1875 [========================>.....] - ETA: 0s - loss: 0.1503 - accuracy: 0.9820
1624/1875 [========================>.....] - ETA: 0s - loss: 0.1504 - accuracy: 0.9819
1648/1875 [=========================>....] - ETA: 0s - loss: 0.1504 - accuracy: 0.9820
1675/1875 [=========================>....] - ETA: 0s - loss: 0.1504 - accuracy: 0.9820
1703/1875 [==========================>...] - ETA: 0s - loss: 0.1505 - accuracy: 0.9820
1730/1875 [==========================>...] - ETA: 0s - loss: 0.1504 - accuracy: 0.9820
1756/1875 [===========================>..] - ETA: 0s - loss: 0.1505 - accuracy: 0.9820
1782/1875 [===========================>..] - ETA: 0s - loss: 0.1508 - accuracy: 0.9818
1810/1875 [===========================>..] - ETA: 0s - loss: 0.1512 - accuracy: 0.9816
1838/1875 [============================>.] - ETA: 0s - loss: 0.1512 - accuracy: 0.9815
1858/1875 [============================>.] - ETA: 0s - loss: 0.1511 - accuracy: 0.9816
1875/1875 [==============================] - 4s 2ms/step - loss: 0.1511 - accuracy: 0.9815
  1/313 [..............................] - ETA: 0s - loss: 0.1008 - accuracy: 1.0000
 42/313 [===>..........................] - ETA: 0s - loss: 0.1902 - accuracy: 0.9658
 80/313 [======>.......................] - ETA: 0s - loss: 0.1983 - accuracy: 0.9629
115/313 [==========>...................] - ETA: 0s - loss: 0.1925 - accuracy: 0.9660
152/313 [=============>................] - ETA: 0s - loss: 0.1972 - accuracy: 0.9640
179/313 [================>.............] - ETA: 0s - loss: 0.1868 - accuracy: 0.9674
211/313 [===================>..........] - ETA: 0s - loss: 0.1818 - accuracy: 0.9695
247/313 [======================>.......] - ETA: 0s - loss: 0.1717 - accuracy: 0.9734
285/313 [==========================>...] - ETA: 0s - loss: 0.1649 - accuracy: 0.9760
313/313 [==============================] - 0s 1ms/step - loss: 0.1652 - accuracy: 0.9757

test loss 0.16515833139419556
test accuracy 0.9757000207901001
   1/1875 [..............................] - ETA: 0s - loss: 0.1372 - accuracy: 0.9688
  29/1875 [..............................] - ETA: 3s - loss: 0.1579 - accuracy: 0.9817
  50/1875 [..............................] - ETA: 3s - loss: 0.1542 - accuracy: 0.9812
  78/1875 [>.............................] - ETA: 3s - loss: 0.1439 - accuracy: 0.9856
 107/1875 [>.............................] - ETA: 3s - loss: 0.1388 - accuracy: 0.9874
 133/1875 [=>............................] - ETA: 3s - loss: 0.1361 - accuracy: 0.9887
 161/1875 [=>............................] - ETA: 3s - loss: 0.1342 - accuracy: 0.9893
 189/1875 [==>...........................] - ETA: 3s - loss: 0.1356 - accuracy: 0.9891
 218/1875 [==>...........................] - ETA: 3s - loss: 0.1356 - accuracy: 0.9882
 244/1875 [==>...........................] - ETA: 3s - loss: 0.1352 - accuracy: 0.9882
 272/1875 [===>..........................] - ETA: 2s - loss: 0.1360 - accuracy: 0.9882
 300/1875 [===>..........................] - ETA: 2s - loss: 0.1379 - accuracy: 0.9875
 329/1875 [====>.........................] - ETA: 2s - loss: 0.1364 - accuracy: 0.9881
 356/1875 [====>.........................] - ETA: 2s - loss: 0.1357 - accuracy: 0.9881
 377/1875 [=====>........................] - ETA: 2s - loss: 0.1357 - accuracy: 0.9881
 404/1875 [=====>........................] - ETA: 2s - loss: 0.1359 - accuracy: 0.9879
 432/1875 [=====>........................] - ETA: 2s - loss: 0.1353 - accuracy: 0.9880
 461/1875 [======>.......................] - ETA: 2s - loss: 0.1352 - accuracy: 0.9879
 490/1875 [======>.......................] - ETA: 2s - loss: 0.1345 - accuracy: 0.9881
 514/1875 [=======>......................] - ETA: 2s - loss: 0.1352 - accuracy: 0.9878
 539/1875 [=======>......................] - ETA: 2s - loss: 0.1354 - accuracy: 0.9878
 567/1875 [========>.....................] - ETA: 2s - loss: 0.1354 - accuracy: 0.9878
 595/1875 [========>.....................] - ETA: 2s - loss: 0.1352 - accuracy: 0.9879
 622/1875 [========>.....................] - ETA: 2s - loss: 0.1357 - accuracy: 0.9878
 649/1875 [=========>....................] - ETA: 2s - loss: 0.1360 - accuracy: 0.9875
 677/1875 [=========>....................] - ETA: 2s - loss: 0.1366 - accuracy: 0.9874
 706/1875 [==========>...................] - ETA: 2s - loss: 0.1369 - accuracy: 0.9873
 733/1875 [==========>...................] - ETA: 2s - loss: 0.1366 - accuracy: 0.9872
 758/1875 [===========>..................] - ETA: 2s - loss: 0.1367 - accuracy: 0.9873
 785/1875 [===========>..................] - ETA: 2s - loss: 0.1366 - accuracy: 0.9872
 814/1875 [============>.................] - ETA: 1s - loss: 0.1366 - accuracy: 0.9873
 842/1875 [============>.................] - ETA: 1s - loss: 0.1375 - accuracy: 0.9870
 872/1875 [============>.................] - ETA: 1s - loss: 0.1375 - accuracy: 0.9870
 903/1875 [=============>................] - ETA: 1s - loss: 0.1371 - accuracy: 0.9871
 931/1875 [=============>................] - ETA: 1s - loss: 0.1370 - accuracy: 0.9870
 963/1875 [==============>...............] - ETA: 1s - loss: 0.1368 - accuracy: 0.9871
 995/1875 [==============>...............] - ETA: 1s - loss: 0.1374 - accuracy: 0.9870
1025/1875 [===============>..............] - ETA: 1s - loss: 0.1376 - accuracy: 0.9869
1057/1875 [===============>..............] - ETA: 1s - loss: 0.1372 - accuracy: 0.9869
1089/1875 [================>.............] - ETA: 1s - loss: 0.1373 - accuracy: 0.9868
1121/1875 [================>.............] - ETA: 1s - loss: 0.1375 - accuracy: 0.9869
1153/1875 [=================>............] - ETA: 1s - loss: 0.1375 - accuracy: 0.9869
1179/1875 [=================>............] - ETA: 1s - loss: 0.1380 - accuracy: 0.9867
1205/1875 [==================>...........] - ETA: 1s - loss: 0.1382 - accuracy: 0.9867
1234/1875 [==================>...........] - ETA: 1s - loss: 0.1383 - accuracy: 0.9867
1266/1875 [===================>..........] - ETA: 1s - loss: 0.1380 - accuracy: 0.9868
1294/1875 [===================>..........] - ETA: 1s - loss: 0.1383 - accuracy: 0.9867
1324/1875 [====================>.........] - ETA: 0s - loss: 0.1383 - accuracy: 0.9868
1356/1875 [====================>.........] - ETA: 0s - loss: 0.1384 - accuracy: 0.9867
1387/1875 [=====================>........] - ETA: 0s - loss: 0.1384 - accuracy: 0.9867
1418/1875 [=====================>........] - ETA: 0s - loss: 0.1382 - accuracy: 0.9868
1447/1875 [======================>.......] - ETA: 0s - loss: 0.1385 - accuracy: 0.9866
1478/1875 [======================>.......] - ETA: 0s - loss: 0.1386 - accuracy: 0.9866
1507/1875 [=======================>......] - ETA: 0s - loss: 0.1389 - accuracy: 0.9864
1537/1875 [=======================>......] - ETA: 0s - loss: 0.1390 - accuracy: 0.9864
1569/1875 [========================>.....] - ETA: 0s - loss: 0.1393 - accuracy: 0.9863
1598/1875 [========================>.....] - ETA: 0s - loss: 0.1393 - accuracy: 0.9863
1630/1875 [=========================>....] - ETA: 0s - loss: 0.1392 - accuracy: 0.9863
1662/1875 [=========================>....] - ETA: 0s - loss: 0.1392 - accuracy: 0.9863
1693/1875 [==========================>...] - ETA: 0s - loss: 0.1392 - accuracy: 0.9863
1717/1875 [==========================>...] - ETA: 0s - loss: 0.1391 - accuracy: 0.9864
1745/1875 [==========================>...] - ETA: 0s - loss: 0.1390 - accuracy: 0.9864
1776/1875 [===========================>..] - ETA: 0s - loss: 0.1388 - accuracy: 0.9865
1807/1875 [===========================>..] - ETA: 0s - loss: 0.1387 - accuracy: 0.9865
1838/1875 [============================>.] - ETA: 0s - loss: 0.1384 - accuracy: 0.9866
1868/1875 [============================>.] - ETA: 0s - loss: 0.1381 - accuracy: 0.9868
1875/1875 [==============================] - 3s 2ms/step - loss: 0.1382 - accuracy: 0.9868

train loss 0.1381898820400238
train accuracy 0.9867666959762573
粉皮皮
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
正则化的使用
Harder_14的博客
09-11 448
1.导入数据集 import numpy as np import matplotlib.pyplot as plt from reg_utils import sigmoid, relu, plot_decision_boundary, initialize_parameters, load_2D_dataset, predict_dec from reg_utils import compute_cost, predict, forward_propagation, backward_propaga
正则化
ahxieqi的博客
06-09 196
2019 June 09 正则化 正则化 Batch Normalization（批标准化） 加速网络的训练（缓解梯度消失，支持更大的学习率） 防止过拟合 降低了参数初始化的要求 动机 训练的本质是学习数据分布。如果训练数据与测试数据的分布不同会降低模型的泛化能力。因此，应该在开始训练前对所有输入数据做归一化处理。 而在神经网络中，因为每个隐层的参数不同，会使下一层的输入发生变化，从而...
7.正则化应用
booze_的博客
07-06 245
在6.Dropout应用中的未使用Dropout的代码的网络模型构建中添加正则化。 将6.Dropout应用中的 修改为 使用l2正则化之前需要先导入。 运行结果： 从运行结果可以看出来明显克服了一些过拟合的情况，模型对于数据集不是很复杂，加上正则化的话，它的效果可能就不是很好。1.导入第三方库 2.加载数据及数据预处理 3.训练模型.........
【正则化应用】正则化在线性回归以及逻辑回归中的应用
wx0628的博客
01-17 479
命题： hθ(x)=y=θ0+θ1*x1+θ2*x2+θ3*x12+θ4*x22 正则化的思路需要分析每个参数对结果的影响，如果该参数对结果影响不大，则就需要把该参数拿掉，反之，则需要保留该参数。 如果我们θ3是一个很小的参数，例如：0.00023，则我们认为θ3*x12是一个多余项； 所以对原来代价函数做如下调整（使用λ来调整前后两个表达式之间的权重关系）： 针对上述的表达式求导： 以下的代...
正则化和pytorch实际正则化应用
每日提升一点点
05-24 458
深度学习离不开梯度下降： （1） 优化器也是做上述公式。 正则化： 在下图中，虽然绿线完美的匹配训练数据，但太过依赖，并且与黑线相比，对于新的测试数据上会具有更高的错误率。虽然这个模型在训练数据集上的正确率很高，但这个模型却很难对从未见过的数据做出正确响应，认为该模型存在过拟合现象。 绿线代表过拟合模型，黑线代表正则化模型。故我们使用正则化来解决过拟合问题。 正则化是机器学习中通过显示控制模型复杂度来避免模型过拟合、确保泛化能力的一种有效方式。正则化在损失函数中引入模型复杂度指标..
正则化pdf讲义超详细
10-18
正则化是机器学习和统计学习中的一种重要技术，它广泛应用于数据预处理、特征选择和模型正则化等领域。下面我们将详细介绍正则化的概念、类型、优点和应用场景等。 一、什么是正则化？ 正则化（Regularization）是...
TV正则化代码
06-05
该程序介绍了详细的TV正则化方法在数学反问题中的应用，可以帮助大家更好的理解TV方法的原理和实现方法。
正则化算法在图像复原中的应用
04-20
关于正则化算法在图像重建中的应用，图像重建话题是光学成像领域中的一个反向推演，也是在图像处理问题中非常常见的讨论话题之一，这类反向推演通常都具有不适定性，而正则化算法在解决此类问题的时候有非常出色的...
不适定问题的正则化方法及应用__刘继军著_北京：科学出版社_2005.09.pdf
07-25
国内最经典的不适定问题研究的教材，网络上目前还没有，高清带书签。
基于Hessian矩阵范数正则化方法的共聚焦图像复原
05-06
对于泊松噪声污染下的模糊共聚焦图像复原问题，为解决传统方法中存在的阶梯效应，提出了一种基于Hessian矩阵范数的正则化方法.在泊松概率模型的基础上，该方法引入Hessian矩阵范数作为正则条件，并应用交替方向乘子...
正则化方法的实践应用：在实际项目中的成功案例
禅与计算机程序设计艺术
01-10 962
1.背景介绍 正则化方法是一种常用的机器学习和深度学习中的正则化方法，它可以帮助我们避免过拟合，提高模型的泛化能力。在实际项目中，正则化方法已经得到了广泛的应用，这篇文章将介绍一些在实际项目中成功应用正则化方法的案例，并深入讲解其核心概念、算法原理、具体操作步骤和数学模型公式。同时，我们还将讨论未来发展趋势与挑战，并提供附录中的常见问题与解答。 1.1 正则化方法的基本概念 正则化方法是一种...
深度学习中的正则化的应用（最全）
weixin_42010722的博客
09-13 1879
深度学习正则化1.正则化介绍2.数据增强3.L2正则化4.L1 正则化5.L1和L2正则化的对比5.1 L1和L2正则化防止过拟合原因5.2 L1使得权值稀疏原因6.Dropout7.Drop Connect8. 最大约束范式9.基于优化过程的正则化：早停法10.基于函数模型的正则化10.1 参数共享10.2 噪声标签10.3 标签平滑10.4 多任务学习 1.正则化介绍 正则化就是结构风险最小化策略的实现， 是在经验风险最小化的情况下加入一个正则化项或者罚项。 正则化技术令参数数量多于输入数据量的网络避免
【应用】【正则化】L1、L2正则化
weixin_39923556的博客
02-27 3103
L1正则化的作用：特征选择从可用的特征子集中选择有意义的特征，化简机器学习问题。著名的LASSO（Least Absolute Shrinkage and Selection Operator）模型将L1惩罚项和线性模型结合，饼使用最小二乘代价函数。L1正则化导致模型参数的稀疏性，被广泛地用于特征选择（feature selection）机制。L2正则化的作用：PRML书中描述“focus on quadratic both for its practical importance and analy.
（转）正则化方法在深度学习中的应用
bemy1008的博客
06-04 1333
深度学习中，卷积神经网络和循环神经网络等深度模型在各种复杂的任务中表现十分优秀。例如卷积神经网络（CNN）这种由生物启发而诞生的网络，它基于数学的卷积运算而能检测大量的图像特征，因此可用于解决多种图像视觉应用、目标分类和语音识别等问题。但是，深层网络架构的学习要求大量数据，对计算能力的要求很高。神经元和...
正则化的理解
热门推荐
不曾走远的博客
08-13 3万+
目录 一、Why & What 正则化 1 概念 2、先讨论几个问题： 二、一般正则项 三、深入理解 一、Why & What 正则化 我们总会在各种地方遇到正则化这个看起来很难理解的名词，其实它并没有那么高冷，是很好理解的 首先，从使用正则化解决了一个什么问题的角度来看：正则化是为了防止过拟合， 进而增强泛化能力。用白话文转义，泛化误差（generalizatio...
什么是正则化？他是如何起作用的？
qq_53430308的博客
01-16 4049
过拟合，欠拟合，L1L2正则 正则化可以理解为规则化,规则就等同于一种限制。在损失函数中加入正则化项可以限制他们的拟合能力，正则化就是为了防止过拟合，那么什么是过拟合？ 图1 假如我们要构建的模型是能够区分图中的红色与蓝色部分，看图1的三种模型对训练集的拟合状态： 第1种模型：欠拟合，此模型不能很好的区分图中的红色与蓝色部分。 第2种模型：拟合状态刚好，虽然有个别红色部分未被区分但考虑到实际测试集中会有噪声的存在，其拟合程度就刚刚好。 第3种模型：过拟合，此种模型对于训练集的拟合程度非常高，
史上最简单易懂、全面详细的“正则化”教程
MIss-Y的博客
11-06 8512
  进入正文 全文摘要 在机器学习和深度学习中，最艰难的问题就是如何面对模型的过拟合问题，处理过拟合的方式手段多样，我们常常听见的方法是“正则化”，但是，很多的资料对于正则化的介绍要么是单调片面、要么是晦涩难懂，本文汲取众家之长，由浅入深，彻底搞明白正则化的原理和应用。 本文偏长，阅读全文约20分钟。 一、模型过拟合 1.1 什么是模型的过拟合 1.  1训练的模型过拟合...
深度学习神经网络中正则化的使用
夜雨飘零
04-15 4610
目录 目录 前言 前提工作 模型函数 无正则化 带L2正则的激活函数 损失函数 反向传播 Dropout 带Dropout的前向传播 带Dropout的反向传播 总结 参考资料 前言 如果训练数据集不够大，由于深度学习模型具有非常大的灵活性和容量，以至于过度拟合可能是一个严重的问题，为了解决这个问题，引入了正则化的这个方法。要在神经网络中加入正则化，除了在激活层中加入正...
操作系统期末复习笔记！
最新发布
06-13
操作系统期末复习笔记
pytorch 正则化
09-22
在PyTorch中，可以使用torch.optim中的优化器来应用正则化。使用torch.optim.SGD时，可以通过设置weight_decay参数来应用L2正则化。例如，可以设置weight_decay=0.001来控制正则化的程度。 另外，还可以使用torch....

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值