优化器optimizer

交叉熵的代码改的
模型太简单，用了优化器效果也不明显
一般来说adam比SGD要好，模型优化速度比较快

import numpy as np
from keras.datasets import mnist  # 导入数据集
from keras.utils import np_utils  # Keras里面提供的一个numpy的工具包
from keras.models import Sequential
from keras.layers import Dense
from keras.optimizers import SGD, Adam
# 载入数据，从网上下载
(x_train, y_train), (x_test, y_test) = mnist.load_data()
# (60000,28,28)
print('x_shape:', x_train.shape)  # 看数据格式
# (60000)
print('y_shape:', y_train.shape)  # 看数据格式

# (60000,28,28)->(60000,784)
# 转成60000行-1表示列数不确定，会自动判断，255归一化
x_train = x_train.reshape(x_train.shape[0], -1)/255.0
x_test = x_test.reshape(x_test.shape[0], -1)/255.0

# 换one hot格式 10个类
y_train = np_utils.to_categorical(y_train, num_classes=10)
y_test = np_utils.to_categorical(y_test, num_classes=10)

# 创建模型，输入784个神经元，输出10个神经元 偏置设成1
model = Sequential([
    Dense(units=10, input_dim=784, bias_initializer='one', activation='softmax')
                   ])
# 定义优化器，loss function，训练过程中计算准确率
sgd = SGD(lr=0.2)
adam = Adam(lr=0.001)
model.compile(
    optimizer=adam,
    loss='categorical_crossentropy',  # 使用交叉熵收敛速度比较快
    metrics=['accuracy'],
)

# 训练模型（用的更多） 32张图片，每一次训练32张，60000/32次，
# epochs为训练周期,60000张全都训练一次叫一个周期。
model.fit(x_train, y_train, batch_size=32, epochs=10)
# 评估模型
loss, accuracy = model.evaluate(x_test, y_test)

print('\ntest loss', loss)
print('accuracy', accuracy)

# 保存模型
model.save('model.h5')

Epoch 1/10
   1/1875 [..............................] - ETA: 0s - loss: 2.3689 - accuracy: 0.0625
  44/1875 [..............................] - ETA: 2s - loss: 1.8078 - accuracy: 0.4709
  87/1875 [>.............................] - ETA: 2s - loss: 1.4844 - accuracy: 0.6088
 128/1875 [=>............................] - ETA: 2s - loss: 1.2869 - accuracy: 0.6790
 177/1875 [=>............................] - ETA: 1s - loss: 1.1339 - accuracy: 0.7232
 221/1875 [==>...........................] - ETA: 1s - loss: 1.0355 - accuracy: 0.7492
 270/1875 [===>..........................] - ETA: 1s - loss: 0.9540 - accuracy: 0.7689
 322/1875 [====>.........................] - ETA: 1s - loss: 0.8887 - accuracy: 0.7839
 376/1875 [=====>........................] - ETA: 1s - loss: 0.8297 - accuracy: 0.7987
 429/1875 [=====>........................] - ETA: 1s - loss: 0.7838 - accuracy: 0.8087
 475/1875 [======>.......................] - ETA: 1s - loss: 0.7509 - accuracy: 0.8171
 526/1875 [=======>......................] - ETA: 1s - loss: 0.7215 - accuracy: 0.8232
 580/1875 [========>.....................] - ETA: 1s - loss: 0.6946 - accuracy: 0.8293
 629/1875 [=========>....................] - ETA: 1s - loss: 0.6764 - accuracy: 0.8329
 682/1875 [=========>....................] - ETA: 1s - loss: 0.6547 - accuracy: 0.8377
 726/1875 [==========>...................] - ETA: 1s - loss: 0.6406 - accuracy: 0.8407
 778/1875 [===========>..................] - ETA: 1s - loss: 0.6237 - accuracy: 0.8449
 833/1875 [============>.................] - ETA: 1s - loss: 0.6081 - accuracy: 0.8483
 889/1875 [=============>................] - ETA: 1s - loss: 0.5952 - accuracy: 0.8511
 945/1875 [==============>...............] - ETA: 0s - loss: 0.5809 - accuracy: 0.8547
 969/1875 [==============>...............] - ETA: 0s - loss: 0.5763 - accuracy: 0.8555
 990/1875 [==============>...............] - ETA: 0s - loss: 0.5717 - accuracy: 0.8562
1028/1875 [===============>..............] - ETA: 0s - loss: 0.5657 - accuracy: 0.8577
1067/1875 [================>.............] - ETA: 0s - loss: 0.5590 - accuracy: 0.8587
1108/1875 [================>.............] - ETA: 0s - loss: 0.5509 - accuracy: 0.8605
1142/1875 [=================>............] - ETA: 0s - loss: 0.5453 - accuracy: 0.8613
1181/1875 [=================>............] - ETA: 0s - loss: 0.5393 - accuracy: 0.8627
1225/1875 [==================>...........] - ETA: 0s - loss: 0.5324 - accuracy: 0.8643
1272/1875 [===================>..........] - ETA: 0s - loss: 0.5259 - accuracy: 0.8655
1328/1875 [====================>.........] - ETA: 0s - loss: 0.5182 - accuracy: 0.8670
1377/1875 [=====================>........] - ETA: 0s - loss: 0.5122 - accuracy: 0.8684
1427/1875 [=====================>........] - ETA: 0s - loss: 0.5062 - accuracy: 0.8695
1482/1875 [======================>.......] - ETA: 0s - loss: 0.5003 - accuracy: 0.8706
1537/1875 [=======================>......] - ETA: 0s - loss: 0.4944 - accuracy: 0.8719
1592/1875 [========================>.....] - ETA: 0s - loss: 0.4882 - accuracy: 0.8734
1641/1875 [=========================>....] - ETA: 0s - loss: 0.4830 - accuracy: 0.8746
1687/1875 [=========================>....] - ETA: 0s - loss: 0.4784 - accuracy: 0.8759
1738/1875 [==========================>...] - ETA: 0s - loss: 0.4746 - accuracy: 0.8768
1793/1875 [===========================>..] - ETA: 0s - loss: 0.4704 - accuracy: 0.8775
1849/1875 [============================>.] - ETA: 0s - loss: 0.4665 - accuracy: 0.8782
1875/1875 [==============================] - 2s 1ms/step - loss: 0.4642 - accuracy: 0.8786
Epoch 2/10
   1/1875 [..............................] - ETA: 0s - loss: 0.2160 - accuracy: 0.9688
  54/1875 [..............................] - ETA: 1s - loss: 0.3198 - accuracy: 0.9115
 107/1875 [>.............................] - ETA: 1s - loss: 0.3186 - accuracy: 0.9127
 163/1875 [=>............................] - ETA: 1s - loss: 0.3220 - accuracy: 0.9099
 210/1875 [==>...........................] - ETA: 1s - loss: 0.3129 - accuracy: 0.9135
 259/1875 [===>..........................] - ETA: 1s - loss: 0.3086 - accuracy: 0.9142
 309/1875 [===>..........................] - ETA: 1s - loss: 0.3087 - accuracy: 0.9134
 364/1875 [====>.........................] - ETA: 1s - loss: 0.3108 - accuracy: 0.9139
 419/1875 [=====>........................] - ETA: 1s - loss: 0.3136 - accuracy: 0.9127
 470/1875 [======>.......................] - ETA: 1s - loss: 0.3135 - accuracy: 0.9130
 525/1875 [=======>......................] - ETA: 1s - loss: 0.3128 - accuracy: 0.9124
 579/1875 [========>.....................] - ETA: 1s - loss: 0.3128 - accuracy: 0.9127
 634/1875 [=========>....................] - ETA: 1s - loss: 0.3132 - accuracy: 0.9131
 688/1875 [==========>...................] - ETA: 1s - loss: 0.3124 - accuracy: 0.9138
 729/1875 [==========>...................] - ETA: 1s - loss: 0.3129 - accuracy: 0.9135
 772/1875 [===========>..................] - ETA: 1s - loss: 0.3125 - accuracy: 0.9131
 821/1875 [============>.................] - ETA: 1s - loss: 0.3134 - accuracy: 0.9125
 871/1875 [============>.................] - ETA: 0s - loss: 0.3130 - accuracy: 0.9124
 926/1875 [=============>................] - ETA: 0s - loss: 0.3104 - accuracy: 0.9134
 963/1875 [==============>...............] - ETA: 0s - loss: 0.3097 - accuracy: 0.9136
1017/1875 [===============>..............] - ETA: 0s - loss: 0.3096 - accuracy: 0.9137
1061/1875 [===============>..............] - ETA: 0s - loss: 0.3096 - accuracy: 0.9138
1112/1875 [================>.............] - ETA: 0s - loss: 0.3099 - accuracy: 0.9140
1168/1875 [=================>............] - ETA: 0s - loss: 0.3096 - accuracy: 0.9140
1210/1875 [==================>...........] - ETA: 0s - loss: 0.3091 - accuracy: 0.9143
1259/1875 [===================>..........] - ETA: 0s - loss: 0.3081 - accuracy: 0.9143
1312/1875 [===================>..........] - ETA: 0s - loss: 0.3073 - accuracy: 0.9146
1365/1875 [====================>.........] - ETA: 0s - loss: 0.3066 - accuracy: 0.9148
1421/1875 [=====================>........] - ETA: 0s - loss: 0.3060 - accuracy: 0.9149
1469/1875 [======================>.......] - ETA: 0s - loss: 0.3053 - accuracy: 0.9151
1522/1875 [=======================>......] - ETA: 0s - loss: 0.3046 - accuracy: 0.9153
1578/1875 [========================>.....] - ETA: 0s - loss: 0.3049 - accuracy: 0.9154
1633/1875 [=========================>....] - ETA: 0s - loss: 0.3035 - accuracy: 0.9158
1686/1875 [=========================>....] - ETA: 0s - loss: 0.3028 - accuracy: 0.9160
1735/1875 [==========================>...] - ETA: 0s - loss: 0.3038 - accuracy: 0.9158
1784/1875 [===========================>..] - ETA: 0s - loss: 0.3041 - accuracy: 0.9157
1837/1875 [============================>.] - ETA: 0s - loss: 0.3038 - accuracy: 0.9157
1875/1875 [==============================] - 2s 980us/step - loss: 0.3033 - accuracy: 0.9156
Epoch 3/10
   1/1875 [..............................] - ETA: 0s - loss: 0.3355 - accuracy: 0.9062
  53/1875 [..............................] - ETA: 1s - loss: 0.3143 - accuracy: 0.9163
  97/1875 [>.............................] - ETA: 1s - loss: 0.3072 - accuracy: 0.9175
 133/1875 [=>............................] - ETA: 1s - loss: 0.3053 - accuracy: 0.9175
 183/1875 [=>............................] - ETA: 1s - loss: 0.2965 - accuracy: 0.9199
 224/1875 [==>...........................] - ETA: 1s - loss: 0.2912 - accuracy: 0.9210
 274/1875 [===>..........................] - ETA: 1s - loss: 0.2874 - accuracy: 0.9221
 322/1875 [====>.........................] - ETA: 1s - loss: 0.2892 - accuracy: 0.9200
 356/1875 [====>.........................] - ETA: 1s - loss: 0.2913 - accuracy: 0.9191
 406/1875 [=====>........................] - ETA: 1s - loss: 0.2904 - accuracy: 0.9199
 454/1875 [======>.......................] - ETA: 1s - loss: 0.2879 - accuracy: 0.9208
 500/1875 [=======>......................] - ETA: 1s - loss: 0.2871 - accuracy: 0.9213
 544/1875 [=======>......................] - ETA: 1s - loss: 0.2849 - accuracy: 0.9217
 598/1875 [========>.....................] - ETA: 1s - loss: 0.2863 - accuracy: 0.9207
 653/1875 [=========>....................] - ETA: 1s - loss: 0.2874 - accuracy: 0.9202
 693/1875 [==========>...................] - ETA: 1s - loss: 0.2867 - accuracy: 0.9203
 742/1875 [==========>...................] - ETA: 1s - loss: 0.2853 - accuracy: 0.9204
 798/1875 [===========>..................] - ETA: 1s - loss: 0.2849 - accuracy: 0.9206
 854/1875 [============>.................] - ETA: 1s - loss: 0.2831 - accuracy: 0.9209
 909/1875 [=============>................] - ETA: 1s - loss: 0.2835 - accuracy: 0.9206
 957/1875 [==============>...............] - ETA: 0s - loss: 0.2814 - accuracy: 0.9207
 992/1875 [==============>...............] - ETA: 0s - loss: 0.2813 - accuracy: 0.9204
1040/1875 [===============>..............] - ETA: 0s - loss: 0.2821 - accuracy: 0.9201
1087/1875 [================>.............] - ETA: 0s - loss: 0.2810 - accuracy: 0.9204
1135/1875 [=================>............] - ETA: 0s - loss: 0.2799 - accuracy: 0.9208
1179/1875 [=================>............] - ETA: 0s - loss: 0.2812 - accuracy: 0.9204
1220/1875 [==================>...........] - ETA: 0s - loss: 0.2810 - accuracy: 0.9203
1272/1875 [===================>..........] - ETA: 0s - loss: 0.2817 - accuracy: 0.9203
1327/1875 [====================>.........] - ETA: 0s - loss: 0.2846 - accuracy: 0.9196
1382/1875 [=====================>........] - ETA: 0s - loss: 0.2852 - accuracy: 0.9195
1423/1875 [=====================>........] - ETA: 0s - loss: 0.2861 - accuracy: 0.9193
1465/1875 [======================>.......] - ETA: 0s - loss: 0.2857 - accuracy: 0.9193
1512/1875 [=======================>......] - ETA: 0s - loss: 0.2856 - accuracy: 0.9195
1565/1875 [========================>.....] - ETA: 0s - loss: 0.2848 - accuracy: 0.9196
1620/1875 [========================>.....] - ETA: 0s - loss: 0.2842 - accuracy: 0.9198
1669/1875 [=========================>....] - ETA: 0s - loss: 0.2854 - accuracy: 0.9196
1723/1875 [==========================>...] - ETA: 0s - loss: 0.2848 - accuracy: 0.9200
1777/1875 [===========================>..] - ETA: 0s - loss: 0.2843 - accuracy: 0.9199
1832/1875 [============================>.] - ETA: 0s - loss: 0.2831 - accuracy: 0.9203
1875/1875 [==============================] - 2s 1ms/step - loss: 0.2832 - accuracy: 0.9203
Epoch 4/10
   1/1875 [..............................] - ETA: 0s - loss: 0.1720 - accuracy: 0.9375
  48/1875 [..............................] - ETA: 1s - loss: 0.2744 - accuracy: 0.9284
  98/1875 [>.............................] - ETA: 1s - loss: 0.2645 - accuracy: 0.9289
 150/1875 [=>............................] - ETA: 1s - loss: 0.2737 - accuracy: 0.9256
 205/1875 [==>...........................] - ETA: 1s - loss: 0.2781 - accuracy: 0.9239
 260/1875 [===>..........................] - ETA: 1s - loss: 0.2858 - accuracy: 0.9216
 309/1875 [===>..........................] - ETA: 1s - loss: 0.2885 - accuracy: 0.9213
 362/1875 [====>.........................] - ETA: 1s - loss: 0.2860 - accuracy: 0.9205
 408/1875 [=====>........................] - ETA: 1s - loss: 0.2816 - accuracy: 0.9211
 463/1875 [======>.......................] - ETA: 1s - loss: 0.2842 - accuracy: 0.9202
 519/1875 [=======>......................] - ETA: 1s - loss: 0.2803 - accuracy: 0.9208
 569/1875 [========>.....................] - ETA: 1s - loss: 0.2795 - accuracy: 0.9210
 621/1875 [========>.....................] - ETA: 1s - loss: 0.2776 - accuracy: 0.9221
 674/1875 [=========>....................] - ETA: 1s - loss: 0.2814 - accuracy: 0.9210
 729/1875 [==========>...................] - ETA: 1s - loss: 0.2814 - accuracy: 0.9219
 785/1875 [===========>..................] - ETA: 1s - loss: 0.2789 - accuracy: 0.9221
 835/1875 [============>.................] - ETA: 0s - loss: 0.2795 - accuracy: 0.9224
 889/1875 [=============>................] - ETA: 0s - loss: 0.2787 - accuracy: 0.9224
 945/1875 [==============>...............] - ETA: 0s - loss: 0.2773 - accuracy: 0.9225
1002/1875 [===============>..............] - ETA: 0s - loss: 0.2764 - accuracy: 0.9227
1058/1875 [===============>..............] - ETA: 0s - loss: 0.2761 - accuracy: 0.9231
1106/1875 [================>.............] - ETA: 0s - loss: 0.2754 - accuracy: 0.9232
1158/1875 [=================>............] - ETA: 0s - loss: 0.2760 - accuracy: 0.9233
1213/1875 [==================>...........] - ETA: 0s - loss: 0.2745 - accuracy: 0.9237
1256/1875 [===================>..........] - ETA: 0s - loss: 0.2743 - accuracy: 0.9234
1303/1875 [===================>..........] - ETA: 0s - loss: 0.2751 - accuracy: 0.9233
1354/1875 [====================>.........] - ETA: 0s - loss: 0.2763 - accuracy: 0.9229
1408/1875 [=====================>........] - ETA: 0s - loss: 0.2766 - accuracy: 0.9229
1464/1875 [======================>.......] - ETA: 0s - loss: 0.2766 - accuracy: 0.9227
1516/1875 [=======================>......] - ETA: 0s - loss: 0.2757 - accuracy: 0.9229
1565/1875 [========================>.....] - ETA: 0s - loss: 0.2751 - accuracy: 0.9230
1618/1875 [========================>.....] - ETA: 0s - loss: 0.2740 - accuracy: 0.9231
1673/1875 [=========================>....] - ETA: 0s - loss: 0.2732 - accuracy: 0.9234
1729/1875 [==========================>...] - ETA: 0s - loss: 0.2731 - accuracy: 0.9232
1784/1875 [===========================>..] - ETA: 0s - loss: 0.2733 - accuracy: 0.9231
1827/1875 [============================>.] - ETA: 0s - loss: 0.2734 - accuracy: 0.9231
1875/1875 [==============================] - 2s 958us/step - loss: 0.2732 - accuracy: 0.9234
Epoch 5/10
   1/1875 [..............................] - ETA: 0s - loss: 0.1623 - accuracy: 0.9375
  57/1875 [..............................] - ETA: 1s - loss: 0.2358 - accuracy: 0.9348
 114/1875 [>.............................] - ETA: 1s - loss: 0.2493 - accuracy: 0.9309
 172/1875 [=>............................] - ETA: 1s - loss: 0.2591 - accuracy: 0.9273
 223/1875 [==>...........................] - ETA: 1s - loss: 0.2566 - accuracy: 0.9277
 274/1875 [===>..........................] - ETA: 1s - loss: 0.2558 - accuracy: 0.9277
 328/1875 [====>.........................] - ETA: 1s - loss: 0.2591 - accuracy: 0.9266
 372/1875 [====>.........................] - ETA: 1s - loss: 0.2607 - accuracy: 0.9262
 429/1875 [=====>........................] - ETA: 1s - loss: 0.2650 - accuracy: 0.9250
 478/1875 [======>.......................] - ETA: 1s - loss: 0.2656 - accuracy: 0.9248
 531/1875 [=======>......................] - ETA: 1s - loss: 0.2660 - accuracy: 0.9247
 588/1875 [========>.....................] - ETA: 1s - loss: 0.2675 - accuracy: 0.9250
 645/1875 [=========>....................] - ETA: 1s - loss: 0.2707 - accuracy: 0.9245
 701/1875 [==========>...................] - ETA: 1s - loss: 0.2671 - accuracy: 0.9260
 753/1875 [===========>..................] - ETA: 1s - loss: 0.2672 - accuracy: 0.9263
 797/1875 [===========>..................] - ETA: 1s - loss: 0.2696 - accuracy: 0.9257
 851/1875 [============>.................] - ETA: 0s - loss: 0.2700 - accuracy: 0.9255
 908/1875 [=============>................] - ETA: 0s - loss: 0.2718 - accuracy: 0.9247
 958/1875 [==============>...............] - ETA: 0s - loss: 0.2724 - accuracy: 0.9246
1012/1875 [===============>..............] - ETA: 0s - loss: 0.2705 - accuracy: 0.9252
1068/1875 [================>.............] - ETA: 0s - loss: 0.2704 - accuracy: 0.9250
1125/1875 [=================>............] - ETA: 0s - loss: 0.2712 - accuracy: 0.9249
1182/1875 [=================>............] - ETA: 0s - loss: 0.2691 - accuracy: 0.9253
1234/1875 [==================>...........] - ETA: 0s - loss: 0.2679 - accuracy: 0.9253
1288/1875 [===================>..........] - ETA: 0s - loss: 0.2677 - accuracy: 0.9253
1342/1875 [====================>.........] - ETA: 0s - loss: 0.2663 - accuracy: 0.9258
1394/1875 [=====================>........] - ETA: 0s - loss: 0.2658 - accuracy: 0.9259
1450/1875 [======================>.......] - ETA: 0s - loss: 0.2648 - accuracy: 0.9261
1500/1875 [=======================>......] - ETA: 0s - loss: 0.2661 - accuracy: 0.9260
1554/1875 [=======================>......] - ETA: 0s - loss: 0.2647 - accuracy: 0.9264
1608/1875 [========================>.....] - ETA: 0s - loss: 0.2643 - accuracy: 0.9262
1663/1875 [=========================>....] - ETA: 0s - loss: 0.2645 - accuracy: 0.9262
1720/1875 [==========================>...] - ETA: 0s - loss: 0.2658 - accuracy: 0.9257
1767/1875 [===========================>..] - ETA: 0s - loss: 0.2663 - accuracy: 0.9254
1819/1875 [============================>.] - ETA: 0s - loss: 0.2667 - accuracy: 0.9253
1875/1875 [==============================] - 2s 934us/step - loss: 0.2663 - accuracy: 0.9253
Epoch 6/10
   1/1875 [..............................] - ETA: 0s - loss: 0.2711 - accuracy: 0.9062
  56/1875 [..............................] - ETA: 1s - loss: 0.2327 - accuracy: 0.9342
 111/1875 [>.............................] - ETA: 1s - loss: 0.2526 - accuracy: 0.9285
 162/1875 [=>............................] - ETA: 1s - loss: 0.2598 - accuracy: 0.9282
 216/1875 [==>...........................] - ETA: 1s - loss: 0.2590 - accuracy: 0.9275
 272/1875 [===>..........................] - ETA: 1s - loss: 0.2573 - accuracy: 0.9288
 327/1875 [====>.........................] - ETA: 1s - loss: 0.2531 - accuracy: 0.9296
 377/1875 [=====>........................] - ETA: 1s - loss: 0.2531 - accuracy: 0.9297
 431/1875 [=====>........................] - ETA: 1s - loss: 0.2569 - accuracy: 0.9291
 484/1875 [======>.......................] - ETA: 1s - loss: 0.2571 - accuracy: 0.9290
 540/1875 [=======>......................] - ETA: 1s - loss: 0.2580 - accuracy: 0.9278
 589/1875 [========>.....................] - ETA: 1s - loss: 0.2596 - accuracy: 0.9270
 640/1875 [=========>....................] - ETA: 1s - loss: 0.2568 - accuracy: 0.9278
 695/1875 [==========>...................] - ETA: 1s - loss: 0.2610 - accuracy: 0.9272
 753/1875 [===========>..................] - ETA: 1s - loss: 0.2644 - accuracy: 0.9264
 809/1875 [===========>..................] - ETA: 0s - loss: 0.2642 - accuracy: 0.9266
 850/1875 [============>.................] - ETA: 0s - loss: 0.2639 - accuracy: 0.9266
 902/1875 [=============>................] - ETA: 0s - loss: 0.2640 - accuracy: 0.9266
 958/1875 [==============>...............] - ETA: 0s - loss: 0.2648 - accuracy: 0.9265
1015/1875 [===============>..............] - ETA: 0s - loss: 0.2647 - accuracy: 0.9262
1070/1875 [================>.............] - ETA: 0s - loss: 0.2635 - accuracy: 0.9266
1122/1875 [================>.............] - ETA: 0s - loss: 0.2630 - accuracy: 0.9266
1175/1875 [=================>............] - ETA: 0s - loss: 0.2627 - accuracy: 0.9266
1231/1875 [==================>...........] - ETA: 0s - loss: 0.2615 - accuracy: 0.9269
1286/1875 [===================>..........] - ETA: 0s - loss: 0.2614 - accuracy: 0.9270
1341/1875 [====================>.........] - ETA: 0s - loss: 0.2608 - accuracy: 0.9268
1389/1875 [=====================>........] - ETA: 0s - loss: 0.2602 - accuracy: 0.9270
1439/1875 [======================>.......] - ETA: 0s - loss: 0.2610 - accuracy: 0.9269
1494/1875 [======================>.......] - ETA: 0s - loss: 0.2607 - accuracy: 0.9272
1550/1875 [=======================>......] - ETA: 0s - loss: 0.2612 - accuracy: 0.9270
1604/1875 [========================>.....] - ETA: 0s - loss: 0.2608 - accuracy: 0.9270
1653/1875 [=========================>....] - ETA: 0s - loss: 0.2612 - accuracy: 0.9270
1693/1875 [==========================>...] - ETA: 0s - loss: 0.2615 - accuracy: 0.9268
1748/1875 [==========================>...] - ETA: 0s - loss: 0.2604 - accuracy: 0.9272
1804/1875 [===========================>..] - ETA: 0s - loss: 0.2606 - accuracy: 0.9270
1861/1875 [============================>.] - ETA: 0s - loss: 0.2619 - accuracy: 0.9268
1875/1875 [==============================] - 2s 943us/step - loss: 0.2619 - accuracy: 0.9267
Epoch 7/10
   1/1875 [..............................] - ETA: 0s - loss: 0.4039 - accuracy: 0.9062
  55/1875 [..............................] - ETA: 1s - loss: 0.2590 - accuracy: 0.9330
 109/1875 [>.............................] - ETA: 1s - loss: 0.2645 - accuracy: 0.9249
 166/1875 [=>............................] - ETA: 1s - loss: 0.2707 - accuracy: 0.9238
 223/1875 [==>...........................] - ETA: 1s - loss: 0.2698 - accuracy: 0.9257
 272/1875 [===>..........................] - ETA: 1s - loss: 0.2722 - accuracy: 0.9266
 324/1875 [====>.........................] - ETA: 1s - loss: 0.2661 - accuracy: 0.9283
 375/1875 [=====>........................] - ETA: 1s - loss: 0.2619 - accuracy: 0.9296
 429/1875 [=====>........................] - ETA: 1s - loss: 0.2641 - accuracy: 0.9293
 484/1875 [======>.......................] - ETA: 1s - loss: 0.2612 - accuracy: 0.9301
 526/1875 [=======>......................] - ETA: 1s - loss: 0.2595 - accuracy: 0.9304
 575/1875 [========>.....................] - ETA: 1s - loss: 0.2599 - accuracy: 0.9301
 630/1875 [=========>....................] - ETA: 1s - loss: 0.2605 - accuracy: 0.9306
 686/1875 [=========>....................] - ETA: 1s - loss: 0.2640 - accuracy: 0.9298
 738/1875 [==========>...................] - ETA: 1s - loss: 0.2640 - accuracy: 0.9302
 790/1875 [===========>..................] - ETA: 1s - loss: 0.2636 - accuracy: 0.9301
 846/1875 [============>.................] - ETA: 0s - loss: 0.2635 - accuracy: 0.9299
 903/1875 [=============>................] - ETA: 0s - loss: 0.2661 - accuracy: 0.9288
 960/1875 [==============>...............] - ETA: 0s - loss: 0.2646 - accuracy: 0.9287
1010/1875 [===============>..............] - ETA: 0s - loss: 0.2654 - accuracy: 0.9281
1064/1875 [================>.............] - ETA: 0s - loss: 0.2638 - accuracy: 0.9285
1118/1875 [================>.............] - ETA: 0s - loss: 0.2629 - accuracy: 0.9284
1172/1875 [=================>............] - ETA: 0s - loss: 0.2612 - accuracy: 0.9285
1227/1875 [==================>...........] - ETA: 0s - loss: 0.2599 - accuracy: 0.9287
1278/1875 [===================>..........] - ETA: 0s - loss: 0.2590 - accuracy: 0.9288
1333/1875 [====================>.........] - ETA: 0s - loss: 0.2595 - accuracy: 0.9286
1389/1875 [=====================>........] - ETA: 0s - loss: 0.2587 - accuracy: 0.9287
1444/1875 [======================>.......] - ETA: 0s - loss: 0.2572 - accuracy: 0.9291
1495/1875 [======================>.......] - ETA: 0s - loss: 0.2584 - accuracy: 0.9287
1544/1875 [=======================>......] - ETA: 0s - loss: 0.2582 - accuracy: 0.9285
1600/1875 [========================>.....] - ETA: 0s - loss: 0.2581 - accuracy: 0.9287
1657/1875 [=========================>....] - ETA: 0s - loss: 0.2575 - accuracy: 0.9288
1712/1875 [==========================>...] - ETA: 0s - loss: 0.2580 - accuracy: 0.9284
1769/1875 [===========================>..] - ETA: 0s - loss: 0.2579 - accuracy: 0.9285
1819/1875 [============================>.] - ETA: 0s - loss: 0.2587 - accuracy: 0.9284
1875/1875 [==============================] - 2s 936us/step - loss: 0.2579 - accuracy: 0.9286
Epoch 8/10
   1/1875 [..............................] - ETA: 0s - loss: 0.3337 - accuracy: 0.8750
  57/1875 [..............................] - ETA: 1s - loss: 0.2804 - accuracy: 0.9293
 114/1875 [>.............................] - ETA: 1s - loss: 0.2738 - accuracy: 0.9249
 170/1875 [=>............................] - ETA: 1s - loss: 0.2743 - accuracy: 0.9244
 220/1875 [==>...........................] - ETA: 1s - loss: 0.2665 - accuracy: 0.9260
 265/1875 [===>..........................] - ETA: 1s - loss: 0.2578 - accuracy: 0.9282
 319/1875 [====>.........................] - ETA: 1s - loss: 0.2532 - accuracy: 0.9302
 373/1875 [====>.........................] - ETA: 1s - loss: 0.2553 - accuracy: 0.9294
 422/1875 [=====>........................] - ETA: 1s - loss: 0.2545 - accuracy: 0.9291
 471/1875 [======>.......................] - ETA: 1s - loss: 0.2553 - accuracy: 0.9279
 519/1875 [=======>......................] - ETA: 1s - loss: 0.2552 - accuracy: 0.9278
 576/1875 [========>.....................] - ETA: 1s - loss: 0.2547 - accuracy: 0.9283
 631/1875 [=========>....................] - ETA: 1s - loss: 0.2565 - accuracy: 0.9284
 681/1875 [=========>....................] - ETA: 1s - loss: 0.2568 - accuracy: 0.9280
 734/1875 [==========>...................] - ETA: 1s - loss: 0.2571 - accuracy: 0.9282
 792/1875 [===========>..................] - ETA: 1s - loss: 0.2568 - accuracy: 0.9287
 849/1875 [============>.................] - ETA: 0s - loss: 0.2571 - accuracy: 0.9286
 906/1875 [=============>................] - ETA: 0s - loss: 0.2587 - accuracy: 0.9279
 956/1875 [==============>...............] - ETA: 0s - loss: 0.2587 - accuracy: 0.9281
1008/1875 [===============>..............] - ETA: 0s - loss: 0.2580 - accuracy: 0.9283
1060/1875 [===============>..............] - ETA: 0s - loss: 0.2572 - accuracy: 0.9287
1110/1875 [================>.............] - ETA: 0s - loss: 0.2567 - accuracy: 0.9288
1163/1875 [=================>............] - ETA: 0s - loss: 0.2556 - accuracy: 0.9291
1214/1875 [==================>...........] - ETA: 0s - loss: 0.2572 - accuracy: 0.9286
1270/1875 [===================>..........] - ETA: 0s - loss: 0.2565 - accuracy: 0.9287
1326/1875 [====================>.........] - ETA: 0s - loss: 0.2550 - accuracy: 0.9292
1383/1875 [=====================>........] - ETA: 0s - loss: 0.2541 - accuracy: 0.9293
1434/1875 [=====================>........] - ETA: 0s - loss: 0.2553 - accuracy: 0.9292
1488/1875 [======================>.......] - ETA: 0s - loss: 0.2567 - accuracy: 0.9289
1545/1875 [=======================>......] - ETA: 0s - loss: 0.2558 - accuracy: 0.9293
1601/1875 [========================>.....] - ETA: 0s - loss: 0.2549 - accuracy: 0.9296
1656/1875 [=========================>....] - ETA: 0s - loss: 0.2550 - accuracy: 0.9294
1704/1875 [==========================>...] - ETA: 0s - loss: 0.2550 - accuracy: 0.9293
1752/1875 [===========================>..] - ETA: 0s - loss: 0.2541 - accuracy: 0.9295
1806/1875 [===========================>..] - ETA: 0s - loss: 0.2547 - accuracy: 0.9293
1864/1875 [============================>.] - ETA: 0s - loss: 0.2548 - accuracy: 0.9294
1875/1875 [==============================] - 2s 940us/step - loss: 0.2549 - accuracy: 0.9293
Epoch 9/10
   1/1875 [..............................] - ETA: 0s - loss: 0.0515 - accuracy: 1.0000
  54/1875 [..............................] - ETA: 1s - loss: 0.2274 - accuracy: 0.9363
 106/1875 [>.............................] - ETA: 1s - loss: 0.2378 - accuracy: 0.9331
 160/1875 [=>............................] - ETA: 1s - loss: 0.2361 - accuracy: 0.9344
 209/1875 [==>...........................] - ETA: 1s - loss: 0.2462 - accuracy: 0.9317
 264/1875 [===>..........................] - ETA: 1s - loss: 0.2436 - accuracy: 0.9325
 316/1875 [====>.........................] - ETA: 1s - loss: 0.2475 - accuracy: 0.9312
 371/1875 [====>.........................] - ETA: 1s - loss: 0.2474 - accuracy: 0.9313
 427/1875 [=====>........................] - ETA: 1s - loss: 0.2493 - accuracy: 0.9314
 485/1875 [======>.......................] - ETA: 1s - loss: 0.2457 - accuracy: 0.9318
 542/1875 [=======>......................] - ETA: 1s - loss: 0.2480 - accuracy: 0.9321
 592/1875 [========>.....................] - ETA: 1s - loss: 0.2501 - accuracy: 0.9312
 634/1875 [=========>....................] - ETA: 1s - loss: 0.2518 - accuracy: 0.9305
 683/1875 [=========>....................] - ETA: 1s - loss: 0.2518 - accuracy: 0.9305
 738/1875 [==========>...................] - ETA: 1s - loss: 0.2527 - accuracy: 0.9305
 793/1875 [===========>..................] - ETA: 1s - loss: 0.2518 - accuracy: 0.9308
 844/1875 [============>.................] - ETA: 0s - loss: 0.2506 - accuracy: 0.9315
 899/1875 [=============>................] - ETA: 0s - loss: 0.2511 - accuracy: 0.9310
 954/1875 [==============>...............] - ETA: 0s - loss: 0.2511 - accuracy: 0.9309
1010/1875 [===============>..............] - ETA: 0s - loss: 0.2527 - accuracy: 0.9307
1068/1875 [================>.............] - ETA: 0s - loss: 0.2531 - accuracy: 0.9304
1118/1875 [================>.............] - ETA: 0s - loss: 0.2530 - accuracy: 0.9303
1173/1875 [=================>............] - ETA: 0s - loss: 0.2506 - accuracy: 0.9310
1227/1875 [==================>...........] - ETA: 0s - loss: 0.2512 - accuracy: 0.9308
1282/1875 [===================>..........] - ETA: 0s - loss: 0.2522 - accuracy: 0.9309
1336/1875 [====================>.........] - ETA: 0s - loss: 0.2535 - accuracy: 0.9304
1387/1875 [=====================>........] - ETA: 0s - loss: 0.2535 - accuracy: 0.9305
1442/1875 [======================>.......] - ETA: 0s - loss: 0.2537 - accuracy: 0.9304
1500/1875 [=======================>......] - ETA: 0s - loss: 0.2540 - accuracy: 0.9302
1556/1875 [=======================>......] - ETA: 0s - loss: 0.2538 - accuracy: 0.9301
1613/1875 [========================>.....] - ETA: 0s - loss: 0.2540 - accuracy: 0.9299
1656/1875 [=========================>....] - ETA: 0s - loss: 0.2542 - accuracy: 0.9298
1711/1875 [==========================>...] - ETA: 0s - loss: 0.2529 - accuracy: 0.9300
1767/1875 [===========================>..] - ETA: 0s - loss: 0.2522 - accuracy: 0.9301
1820/1875 [============================>.] - ETA: 0s - loss: 0.2521 - accuracy: 0.9300
1875/1875 [==============================] - 2s 933us/step - loss: 0.2529 - accuracy: 0.9297
Epoch 10/10
   1/1875 [..............................] - ETA: 0s - loss: 0.1588 - accuracy: 0.9688
  52/1875 [..............................] - ETA: 1s - loss: 0.2660 - accuracy: 0.9279
 104/1875 [>.............................] - ETA: 1s - loss: 0.2416 - accuracy: 0.9312
 159/1875 [=>............................] - ETA: 1s - loss: 0.2414 - accuracy: 0.9298
 215/1875 [==>...........................] - ETA: 1s - loss: 0.2337 - accuracy: 0.9326
 273/1875 [===>..........................] - ETA: 1s - loss: 0.2356 - accuracy: 0.9313
 324/1875 [====>.........................] - ETA: 1s - loss: 0.2386 - accuracy: 0.9310
 380/1875 [=====>........................] - ETA: 1s - loss: 0.2388 - accuracy: 0.9319
 437/1875 [=====>........................] - ETA: 1s - loss: 0.2409 - accuracy: 0.9309
 490/1875 [======>.......................] - ETA: 1s - loss: 0.2411 - accuracy: 0.9308
 545/1875 [=======>......................] - ETA: 1s - loss: 0.2430 - accuracy: 0.9306
 596/1875 [========>.....................] - ETA: 1s - loss: 0.2453 - accuracy: 0.9301
 651/1875 [=========>....................] - ETA: 1s - loss: 0.2474 - accuracy: 0.9302
 708/1875 [==========>...................] - ETA: 1s - loss: 0.2452 - accuracy: 0.9308
 765/1875 [===========>..................] - ETA: 1s - loss: 0.2439 - accuracy: 0.9314
 823/1875 [============>.................] - ETA: 0s - loss: 0.2452 - accuracy: 0.9312
 873/1875 [============>.................] - ETA: 0s - loss: 0.2455 - accuracy: 0.9311
 926/1875 [=============>................] - ETA: 0s - loss: 0.2458 - accuracy: 0.9313
 982/1875 [==============>...............] - ETA: 0s - loss: 0.2472 - accuracy: 0.9312
1039/1875 [===============>..............] - ETA: 0s - loss: 0.2480 - accuracy: 0.9312
1081/1875 [================>.............] - ETA: 0s - loss: 0.2493 - accuracy: 0.9311
1120/1875 [================>.............] - ETA: 0s - loss: 0.2497 - accuracy: 0.9307
1172/1875 [=================>............] - ETA: 0s - loss: 0.2493 - accuracy: 0.9306
1226/1875 [==================>...........] - ETA: 0s - loss: 0.2480 - accuracy: 0.9306
1282/1875 [===================>..........] - ETA: 0s - loss: 0.2471 - accuracy: 0.9305
1339/1875 [====================>.........] - ETA: 0s - loss: 0.2485 - accuracy: 0.9303
1389/1875 [=====================>........] - ETA: 0s - loss: 0.2499 - accuracy: 0.9300
1444/1875 [======================>.......] - ETA: 0s - loss: 0.2495 - accuracy: 0.9300
1501/1875 [=======================>......] - ETA: 0s - loss: 0.2498 - accuracy: 0.9298
1558/1875 [=======================>......] - ETA: 0s - loss: 0.2509 - accuracy: 0.9296
1614/1875 [========================>.....] - ETA: 0s - loss: 0.2506 - accuracy: 0.9297
1652/1875 [=========================>....] - ETA: 0s - loss: 0.2505 - accuracy: 0.9299
1702/1875 [==========================>...] - ETA: 0s - loss: 0.2509 - accuracy: 0.9298
1751/1875 [===========================>..] - ETA: 0s - loss: 0.2503 - accuracy: 0.9300
1798/1875 [===========================>..] - ETA: 0s - loss: 0.2505 - accuracy: 0.9303
1853/1875 [============================>.] - ETA: 0s - loss: 0.2505 - accuracy: 0.9302
1875/1875 [==============================] - 2s 946us/step - loss: 0.2509 - accuracy: 0.9302
  1/313 [..............................] - ETA: 0s - loss: 0.2823 - accuracy: 0.9688
 66/313 [=====>........................] - ETA: 0s - loss: 0.3314 - accuracy: 0.9044
133/313 [===========>..................] - ETA: 0s - loss: 0.3320 - accuracy: 0.9067
201/313 [==================>...........] - ETA: 0s - loss: 0.3002 - accuracy: 0.9150
266/313 [========================>.....] - ETA: 0s - loss: 0.2729 - accuracy: 0.9235
313/313 [==============================] - 0s 760us/step - loss: 0.2619 - accuracy: 0.9269

test loss 0.26187828183174133
accuracy 0.9269000291824341