TensorFlow2模型保存与加载

最新推荐文章于 2022-08-06 20:01:50 发布
最新推荐文章于 2022-08-06 20:01:50 发布
阅读量1.3k 收藏 8
点赞数 1
分类专栏： TensorFlow学习 文章标签： tensorflow 模型保存 模型加载 HDF5 checkpoint
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/Jwenxue/article/details/106863755
版权

0. 概述

TensorFlow训练的模型可以保存起来，方便自己使用或模型分享给他人。同时，如果模型训练非常耗时，则模型保存可以达到断点续训的功能。分享自己的模型可以有两种方式：一是将模型的源代码分享给他人，这时别人拿到代码后需要从头开始训练。二是将训练好的模型，即训练保存的模型（里面包含权重、超参数等）分享给他人，这里别人拿到模型就可以使用或者稍加训练即可使用。

TensorFlow中模型的保存有很多种方法。本案例使用tf.keras进行保存。

1. 导入所需的库

import tensorflow as tf
import os

for i in [tf]:
    print(i.__name__,": ",i.__version__,sep="")

输出：

tensorflow: 2.2.0

2. 导入数据集

以MNIST数据集为例进行案例分析，故导入tf.keras自带的mnist数据集

(trainImages, trainLabels),(testImages, testLabels) = tf.keras.datasets.mnist.load_data()
for i in [trainImages, trainLabels, testImages, testLabels]:
    print(i.shape)

trainImages = trainImages.reshape(-1,28*28)/255.0
testImages = testImages.reshape(-1,28*28)/255.0
for i in [trainImages, trainLabels, testImages, testLabels]:
    print(i.shape)

输出：

(60000, 28, 28)
(60000,)
(10000, 28, 28)
(10000,)
(60000, 784)
(60000,)
(10000, 784)
(10000,)

3. 模型构建

# 构建模型结构
model = tf.keras.models.Sequential([
    tf.keras.layers.Dense(512, activation="relu", input_shape=(784,)),
    tf.keras.layers.Dropout(0.2),
    tf.keras.layers.Dense(10)
])

model.summary()

输出：

Model: "sequential_3"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_6 (Dense)              (None, 512)               401920    
_________________________________________________________________
dropout_3 (Dropout)          (None, 512)               0         
_________________________________________________________________
dense_7 (Dense)              (None, 10)                5130      
=================================================================
Total params: 407,050
Trainable params: 407,050
Non-trainable params: 0
_________________________________________________________________
# 编译模型
model.compile(optimizer="adam",
             loss=tf.losses.SparseCategoricalCrossentropy(from_logits=True),
             metrics=["accuracy"])

4. 训练模型并保存

模型训练过程中保存checkpoint

checkpointPath = "training_1/cp.ckpt"
checkpointDir = os.path.dirname(checkpointPath)

cp_callback = tf.keras.callbacks.ModelCheckpoint(filepath=checkpointPath,
                                                save_weights_only=True,
                                                verbose=1)

model.fit(trainImages, trainLabels, epochs=10, 
          validation_data=(testImages, testLabels),
         callbacks=[cp_callback])

输出：

Epoch 1/10
1871/1875 [============================>.] - ETA: 0s - loss: 0.2221 - accuracy: 0.9347
Epoch 00001: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.2219 - accuracy: 0.9347 - val_loss: 0.1122 - val_accuracy: 0.9638
Epoch 2/10
1865/1875 [============================>.] - ETA: 0s - loss: 0.0947 - accuracy: 0.9702
Epoch 00002: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0947 - accuracy: 0.9702 - val_loss: 0.0743 - val_accuracy: 0.9776
Epoch 3/10
1854/1875 [============================>.] - ETA: 0s - loss: 0.0668 - accuracy: 0.9793
Epoch 00003: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0666 - accuracy: 0.9793 - val_loss: 0.0740 - val_accuracy: 0.9765
Epoch 4/10
1859/1875 [============================>.] - ETA: 0s - loss: 0.0545 - accuracy: 0.9826
Epoch 00004: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0543 - accuracy: 0.9826 - val_loss: 0.0665 - val_accuracy: 0.9808
Epoch 5/10
1869/1875 [============================>.] - ETA: 0s - loss: 0.0435 - accuracy: 0.9864
Epoch 00005: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0435 - accuracy: 0.9864 - val_loss: 0.0603 - val_accuracy: 0.9835
Epoch 6/10
1866/1875 [============================>.] - ETA: 0s - loss: 0.0365 - accuracy: 0.9880
Epoch 00006: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0365 - accuracy: 0.9880 - val_loss: 0.0598 - val_accuracy: 0.9822
Epoch 7/10
1870/1875 [============================>.] - ETA: 0s - loss: 0.0318 - accuracy: 0.9894
Epoch 00007: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 6s 3ms/step - loss: 0.0318 - accuracy: 0.9894 - val_loss: 0.0630 - val_accuracy: 0.9813
Epoch 8/10
1874/1875 [============================>.] - ETA: 0s - loss: 0.0278 - accuracy: 0.9908
Epoch 00008: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0278 - accuracy: 0.9908 - val_loss: 0.0700 - val_accuracy: 0.9821
Epoch 9/10
1860/1875 [============================>.] - ETA: 0s - loss: 0.0229 - accuracy: 0.9924
Epoch 00009: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0227 - accuracy: 0.9925 - val_loss: 0.0824 - val_accuracy: 0.9798
Epoch 10/10
1875/1875 [==============================] - ETA: 0s - loss: 0.0224 - accuracy: 0.9925
Epoch 00010: saving model to training_1/cp.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0224 - accuracy: 0.9925 - val_loss: 0.0665 - val_accuracy: 0.9824
Out[17]:
<tensorflow.python.keras.callbacks.History at 0x1ffa26a0>
ls{checkpointDir}

输出：

2020-06-19  16:20                71 checkpoint
2020-06-19  16:20         4,886,685 cp.ckpt.data-00000-of-00001
2020-06-19  16:20             1,222 cp.ckpt.index

5. 创建新模型并加载保存的权重参数

5.1 创建新模型

如果想要恢复、加载保存的权重参数，则需要创建一个一模一样的模型。

new_model = tf.keras.models.Sequential([
    tf.keras.layers.Dense(512, activation="relu", input_shape=(784,)),
    tf.keras.layers.Dropout(0.2),
    tf.keras.layers.Dense(10)
])

new_model.summary()

# 编译模型
new_model.compile(optimizer="adam",
             loss=tf.losses.SparseCategoricalCrossentropy(from_logits=True),
             metrics=["accuracy"])

输出：

Model: "sequential_6"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_12 (Dense)             (None, 512)               401920    
_________________________________________________________________
dropout_6 (Dropout)          (None, 512)               0         
_________________________________________________________________
dense_13 (Dense)             (None, 10)                5130      
=================================================================
Total params: 407,050
Trainable params: 407,050
Non-trainable params: 0
_________________________________________________________________

5.2 新模型评估

loss, acc = new_model.evaluate(testImages, testLabels, verbose=2)
print("未训练新模型精度：{:5.2f}%".format(100*acc))

输出：

313/313 - 0s - loss: 2.3328 - accuracy: 0.0862
未训练新模型精度： 8.62%

如上输出所示，新模型的权重参数是随机生成的，所以准确率只有8.62%。对于一个10分类的任务，随机猜中一类的概率也就十分之一，即10%。

5.3 加载保存的权重参数

new_model.load_weights(checkpointPath)

loss, acc = new_model.evaluate(testImages, testLabels, verbose=2)
print("未训练新模型精度：{:5.2f}%".format(100*acc))

输出：

313/313 - 0s - loss: 0.0665 - accuracy: 0.9824
未训练新模型精度：98.24%

加载保存的权重参数后再次评估，发现准确率达到98.24%。

6. 模型权重参数保存选项

checkpointPath = "training_2/cp-{epoch:04d}.ckpt"
checkpointDir = os.path.dirname(checkpointPath)

# 创建callback，每训练5轮保存一次模型权重参数
cp_callback = tf.keras.callbacks.ModelCheckpoint(filepath=checkpointPath,
                                                verbose=1,
                                                save_weights_only=True,
                                                period=5)

# 创建模型
new_model = tf.keras.models.Sequential([
    tf.keras.layers.Dense(512, activation="relu", input_shape=(784,)),
    tf.keras.layers.Dropout(0.2),
    tf.keras.layers.Dense(10)
])

new_model.summary()

# 编译模型
new_model.compile(optimizer="adam",
             loss=tf.losses.SparseCategoricalCrossentropy(from_logits=True),
             metrics=["accuracy"])

# 训练并保存模型
new_model.save_weights(checkpointPath.format(epoch=0))
new_model.fit(trainImages, trainLabels,epochs=50,callbacks=[cp_callback],
             validation_data=(testImages, testLabels),
             verbose=1)

输出：

Model: "sequential_8"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_16 (Dense)             (None, 512)               401920    
_________________________________________________________________
dropout_8 (Dropout)          (None, 512)               0         
_________________________________________________________________
dense_17 (Dense)             (None, 10)                5130      
=================================================================
Total params: 407,050
Trainable params: 407,050
Non-trainable params: 0
_________________________________________________________________
Epoch 1/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.2222 - accuracy: 0.9338 - val_loss: 0.1010 - val_accuracy: 0.9687
Epoch 2/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0982 - accuracy: 0.9698 - val_loss: 0.0802 - val_accuracy: 0.9750
Epoch 3/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0700 - accuracy: 0.9781 - val_loss: 0.0696 - val_accuracy: 0.9800
Epoch 4/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0533 - accuracy: 0.9826 - val_loss: 0.0741 - val_accuracy: 0.9780
Epoch 5/50
1862/1875 [============================>.] - ETA: 0s - loss: 0.0454 - accuracy: 0.9849
Epoch 00005: saving model to training_2/cp-0005.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0454 - accuracy: 0.9850 - val_loss: 0.0701 - val_accuracy: 0.9786
Epoch 6/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0377 - accuracy: 0.9879 - val_loss: 0.0629 - val_accuracy: 0.9805
Epoch 7/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0309 - accuracy: 0.9893 - val_loss: 0.0701 - val_accuracy: 0.9808
Epoch 8/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0273 - accuracy: 0.9908 - val_loss: 0.0659 - val_accuracy: 0.9808
Epoch 9/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0254 - accuracy: 0.9914 - val_loss: 0.0736 - val_accuracy: 0.9800
Epoch 10/50
1864/1875 [============================>.] - ETA: 0s - loss: 0.0244 - accuracy: 0.9916
Epoch 00010: saving model to training_2/cp-0010.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0243 - accuracy: 0.9916 - val_loss: 0.0710 - val_accuracy: 0.9818
Epoch 11/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0193 - accuracy: 0.9934 - val_loss: 0.0785 - val_accuracy: 0.9812
Epoch 12/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0187 - accuracy: 0.9933 - val_loss: 0.0884 - val_accuracy: 0.9779
Epoch 13/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0199 - accuracy: 0.9934 - val_loss: 0.0668 - val_accuracy: 0.9833
Epoch 14/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0148 - accuracy: 0.9951 - val_loss: 0.0878 - val_accuracy: 0.9812
Epoch 15/50
1860/1875 [============================>.] - ETA: 0s - loss: 0.0159 - accuracy: 0.9947
Epoch 00015: saving model to training_2/cp-0015.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0159 - accuracy: 0.9947 - val_loss: 0.0875 - val_accuracy: 0.9820
Epoch 16/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0143 - accuracy: 0.9952 - val_loss: 0.0884 - val_accuracy: 0.9812
Epoch 17/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0169 - accuracy: 0.9948 - val_loss: 0.0834 - val_accuracy: 0.9830
Epoch 18/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0133 - accuracy: 0.9956 - val_loss: 0.0943 - val_accuracy: 0.9809
Epoch 19/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0142 - accuracy: 0.9951 - val_loss: 0.0905 - val_accuracy: 0.9827
Epoch 20/50
1867/1875 [============================>.] - ETA: 0s - loss: 0.0137 - accuracy: 0.9957
Epoch 00020: saving model to training_2/cp-0020.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0137 - accuracy: 0.9958 - val_loss: 0.0849 - val_accuracy: 0.9844
Epoch 21/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0121 - accuracy: 0.9957 - val_loss: 0.0989 - val_accuracy: 0.9823
Epoch 22/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0134 - accuracy: 0.9958 - val_loss: 0.0869 - val_accuracy: 0.9831
Epoch 23/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0132 - accuracy: 0.9959 - val_loss: 0.0996 - val_accuracy: 0.9822
Epoch 24/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0107 - accuracy: 0.9967 - val_loss: 0.1022 - val_accuracy: 0.9844
Epoch 25/50
1874/1875 [============================>.] - ETA: 0s - loss: 0.0133 - accuracy: 0.9958
Epoch 00025: saving model to training_2/cp-0025.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0133 - accuracy: 0.9958 - val_loss: 0.1029 - val_accuracy: 0.9825
Epoch 26/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0112 - accuracy: 0.9962 - val_loss: 0.1101 - val_accuracy: 0.9824
Epoch 27/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0111 - accuracy: 0.9965 - val_loss: 0.1029 - val_accuracy: 0.9826
Epoch 28/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0105 - accuracy: 0.9965 - val_loss: 0.0998 - val_accuracy: 0.9839
Epoch 29/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0104 - accuracy: 0.9965 - val_loss: 0.1135 - val_accuracy: 0.9827
Epoch 30/50
1866/1875 [============================>.] - ETA: 0s - loss: 0.0103 - accuracy: 0.9969
Epoch 00030: saving model to training_2/cp-0030.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0103 - accuracy: 0.9969 - val_loss: 0.1044 - val_accuracy: 0.9845
Epoch 31/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0114 - accuracy: 0.9968 - val_loss: 0.1160 - val_accuracy: 0.9825
Epoch 32/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0105 - accuracy: 0.9969 - val_loss: 0.1220 - val_accuracy: 0.9827
Epoch 33/50
1875/1875 [==============================] - 4s 2ms/step - loss: 0.0099 - accuracy: 0.9969 - val_loss: 0.1256 - val_accuracy: 0.9823
Epoch 34/50
1875/1875 [==============================] - 4s 2ms/step - loss: 0.0101 - accuracy: 0.9969 - val_loss: 0.1270 - val_accuracy: 0.9819
Epoch 35/50
1857/1875 [============================>.] - ETA: 0s - loss: 0.0114 - accuracy: 0.9970
Epoch 00035: saving model to training_2/cp-0035.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0113 - accuracy: 0.9970 - val_loss: 0.1189 - val_accuracy: 0.9835
Epoch 36/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0091 - accuracy: 0.9974 - val_loss: 0.1168 - val_accuracy: 0.9827
Epoch 37/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0106 - accuracy: 0.9970 - val_loss: 0.1390 - val_accuracy: 0.9823
Epoch 38/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0096 - accuracy: 0.9970 - val_loss: 0.1324 - val_accuracy: 0.9841
Epoch 39/50
1875/1875 [==============================] - 5s 2ms/step - loss: 0.0088 - accuracy: 0.9975 - val_loss: 0.1402 - val_accuracy: 0.9826
Epoch 40/50
1873/1875 [============================>.] - ETA: 0s - loss: 0.0124 - accuracy: 0.9966
Epoch 00040: saving model to training_2/cp-0040.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0124 - accuracy: 0.9966 - val_loss: 0.1290 - val_accuracy: 0.9843
Epoch 41/50
1875/1875 [==============================] - 4s 2ms/step - loss: 0.0096 - accuracy: 0.9974 - val_loss: 0.1353 - val_accuracy: 0.9829
Epoch 42/50
1875/1875 [==============================] - 4s 2ms/step - loss: 0.0080 - accuracy: 0.9976 - val_loss: 0.1411 - val_accuracy: 0.9833
Epoch 43/50
1875/1875 [==============================] - 4s 2ms/step - loss: 0.0096 - accuracy: 0.9972 - val_loss: 0.1459 - val_accuracy: 0.9839
Epoch 44/50
1875/1875 [==============================] - 4s 2ms/step - loss: 0.0105 - accuracy: 0.9972 - val_loss: 0.1257 - val_accuracy: 0.9842
Epoch 45/50
1865/1875 [============================>.] - ETA: 0s - loss: 0.0104 - accuracy: 0.9971
Epoch 00045: saving model to training_2/cp-0045.ckpt
1875/1875 [==============================] - 5s 2ms/step - loss: 0.0103 - accuracy: 0.9971 - val_loss: 0.1407 - val_accuracy: 0.9832
Epoch 46/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0098 - accuracy: 0.9974 - val_loss: 0.1356 - val_accuracy: 0.9841
Epoch 47/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0079 - accuracy: 0.9979 - val_loss: 0.1445 - val_accuracy: 0.9837
Epoch 48/50
1875/1875 [==============================] - 5s 2ms/step - loss: 0.0097 - accuracy: 0.9974 - val_loss: 0.1407 - val_accuracy: 0.9831
Epoch 49/50
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0107 - accuracy: 0.9972 - val_loss: 0.1434 - val_accuracy: 0.9832
Epoch 50/50
1867/1875 [============================>.] - ETA: 0s - loss: 0.0082 - accuracy: 0.9978
Epoch 00050: saving model to training_2/cp-0050.ckpt
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0082 - accuracy: 0.9979 - val_loss: 0.1601 - val_accuracy: 0.9833
Out[31]:
<tensorflow.python.keras.callbacks.History at 0x2034e748>
ls{checkpointDir}

输出：

2020-06-19  16:46                81 checkpoint
2020-06-19  16:42         1,628,730 cp-0000.ckpt.data-00000-of-00001
2020-06-19  16:42               402 cp-0000.ckpt.index
2020-06-19  16:43         4,886,697 cp-0005.ckpt.data-00000-of-00001
2020-06-19  16:43             1,222 cp-0005.ckpt.index
2020-06-19  16:43         4,886,697 cp-0010.ckpt.data-00000-of-00001
2020-06-19  16:43             1,222 cp-0010.ckpt.index
2020-06-19  16:44         4,886,697 cp-0015.ckpt.data-00000-of-00001
2020-06-19  16:44             1,222 cp-0015.ckpt.index
2020-06-19  16:44         4,886,697 cp-0020.ckpt.data-00000-of-00001
2020-06-19  16:44             1,222 cp-0020.ckpt.index
2020-06-19  16:45         4,886,697 cp-0025.ckpt.data-00000-of-00001
2020-06-19  16:45             1,222 cp-0025.ckpt.index
2020-06-19  16:45         4,886,697 cp-0030.ckpt.data-00000-of-00001
2020-06-19  16:45             1,222 cp-0030.ckpt.index
2020-06-19  16:45         4,886,697 cp-0035.ckpt.data-00000-of-00001
2020-06-19  16:45             1,222 cp-0035.ckpt.index
2020-06-19  16:46         4,886,697 cp-0040.ckpt.data-00000-of-00001
2020-06-19  16:46             1,222 cp-0040.ckpt.index
2020-06-19  16:46         4,886,697 cp-0045.ckpt.data-00000-of-00001
2020-06-19  16:46             1,222 cp-0045.ckpt.index
2020-06-19  16:46         4,886,697 cp-0050.ckpt.data-00000-of-00001
2020-06-19  16:46             1,222 cp-0050.ckpt.index
latest = tf.train.latest_checkpoint(checkpoint_dir=checkpointDir)
latest

输出：

'training_2\\cp-0050.ckpt'

注意：TensorFlow默认只保存5条最近的checkpoint，如果超过5条会被覆盖。

上述保存的是checkpoint格式的二进制文件，里面仅包含训练的权重参数。

7. 保存整个模型

调用model.save()函数就可以将模型架构、权重参数以及训练配置等信息保存到单个文件中。这时保存的模型就不需要源代码或创建新的模型加载它，而可以直接加载整个模型，包括在同一平台或其它平台，例如在windows上训练保存的模型可以在安卓系统上加载。

保存整个模型有两种格式：一是SavedModel格式，另一种是HDF5格式。SavedModel是TensorFlow2中默认的格式

7.1 SavedModel格式

# 创建模型
model = tf.keras.models.Sequential([
    tf.keras.layers.Dense(512, activation="relu", input_shape=(784,)),
    tf.keras.layers.Dropout(0.2),
    tf.keras.layers.Dense(10)
])

model.summary()

# 编译模型
model.compile(optimizer="adam",
             loss=tf.losses.SparseCategoricalCrossentropy(from_logits=True),
             metrics=["accuracy"])

# 训练模型
model.fit(trainImages, trainLabels, epochs=5)
!mkdir -p saved_model
model.save("saved_model/my_model")

输出：

Model: "sequential_9"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_18 (Dense)             (None, 512)               401920    
_________________________________________________________________
dropout_9 (Dropout)          (None, 512)               0         
_________________________________________________________________
dense_19 (Dense)             (None, 10)                5130      
=================================================================
Total params: 407,050
Trainable params: 407,050
Non-trainable params: 0
_________________________________________________________________
Epoch 1/5
1875/1875 [==============================] - 5s 2ms/step - loss: 0.2163 - accuracy: 0.9355
Epoch 2/5
1875/1875 [==============================] - 5s 2ms/step - loss: 0.0975 - accuracy: 0.9703
Epoch 3/5
1875/1875 [==============================] - 4s 2ms/step - loss: 0.0687 - accuracy: 0.9788
Epoch 4/5
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0537 - accuracy: 0.9824
Epoch 5/5
1875/1875 [==============================] - 5s 2ms/step - loss: 0.0424 - accuracy: 0.9867

INFO:tensorflow:Assets written to: saved_model/my_model\assets
ls{"saved_model"}

输出：

2020-06-19  17:48    <DIR>          assets
2020-06-19  17:48            80,844 saved_model.pb
2020-06-19  17:48    <DIR>          variables
# 加载保存的模型
new_model = tf.keras.models.load_model("saved_model\my_model")
new_model.summary()

输出：

Model: "sequential_9"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_18 (Dense)             (None, 512)               401920    
_________________________________________________________________
dropout_9 (Dropout)          (None, 512)               0         
_________________________________________________________________
dense_19 (Dense)             (None, 10)                5130      
=================================================================
Total params: 407,050
Trainable params: 407,050
Non-trainable params: 0
_________________________________________________________________
# 评估加载的模型
loss, acc = new_model.evaluate(testImages,testLabels, verbose=2)
print('Restored model, accuracy: {:5.2f}%'.format(100*acc))

print(new_model.predict(testImages).shape)

输出：

313/313 - 0s - loss: 0.0782 - accuracy: 0.9780
Restored model, accuracy: 97.80%
(10000, 10)

7.2 HDF5格式

# 创建模型
model = tf.keras.models.Sequential([
    tf.keras.layers.Dense(512, activation="relu", input_shape=(784,)),
    tf.keras.layers.Dropout(0.2),
    tf.keras.layers.Dense(10)
])

model.summary()

# 编译模型
model.compile(optimizer="adam",
             loss=tf.losses.SparseCategoricalCrossentropy(from_logits=True),
             metrics=["accuracy"])

# 训练模型
model.fit(trainImages, trainLabels, epochs=5)

# 保存HDF5格式的模型
model.save("my_model.h5")

输出：

Model: "sequential_10"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_20 (Dense)             (None, 512)               401920    
_________________________________________________________________
dropout_10 (Dropout)         (None, 512)               0         
_________________________________________________________________
dense_21 (Dense)             (None, 10)                5130      
=================================================================
Total params: 407,050
Trainable params: 407,050
Non-trainable params: 0
_________________________________________________________________
Epoch 1/5
1875/1875 [==============================] - 5s 2ms/step - loss: 0.2164 - accuracy: 0.9366
Epoch 2/5
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0980 - accuracy: 0.9697
Epoch 3/5
1875/1875 [==============================] - 5s 3ms/step - loss: 0.0709 - accuracy: 0.9775
Epoch 4/5
1875/1875 [==============================] - 5s 2ms/step - loss: 0.0540 - accuracy: 0.9827
Epoch 5/5
1875/1875 [==============================] - 5s 2ms/step - loss: 0.0422 - accuracy: 0.9862
# 加载保存的HDF5格式的模型
new_model = tf.keras.models.load_model('my_model.h5')
new_model.summary()

输出：

Model: "sequential_10"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_20 (Dense)             (None, 512)               401920    
_________________________________________________________________
dropout_10 (Dropout)         (None, 512)               0         
_________________________________________________________________
dense_21 (Dense)             (None, 10)                5130      
=================================================================
Total params: 407,050
Trainable params: 407,050
Non-trainable params: 0
_________________________________________________________________
# 评估模型
loss, acc = new_model.evaluate(testImages, testLabels, verbose=2)
print('Restored model, accuracy: {:5.2f}%'.format(100*acc))

输出：

313/313 - 0s - loss: 0.0671 - accuracy: 0.9791
Restored model, accuracy: 97.91%

Keras保存模型的内容：

  • 权重参数
  • 模型架构
  • 训练配置（即模型编译时传入的参数）
  • 优化器及优化的位置

 

 

 

bigcindy
关注
  • 1
    点赞
  • 踩
  • 8
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
tensorflow如何继续训练之前保存的模型实例
09-18
今天小编就为大家分享一篇tensorflow如何继续训练之前保存的模型实例，具有很好的参考价值，希望对大家有所帮助。一起跟随小编过来看看吧
浅谈Tensorflow模型的保存与恢复加载
12-24
我们使用TensorFlow进行模型的训练，训练好的模型需要保存，预测阶段我们需要将模型进行加载还原使用，这就涉及TensorFlow模型的保存与恢复加载。 总结一下Tensorflow常用的模型保存方式。 保存checkpoint模型文件...
tf.saved_model
Himmelhoch的博客
01-25 268
Protocol Buffer是什么？ 是由谷歌推出的，跨语言跨平台的序列化结构数据的可扩展机制。比XML更节约内存，更快，更简单。 SavedModel 格式是什么？ SavedModel包含一个完整的Tensorflow程序，不仅包含权重值，还包含计算。 它不需要原始模型构建代码就可以运行，因此对共享和部署（使用TFLite、TensorFlow.js、TensorFlow Serving或TensorFlow Hub）非常有用。 【备注】 TFLite：在终端（如手机）部署模型，用于推理。
tensorflow 保存训练模型ckpt 查看ckpt文件中的变量名和对应值
weixin_34405332的博客
11-01 2268
  TensorFlow 模型保存与恢复   一个快速完整的教程，以保存和恢复Tensorflow模型。 在本教程中，我将会解释： TensorFlow模型是什么样的？ 如何保存TensorFlow模型？ 如何恢复预测/转移学习的TensorFlow模型？ 如何使用导入的预先训练的模型进行微调和修改? 这个教程假设你已经对神经网络有了一定的了解。如果不了解的话请查阅相关资料。 1. 什么是Te...
tensorflow2 保存模型
qq_41567413的博客
07-22 647
tensorflow2 模型保存model.save('mnist_model')，参数保存 model.save_weights('weights')
深度学习 走进tensorflow2.0】tensorflow2.0 保存和加载模型
赖德发的博客
11-10 2616
tensorflow2.0 保存模型方式主要有4种，下面一一介绍下。 1、保存全模型，权重和模型框架一起保存H5格式 model.save('the_save_model.h5') new_model = keras.models.load_model('the_save_model.h5') 2、将模型保存为SavedModel格式，python，java 均可调用 keras.experimental.export_saved_model(model, 'saved_model') new_model
解决tensorflow模型参数保存和加载的问题
09-20
今天小编就为大家分享一篇解决tensorflow模型参数保存和加载的问题，具有很好的参考价值，希望对大家有所帮助。一起跟随小编过来看看吧
tensorflow模型保存、加载之变量重命名实例
09-18
通过`sess.run(tf.global_variables_initializer())`初始化所有变量后，使用`saver.save(sess, "checkpoints/variable.ckpt")`将模型保存到"checkpoints"目录下的"variable.ckpt"文件中。 接下来是模型的加载，通常...
TensorFlow模型保存和提取的方法
09-20
以下是对TensorFlow模型保存和提取的详细解释： 首先，TensorFlow提供了`tf.train.Saver`类来实现模型的保存和恢复。在保存模型时，我们创建一个`Saver`对象，并调用其`save`方法，如`saver.save(sess,"Model/model...
TensorFlow2.0保存模型
hallobike的博客
01-09 980
介绍 模型保存有5种：1、整体保存；2、网络架构保存；3、权重保存；4、回调保存；5、自定义训练模型的保存 1、整体保存：权重值，模型配置（架构），优化器配置 整个模型可以保存到一个文件中，其中包含权重值、模型配置乃至优化器配置。这样，您就可以为模型设置检查点，并稍后从完全相同的状态继续训练，而无需访问原始代码。 在Keras中保存完全可以正常使用的额模型非常有用，您可以在TensorFlow.js中加载它们，然后在网络浏览器中训练和运行它们。 Keras使用HDF5标准提供基本的保存格式。
深度学习：TensorFlow2构建、保存、加载神经网络模型【经典流程】
u013250861的博客
01-12 2005
# 一、network.save_weights、network.load_weights 保存模型的参数，加载已保存的参数的network的结构必须和之前的network的所有结构一模一样
tensorflow数据结构-AssetFileDef
写了 = 会了.gif
11-08 495
AssetFileDef 单个文件或具有相同名称的一组分片文件的资源文件def。 这个应该就是保存权重的.data文件，根据AssetFileDef属性在.data中寻找对应的权重参数。 message AssetFileDef { //将资源文件名绑定到的张量。 TensorInfo tensor_info = 1; //资产目录中的文件名。 注意：不包括路径前缀，即目录。 //...
tensorflow 保存和恢复模型
消极的人永远是对的，积极的人选择勇往直前
03-03 507
模型可以在训练期间和训练完成后进行保存。这意味着模型可以从任意中断中恢复，并避免耗费比较长的时间在训练上。保存也意味着您可以共享模型，而其他人可以通过您的模型来重新创建工作。 在发布研究模型和技术时，大多数机器学习从业者分享： 用于创建模型的代码 模型训练的权重 (weight) 和参数 (parameters) 。 共享数据有助于其他人了解模型的工作原理，并使用新数据自行尝试。 注意：小心不受信任的代码——Tensorflow 模型是代码。有关详细信息，请参阅https://github.com.
Tensorflow训练的模型，如何保存与载入？
GeekZW的博客
05-15 9005
Tensorflow训练的模型，如何保存与载入？目的：学习tensorflow框架的DNN，掌握如何将tensorflow训练得到的模型保存并载入，做预测？内容：1、tensorflow模型保存与载入的两种方法2、实例分析1——线性回归3、实例分析2——mnist分类一、tensorflow模型保存与载入的两种方法参考网址：https://blog.csdn.net/thriving_fcl/ar...
tensorflow保存/加载模型，以及保存再训练模型
安之ccy的博客
12-02 947
1.前期定义输入x，输出y，以及dropout_rate参数时要注意命名，在之前的博客中有提到过 inputs = tf.placeholder(tf.float32, [batch_size, img_high, img_width, Channel], name='inputs') y = tf.placeholder(dtype=tf.float32, shape=[batch_size, ...
tensorflow模型的保存与恢复(saver)
zehuawong的博客
03-04 285
参考 https://www.cnblogs.com/denny402/p/6940134.html 将训练好的模型参数保存起来，以便以后进行验证或测试，这是我们经常要做的事情。tf里面提供模型保存的是tf.train.Saver()模块。 模型保存，先要创建一个Saver对象：如 saver=tf.train.Saver() 在创建这个Saver对象的时候，有一个参数我们经常会用到，就是 max...
TensorFlow2利用Fashion_mnist数据集实现神经网络图像分类任务
bigcindy的博客
06-18 2096
1. 导入所需的库 import tensorflow as tf import numpy as np import matplotlib.pyplot as plt for i in [tf, np]: print(i.__name__,": ",i.__version__,sep="") 输出： tensorflow: 2.2.0 numpy: 1.17.4 2. 导入Fashion_MNIST数据集 fashion_mnist = tf.keras.datasets.fas
好好学习第二天：服装图像分类
liuyingshudian的博客
08-06 240
图像分类
【TensorFlow2.x开发—基础】 模型保存、加载、使用
黎国溥
04-27 3776
本文主要介绍在TensorFlow2 中使用Keras API保存整个模型，以及如果使用保存好的模型。保存整个模型时，有两种格式可以实现，分别是SaveModel和HDF5；在TF2.x中模型使用SavedModel格式。 文章分为简约版、实践版、代码版，首先从简约版认识基本流程、概率、命令等；再到实践版查看每一步的代码调试结果；最后通过代码版，可以自己尝试实践。
tensorflow2模型保存导入
最新发布
05-10
在 TensorFlow 2 中，保存和导入模型可以使用 `tf.keras` 模块的 API。以下是一个简单的示例： 1. 保存模型 ```python import tensorflow as tf # 定义模型 model = tf.keras.Sequential([ tf.keras.layers....
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值