Tensorflow2（4）

自制数据集

观察数据集结构，给x_train,y_train,x_test,y_test赋值

数据增强

image_gen_train=tf.keras.preprocessing.image.ImageDataGenerator（
rescale=所有数据将乘以该数值
rotation_range=随机旋转角度数范围
width_shift_range=随机宽度偏移量
height_shift_range=随机高度偏移量
horizontal_flip=是否随机水平翻转
zoom_range=随机缩放的范围[1-n,1+n]）
image_gen_train.fit(x_train)

断点续训

当在训练过程中由于一些原因无法训练时，需要保存当前的训练结果下次接着训练
读取模型：load_weights(路径文件名)
保存模型：
tf.keras.callbacks.ModelCheckpoint(
filepath=路径文件名，
save_weights_only=True/False,
save_best_only=True/False)
history=model.fit(callbacks=[cp_callback])#cp_callback在上面已定义

参数提取

model.trainable_variables返回模型中可训练参数
设置print输出格式
np.set_printoptions(threshold=超过多少省略显示)(np.inf（不使用省略号）)

acc&loss可视化

history=model.fit(训练集数据，训练集标签，batch_size=,epochs=,validation_split=用作测试数据的比例，validation_data=测试集，validation_freq=测试频率)
history:
训练集loss：loss
测试集loss：val_loss
训练集准确率：spaese_categorical_accuracy
测试集准确率：val_sparse_categorical_accuracy

import tensorflow as tf
import os
import numpy as np
from matplotlib import pyplot as plt

np.set_printoptions(threshold=np.inf)

fashion = tf.keras.datasets.fashion_mnist
(x_train, y_train), (x_test, y_test) = fashion.load_data()
x_train, x_test = x_train / 255.0, x_test / 255.0

model = tf.keras.models.Sequential([
    tf.keras.layers.Flatten(),
    tf.keras.layers.Dense(128, activation='relu'),
    tf.keras.layers.Dense(10, activation='softmax')
])

model.compile(optimizer='adam',
              loss=tf.keras.losses.SparseCategoricalCrossentropy(from_logits=False),
              metrics=['sparse_categorical_accuracy'])

checkpoint_save_path = "./checkpoint/fashion.ckpt"
if os.path.exists(checkpoint_save_path + '.index'):
    print('-------------load the model-----------------')
    model.load_weights(checkpoint_save_path)

cp_callback = tf.keras.callbacks.ModelCheckpoint(filepath=checkpoint_save_path,
                                                 save_weights_only=True,
                                                 save_best_only=True)

history = model.fit(x_train, y_train, batch_size=32, epochs=5, validation_data=(x_test, y_test), validation_freq=1,
                    callbacks=[cp_callback])
model.summary()

print(model.trainable_variables)
file = open('./weights.txt', 'w')
for v in model.trainable_variables:
    file.write(str(v.name) + '\n')
    file.write(str(v.shape) + '\n')
    file.write(str(v.numpy()) + '\n')
file.close()

###############################################    show   ###############################################

# 显示训练集和验证集的acc和loss曲线
acc = history.history['sparse_categorical_accuracy']
val_acc = history.history['val_sparse_categorical_accuracy']
loss = history.history['loss']
val_loss = history.history['val_loss']

plt.subplot(1, 2, 1)
plt.plot(acc, label='Training Accuracy')
plt.plot(val_acc, label='Validation Accuracy')
plt.title('Training and Validation Accuracy')
plt.legend()

plt.subplot(1, 2, 2)
plt.plot(loss, label='Training Loss')
plt.plot(val_loss, label='Validation Loss')
plt.title('Training and Validation Loss')
plt.legend()
plt.show()

给图识物（预测模块）

predict（输入特征，batch_size=整数）

model = tf.keras.models.Sequential([
    tf.keras.layers.Flatten(),
    tf.keras.layers.Dense(128, activation='relu'),
    tf.keras.layers.Dense(10, activation='softmax')
])
                                        
model.load_weights(model_save_path)
result=model.predict(x_predict)