今天在写deep learning作业(Name Entity Recognition),训练模型时遇到了调参问题:
首先设置 _epochs=10, batch_size=64, learning_rate=0.0001;
发现模型loss一直下降,不确定模型是否欠拟合,考虑增加epoch或增加learning rate
调整参数为 _epochs=10, batch_size=64, learning_rate=0.0005(将learning rate增加至0.0005);
epoch=6时训练完成(epoch>6后 validation loss一直增加,training loss减少,模型过拟合):
试着减少batch size,n_epochs=10, batch_size=32, learning_rate=0.0005;
此时training loss偏高,