【PyTorch】基于 LSTM 的手写数字识别（MNIST）

于 2022-01-29 17:03:40 发布
阅读量2.7k 收藏 14
点赞数 1
分类专栏： pytorch 文章标签： lstm pytorch 深度学习 mnist
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_42951560/article/details/122745201
版权

引言

基于 PyTorch 实现的 LSTM 模型在 MNIST 数据集上的手写数字识别。

用法

代码托管于 GitHub：https://github.com/XavierJiezou/pytorch-lstm-mnist

git clone https://github.com/XavierJiezou/pytorch-lstm-mnist.git
cd pytorch-lstm-mnist
pip install -r requirements.txt
python ./code/train_on_mnist.py

注意：在训练之前你需要先解压 mnist.7z 文件。

配置

你也可以修改配置文件。

data:
  data_root: ./data/mnist # Path to data
  train_ratio: 0.8 # Ratio of training set
  val_ratio: 0.1 # Ratio of validation set
  batch_size: 64 # How many samples per batch to load
  visualize_data_save: ./image/training_data_mnist.png

model:
  input_size: 28 # Number of expected features in the input
  hidden_size: 64 # Number of features in the hidden state
  num_layers: 1 # Number of recurrent layers
  output_size: 10 # Number of expected features in the output

train:
  num_epochs: 100 # How many epochs to use for data training
  sequence_length: 28 # Length of the input sequence
  learning_rate: 0.001 # Learning_rate
  device: cuda:0 # On which a `torch.Tensor` is or will be allocated
  save_path: ./checkpoint/mnist.pth # Path to save the trained model

log:
  sink: ./log/mnist.log # Path to save the logging file
  level: INFO # Logging level: DEBUG | INFO | WARNING | ERROR | SUCCESS | CRITICAL
  format: '{message}' # logging output format. Example: '{time:YYYY-MM-DD at HH:mm:ss} {level} {message}'
  visualize_log_save: ./image/training_log_mnist.png # Path to save the visualization result

数据

MNIST: http://yann.lecun.com/exdb/mnist/

mnist

结果

数据集序列长度输入维度准确率
MNIST28280.9892

result

EPOCH: 001/100 LR: 0.0010 TRAIN-LOSS: 0.6444 TRAIN-ACC: 0.7916  VAL-LOSS: 0.2733 VAL-ACC: 0.9208  EPOCH-TIME: 0m10s
EPOCH: 002/100 LR: 0.0010 TRAIN-LOSS: 0.1911 TRAIN-ACC: 0.9446  VAL-LOSS: 0.1564 VAL-ACC: 0.9533  EPOCH-TIME: 0m10s
EPOCH: 003/100 LR: 0.0010 TRAIN-LOSS: 0.1317 TRAIN-ACC: 0.9617  VAL-LOSS: 0.1323 VAL-ACC: 0.9621  EPOCH-TIME: 0m9s
EPOCH: 004/100 LR: 0.0010 TRAIN-LOSS: 0.1077 TRAIN-ACC: 0.9686  VAL-LOSS: 0.1204 VAL-ACC: 0.9643  EPOCH-TIME: 0m9s
EPOCH: 005/100 LR: 0.0010 TRAIN-LOSS: 0.0894 TRAIN-ACC: 0.9735  VAL-LOSS: 0.1078 VAL-ACC: 0.9690  EPOCH-TIME: 0m9s
EPOCH: 006/100 LR: 0.0010 TRAIN-LOSS: 0.0776 TRAIN-ACC: 0.9775  VAL-LOSS: 0.0802 VAL-ACC: 0.9756  EPOCH-TIME: 0m9s
EPOCH: 007/100 LR: 0.0010 TRAIN-LOSS: 0.0695 TRAIN-ACC: 0.9794  VAL-LOSS: 0.0675 VAL-ACC: 0.9791  EPOCH-TIME: 0m9s
EPOCH: 008/100 LR: 0.0010 TRAIN-LOSS: 0.0589 TRAIN-ACC: 0.9827  VAL-LOSS: 0.0769 VAL-ACC: 0.9773  EPOCH-TIME: 0m9s
EPOCH: 009/100 LR: 0.0010 TRAIN-LOSS: 0.0536 TRAIN-ACC: 0.9838  VAL-LOSS: 0.0701 VAL-ACC: 0.9790  EPOCH-TIME: 0m9s
EPOCH: 010/100 LR: 0.0010 TRAIN-LOSS: 0.0488 TRAIN-ACC: 0.9850  VAL-LOSS: 0.0669 VAL-ACC: 0.9808  EPOCH-TIME: 0m10s
EPOCH: 011/100 LR: 0.0010 TRAIN-LOSS: 0.0441 TRAIN-ACC: 0.9862  VAL-LOSS: 0.0646 VAL-ACC: 0.9808  EPOCH-TIME: 0m10s
EPOCH: 012/100 LR: 0.0010 TRAIN-LOSS: 0.0403 TRAIN-ACC: 0.9881  VAL-LOSS: 0.0564 VAL-ACC: 0.9837  EPOCH-TIME: 0m10s
EPOCH: 013/100 LR: 0.0010 TRAIN-LOSS: 0.0371 TRAIN-ACC: 0.9889  VAL-LOSS: 0.0485 VAL-ACC: 0.9853  EPOCH-TIME: 0m9s
EPOCH: 014/100 LR: 0.0010 TRAIN-LOSS: 0.0334 TRAIN-ACC: 0.9900  VAL-LOSS: 0.0562 VAL-ACC: 0.9834  EPOCH-TIME: 0m10s
EPOCH: 015/100 LR: 0.0010 TRAIN-LOSS: 0.0320 TRAIN-ACC: 0.9905  VAL-LOSS: 0.0575 VAL-ACC: 0.9834  EPOCH-TIME: 0m9s
EPOCH: 016/100 LR: 0.0010 TRAIN-LOSS: 0.0318 TRAIN-ACC: 0.9906  VAL-LOSS: 0.0617 VAL-ACC: 0.9821  EPOCH-TIME: 0m9s
EPOCH: 017/100 LR: 0.0010 TRAIN-LOSS: 0.0278 TRAIN-ACC: 0.9913  VAL-LOSS: 0.0573 VAL-ACC: 0.9837  EPOCH-TIME: 0m10s
EPOCH: 018/100 LR: 0.0010 TRAIN-LOSS: 0.0258 TRAIN-ACC: 0.9918  VAL-LOSS: 0.0554 VAL-ACC: 0.9841  EPOCH-TIME: 0m9s
EPOCH: 019/100 LR: 0.0010 TRAIN-LOSS: 0.0217 TRAIN-ACC: 0.9933  VAL-LOSS: 0.0490 VAL-ACC: 0.9853  EPOCH-TIME: 0m10s
EPOCH: 020/100 LR: 0.0010 TRAIN-LOSS: 0.0215 TRAIN-ACC: 0.9933  VAL-LOSS: 0.0460 VAL-ACC: 0.9864  EPOCH-TIME: 0m10s
EPOCH: 021/100 LR: 0.0010 TRAIN-LOSS: 0.0206 TRAIN-ACC: 0.9933  VAL-LOSS: 0.0586 VAL-ACC: 0.9847  EPOCH-TIME: 0m10s
EPOCH: 022/100 LR: 0.0010 TRAIN-LOSS: 0.0191 TRAIN-ACC: 0.9939  VAL-LOSS: 0.0533 VAL-ACC: 0.9863  EPOCH-TIME: 0m10s
EPOCH: 023/100 LR: 0.0010 TRAIN-LOSS: 0.0179 TRAIN-ACC: 0.9945  VAL-LOSS: 0.0470 VAL-ACC: 0.9856  EPOCH-TIME: 0m10s
EPOCH: 024/100 LR: 0.0010 TRAIN-LOSS: 0.0182 TRAIN-ACC: 0.9940  VAL-LOSS: 0.0434 VAL-ACC: 0.9884  EPOCH-TIME: 0m10s
EPOCH: 025/100 LR: 0.0010 TRAIN-LOSS: 0.0140 TRAIN-ACC: 0.9957  VAL-LOSS: 0.0458 VAL-ACC: 0.9877  EPOCH-TIME: 0m10s
EPOCH: 026/100 LR: 0.0010 TRAIN-LOSS: 0.0149 TRAIN-ACC: 0.9954  VAL-LOSS: 0.0599 VAL-ACC: 0.9838  EPOCH-TIME: 0m10s
EPOCH: 027/100 LR: 0.0010 TRAIN-LOSS: 0.0154 TRAIN-ACC: 0.9951  VAL-LOSS: 0.0508 VAL-ACC: 0.9858  EPOCH-TIME: 0m10s
EPOCH: 028/100 LR: 0.0010 TRAIN-LOSS: 0.0160 TRAIN-ACC: 0.9949  VAL-LOSS: 0.0471 VAL-ACC: 0.9878  EPOCH-TIME: 0m10s
EPOCH: 029/100 LR: 0.0010 TRAIN-LOSS: 0.0128 TRAIN-ACC: 0.9957  VAL-LOSS: 0.0477 VAL-ACC: 0.9860  EPOCH-TIME: 0m10s
EPOCH: 030/100 LR: 0.0010 TRAIN-LOSS: 0.0107 TRAIN-ACC: 0.9966  VAL-LOSS: 0.0552 VAL-ACC: 0.9856  EPOCH-TIME: 0m10s
EPOCH: 031/100 LR: 0.0010 TRAIN-LOSS: 0.0107 TRAIN-ACC: 0.9967  VAL-LOSS: 0.0514 VAL-ACC: 0.9867  EPOCH-TIME: 0m9s
EPOCH: 032/100 LR: 0.0010 TRAIN-LOSS: 0.0122 TRAIN-ACC: 0.9958  VAL-LOSS: 0.0491 VAL-ACC: 0.9883  EPOCH-TIME: 0m10s
EPOCH: 033/100 LR: 0.0010 TRAIN-LOSS: 0.0106 TRAIN-ACC: 0.9967  VAL-LOSS: 0.0491 VAL-ACC: 0.9878  EPOCH-TIME: 0m9s
EPOCH: 034/100 LR: 0.0010 TRAIN-LOSS: 0.0081 TRAIN-ACC: 0.9973  VAL-LOSS: 0.0516 VAL-ACC: 0.9873  EPOCH-TIME: 0m10s
EPOCH: 035/100 LR: 0.0010 TRAIN-LOSS: 0.0136 TRAIN-ACC: 0.9958  VAL-LOSS: 0.0547 VAL-ACC: 0.9851  EPOCH-TIME: 0m9s
EPOCH: 036/100 LR: 0.0010 TRAIN-LOSS: 0.0082 TRAIN-ACC: 0.9975  VAL-LOSS: 0.0484 VAL-ACC: 0.9878  EPOCH-TIME: 0m10s
EPOCH: 037/100 LR: 0.0010 TRAIN-LOSS: 0.0104 TRAIN-ACC: 0.9965  VAL-LOSS: 0.0533 VAL-ACC: 0.9870  EPOCH-TIME: 0m9s
EPOCH: 038/100 LR: 0.0010 TRAIN-LOSS: 0.0084 TRAIN-ACC: 0.9975  VAL-LOSS: 0.0653 VAL-ACC: 0.9840  EPOCH-TIME: 0m10s
EPOCH: 039/100 LR: 0.0010 TRAIN-LOSS: 0.0084 TRAIN-ACC: 0.9975  VAL-LOSS: 0.0516 VAL-ACC: 0.9880  EPOCH-TIME: 0m9s
EPOCH: 040/100 LR: 0.0010 TRAIN-LOSS: 0.0081 TRAIN-ACC: 0.9974  VAL-LOSS: 0.0474 VAL-ACC: 0.9886  EPOCH-TIME: 0m9s
EPOCH: 041/100 LR: 0.0010 TRAIN-LOSS: 0.0079 TRAIN-ACC: 0.9976  VAL-LOSS: 0.0574 VAL-ACC: 0.9858  EPOCH-TIME: 0m9s
EPOCH: 042/100 LR: 0.0010 TRAIN-LOSS: 0.0072 TRAIN-ACC: 0.9979  VAL-LOSS: 0.0564 VAL-ACC: 0.9866  EPOCH-TIME: 0m9s
EPOCH: 043/100 LR: 0.0010 TRAIN-LOSS: 0.0095 TRAIN-ACC: 0.9971  VAL-LOSS: 0.0557 VAL-ACC: 0.9868  EPOCH-TIME: 0m10s
EPOCH: 044/100 LR: 0.0010 TRAIN-LOSS: 0.0061 TRAIN-ACC: 0.9980  VAL-LOSS: 0.0469 VAL-ACC: 0.9896  EPOCH-TIME: 0m10s
EPOCH: 045/100 LR: 0.0010 TRAIN-LOSS: 0.0089 TRAIN-ACC: 0.9971  VAL-LOSS: 0.0569 VAL-ACC: 0.9868  EPOCH-TIME: 0m10s
EPOCH: 046/100 LR: 0.0010 TRAIN-LOSS: 0.0068 TRAIN-ACC: 0.9979  VAL-LOSS: 0.0540 VAL-ACC: 0.9867  EPOCH-TIME: 0m9s
EPOCH: 047/100 LR: 0.0010 TRAIN-LOSS: 0.0049 TRAIN-ACC: 0.9985  VAL-LOSS: 0.0569 VAL-ACC: 0.9881  EPOCH-TIME: 0m10s
EPOCH: 048/100 LR: 0.0010 TRAIN-LOSS: 0.0079 TRAIN-ACC: 0.9975  VAL-LOSS: 0.0524 VAL-ACC: 0.9880  EPOCH-TIME: 0m9s
EPOCH: 049/100 LR: 0.0010 TRAIN-LOSS: 0.0037 TRAIN-ACC: 0.9991  VAL-LOSS: 0.0541 VAL-ACC: 0.9876  EPOCH-TIME: 0m9s
EPOCH: 050/100 LR: 0.0010 TRAIN-LOSS: 0.0075 TRAIN-ACC: 0.9976  VAL-LOSS: 0.0564 VAL-ACC: 0.9866  EPOCH-TIME: 0m9s
EPOCH: 051/100 LR: 0.0001 TRAIN-LOSS: 0.0031 TRAIN-ACC: 0.9992  VAL-LOSS: 0.0504 VAL-ACC: 0.9890  EPOCH-TIME: 0m9s
EPOCH: 052/100 LR: 0.0001 TRAIN-LOSS: 0.0013 TRAIN-ACC: 0.9998  VAL-LOSS: 0.0497 VAL-ACC: 0.9893  EPOCH-TIME: 0m10s
EPOCH: 053/100 LR: 0.0001 TRAIN-LOSS: 0.0010 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0491 VAL-ACC: 0.9901  EPOCH-TIME: 0m10s
EPOCH: 054/100 LR: 0.0001 TRAIN-LOSS: 0.0008 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0496 VAL-ACC: 0.9897  EPOCH-TIME: 0m9s
EPOCH: 055/100 LR: 0.0001 TRAIN-LOSS: 0.0007 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0504 VAL-ACC: 0.9897  EPOCH-TIME: 0m9s
EPOCH: 056/100 LR: 0.0001 TRAIN-LOSS: 0.0006 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0503 VAL-ACC: 0.9896  EPOCH-TIME: 0m10s
EPOCH: 057/100 LR: 0.0001 TRAIN-LOSS: 0.0005 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0503 VAL-ACC: 0.9900  EPOCH-TIME: 0m10s
EPOCH: 058/100 LR: 0.0001 TRAIN-LOSS: 0.0005 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0525 VAL-ACC: 0.9896  EPOCH-TIME: 0m10s
EPOCH: 059/100 LR: 0.0001 TRAIN-LOSS: 0.0004 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0532 VAL-ACC: 0.9896  EPOCH-TIME: 0m10s
EPOCH: 060/100 LR: 0.0001 TRAIN-LOSS: 0.0003 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0534 VAL-ACC: 0.9898  EPOCH-TIME: 0m10s
EPOCH: 061/100 LR: 0.0001 TRAIN-LOSS: 0.0003 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0546 VAL-ACC: 0.9891  EPOCH-TIME: 0m10s
EPOCH: 062/100 LR: 0.0001 TRAIN-LOSS: 0.0003 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0555 VAL-ACC: 0.9894  EPOCH-TIME: 0m10s
EPOCH: 063/100 LR: 0.0001 TRAIN-LOSS: 0.0002 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0556 VAL-ACC: 0.9894  EPOCH-TIME: 0m10s
EPOCH: 064/100 LR: 0.0001 TRAIN-LOSS: 0.0002 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0586 VAL-ACC: 0.9898  EPOCH-TIME: 0m9s
EPOCH: 065/100 LR: 0.0001 TRAIN-LOSS: 0.0002 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0584 VAL-ACC: 0.9894  EPOCH-TIME: 0m10s
EPOCH: 066/100 LR: 0.0001 TRAIN-LOSS: 0.0001 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0579 VAL-ACC: 0.9893  EPOCH-TIME: 0m9s
EPOCH: 067/100 LR: 0.0001 TRAIN-LOSS: 0.0001 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0599 VAL-ACC: 0.9887  EPOCH-TIME: 0m9s
EPOCH: 068/100 LR: 0.0001 TRAIN-LOSS: 0.0001 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0611 VAL-ACC: 0.9891  EPOCH-TIME: 0m10s
EPOCH: 069/100 LR: 0.0001 TRAIN-LOSS: 0.0001 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0634 VAL-ACC: 0.9890  EPOCH-TIME: 0m9s
EPOCH: 070/100 LR: 0.0001 TRAIN-LOSS: 0.0001 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0621 VAL-ACC: 0.9888  EPOCH-TIME: 0m9s
EPOCH: 071/100 LR: 0.0001 TRAIN-LOSS: 0.0001 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0620 VAL-ACC: 0.9890  EPOCH-TIME: 0m10s
EPOCH: 072/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0657 VAL-ACC: 0.9888  EPOCH-TIME: 0m10s
EPOCH: 073/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0667 VAL-ACC: 0.9887  EPOCH-TIME: 0m10s
EPOCH: 074/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0665 VAL-ACC: 0.9888  EPOCH-TIME: 0m10s
EPOCH: 075/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0675 VAL-ACC: 0.9888  EPOCH-TIME: 0m10s
EPOCH: 076/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0686 VAL-ACC: 0.9888  EPOCH-TIME: 0m10s
EPOCH: 077/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0692 VAL-ACC: 0.9888  EPOCH-TIME: 0m9s
EPOCH: 078/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0707 VAL-ACC: 0.9888  EPOCH-TIME: 0m10s
EPOCH: 079/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0725 VAL-ACC: 0.9884  EPOCH-TIME: 0m10s
EPOCH: 080/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0749 VAL-ACC: 0.9887  EPOCH-TIME: 0m10s
EPOCH: 081/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0750 VAL-ACC: 0.9886  EPOCH-TIME: 0m10s
EPOCH: 082/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0759 VAL-ACC: 0.9887  EPOCH-TIME: 0m9s
EPOCH: 083/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0784 VAL-ACC: 0.9884  EPOCH-TIME: 0m10s
EPOCH: 084/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0810 VAL-ACC: 0.9884  EPOCH-TIME: 0m10s
EPOCH: 085/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0788 VAL-ACC: 0.9887  EPOCH-TIME: 0m10s
EPOCH: 086/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0815 VAL-ACC: 0.9888  EPOCH-TIME: 0m10s
EPOCH: 087/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0817 VAL-ACC: 0.9886  EPOCH-TIME: 0m10s
EPOCH: 088/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0824 VAL-ACC: 0.9884  EPOCH-TIME: 0m10s
EPOCH: 089/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0850 VAL-ACC: 0.9887  EPOCH-TIME: 0m9s
EPOCH: 090/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0869 VAL-ACC: 0.9886  EPOCH-TIME: 0m10s
EPOCH: 091/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0892 VAL-ACC: 0.9883  EPOCH-TIME: 0m9s
EPOCH: 092/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0903 VAL-ACC: 0.9883  EPOCH-TIME: 0m10s
EPOCH: 093/100 LR: 0.0001 TRAIN-LOSS: 0.0001 TRAIN-ACC: 1.0000  VAL-LOSS: 0.1042 VAL-ACC: 0.9868  EPOCH-TIME: 0m9s
EPOCH: 094/100 LR: 0.0001 TRAIN-LOSS: 0.0003 TRAIN-ACC: 0.9999  VAL-LOSS: 0.0972 VAL-ACC: 0.9874  EPOCH-TIME: 0m10s
EPOCH: 095/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0969 VAL-ACC: 0.9874  EPOCH-TIME: 0m9s
EPOCH: 096/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0966 VAL-ACC: 0.9877  EPOCH-TIME: 0m9s
EPOCH: 097/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0962 VAL-ACC: 0.9877  EPOCH-TIME: 0m9s
EPOCH: 098/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0959 VAL-ACC: 0.9877  EPOCH-TIME: 0m9s
EPOCH: 099/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0956 VAL-ACC: 0.9877  EPOCH-TIME: 0m9s
EPOCH: 100/100 LR: 0.0001 TRAIN-LOSS: 0.0000 TRAIN-ACC: 1.0000  VAL-LOSS: 0.0953 VAL-ACC: 0.9877  EPOCH-TIME: 0m10s

参考

Xavier Jiezou
关注
  • 1
    点赞
  • 踩
  • 14
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论
专栏目录
教程 | 基于LSTM实现手写数字识别
小白学视觉
01-28 1364
点击上方“小白学视觉”，选择加"星标"或“置顶”重磅干货，第一时间送达基于tensorflow，如何实现一个简单的循环神经网络，完成手写数字识别，附完整演示代码。01 LSTM网络构建基于...
LSTM实现Mnist手写数字识别
cyj5201314的博客
04-08 392
import os os.environ['TF_CPP_MIN_LOG_LEVEL']='2' import tensorflow.compat.v1 as tf from tensorflow.examples.tutorials.mnist import input_data tf.compat.v1.disable_eager_execution() # 载入数据集 mnist = input_data.read_data_sets("MNIST_data/",one_hot=True) # 输
【深度学习】用LSTM识别手写数字MNIST数据集（tensorflow1.x实现）
东西山海关
04-12 774
网络结构： 就是LSTM后面再加一层全连接层。 输入输出分析： MNIST数据集详解：点击查看MNIST详解 数据集中的手写数字是个（28,28）的灰度像素二维数组。 在此可以将其行向量看做是连续的28个时间序列，故代码中TIME_STEP=28，每一行就是LSTM在时间t的输入其输入数据的维度INPUT_SIZE = 28 代码中NUM_UNITS = 128 表示LSTM的输出h_t的维度是128，具体见下图，其中num_units就是输出维度。 代码： import tensor
Tensorflow实现mnist手写数字识别（附github代码）
幻想乡
04-28 6345
一、任务需求mnist手写识别是经典的入门分类任务。给定28x28x1的输入图像，输出0-9共计十类的分类结果。本次实现分两部分，一是用传统的全连接神经网络实现分类，二是用卷积神经网络（CNN）实现分类。二、所用工具python（Anaconda3）tensorflow 1.0.0Ubuntu 16.04.1 LTS三、代码框架代码地址：https://github.com/zhuangchen-...
用PyTorch实现MNIST手写数字识别（最新，非常详细）
qq_45588019的博客
01-20 6万+
1 MNIST数据集(提取码: zm7q )
pytorch 利用lstm做mnist手写数字识别分类的实例
09-18
在本实例中，我们将探讨如何使用PyTorch构建一个基于LSTM（长短期记忆网络）的手写数字识别模型，以解决MNIST数据集的问题。MNIST数据集包含大量的手写数字图像，通常用于训练和测试计算机视觉算法，尤其是深度学习...
人工智能&深度学习必练案例-PyTorch基于RNN和LSTM进行MNIST手写数字识别（完整代码，含完整注释 + 数据集
05-02
这是一个完整的深度学习案例，适合正在学习深度学习和人工智能的朋友练手使用，该案例所用框架为PyTorch，所用编程语言为Python，所使用的模型，最后各自运用两种模型（一个是RNN，一个是LSTM）完成了该项目，已经在...
pythorch mnist手写数字 CNN MLP LSTM 识别
03-27
在本项目中，我们主要关注的是使用PyTorch框架对MNIST手写数字识别的实现。MNIST数据集是机器学习领域的一个经典基准，它包含了0-9的手写数字图像，用于训练和测试图像分类模型。PyTorch是一个强大的深度学习库，...
【PyTorch 深度学习实战（2）】基于LSTM实现 MNIST手写数字识别 (含源代码+数据集 详解)-2023.5.2
05-02
主题是基于LSTM循环神经网络实现MNIST手写数字识别，所用的框架为目前的主流框架PyTorch，所用编程语言为Python。该项目我已经在博客中详细记录，包含每一步的结果和通俗的解释等，建议结合专栏【Python从入门到人工...
手写数字识别系统之数字提取
weixin_34018169的博客
07-30 844
为什么80%的码农都做不了架构师？>>> ...
lstm实现mnist手写数字识别代码
07-25
参考网上写的、使用tensorflow的lstm实现mnist手写数字识别代码，
Tensorflow - Tutorial (7) : 利用 RNN/LSTM 进行手写数字识别
Joe的博客
03-10 2万+
1. 常用类class tf.contrib.rnn.BasicLSTMCellBasicLSTMCell 是最简单的一个LSTM类，没有实现clipping，projection layer，peep-hole等一些LSTM的高级变种，仅作为一个基本的basicline结构存在，如果要使用这些高级变种，需用class tf.contrib.rnn.LSTMCell这个类。使用方式：lstm = r
TensorFlow学习笔记(四)：手写数字识别之LSTM网络
zchang81的博客
10-09 1442
长短期记忆（LSTM）是目前循环神经网络最普遍使用的类型，在处理时间序列数据时使用最为频繁。
深度学习 LSTM的实现过程图以及代码实现
小鹏AI
07-17 2571
LSTM的实现过程 LSTM的实现步骤 长期记忆 短期记忆 遗忘门（第一个门） 输入门 输出门 注意上面的公式，我们使用上面的公式进行代码的实现 这个是内置的方法，我们可以直接进行调用 a = tf.nn.rnn_cell.LSTMCell() a.call(self, inputs, state) # state : 即指长期记忆，也指短期记忆 a.zero_state(self, batch_size, dtype) # batch_size 样本的数量需要给定， dtype需要传值
TensorFlow入门教程（十）：LSTM网络实现手写字体识别
小明同学
03-01 866
LSTM做图片识别（假设分辨率为20*30），相当于把每行数据（30）看做一组，送入网络，一共送入20次，即把图片一行行的传入进入，在这里强调一下网络输入的参数，inputs=[批次, 共有多少行, 一行多少个数据] import tensorflow as tf from tensorflow.examples.tutorials.mnist import input_data # 载入数...
PyTorch之示例——MNIST
CodeTutor
05-16 2万+
from __future__ import print_function import argparse import torch import torch.nn as nn import torch.nn.functional as F import torch.optim as optim from torchvision import datasets, transforms from to
pytorch小例子mnist
tensorflow mnist
04-19 585
import torch import torch.nn as nn import torch.nn.functional as F import torch.optim as optim from torch.autograd import Variable from torchvision import transforms, datasets batch_size = 64 t...
手写数字识别（一）
quinn1994的博客
03-31 2554
在学习识别手写输入数字时，初始化矩阵那里，有点不理解。源代码是这样的：self.biases=[np.random.randn(y,1) for y in sizes[1:]] '''创建一个偏差向量''' self.weights=[np.random.randn(y,x) for x,y in zip(sizes[:-1],sizes[1:])] '''创建一个...
用python创建的神经网络--mnist手写数字识别率达到98%
热门推荐
学习机器学习
08-11 6万+
周末根据Tariq Rashid大神的指导，没有使用tensorflow等框架，用python编写了一个三层神经网络，并应用再mnist手写库识别上，经过多方面参数调优，识别率竟然达到了98%。  调优比较难，经验感觉特别宝贵，为避免时间长了忘记，记录整理如下。 目录 一、加载所需要的库 二、定义神经网络类 三、创建神经网络对象并用MNIST训练集训练 四、用测试集测试准确率 五、参数...
基于pytorch的mnist手写数字识别步骤
最新发布
05-23
以下是基于PyTorch的MNIST手写数字识别的步骤： 1.导入必要的库 ```python import torch import torch.nn as nn import torch.optim as optim from torch.utils.data import DataLoader from torchvision import ...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

Xavier Jiezou

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值