笔记来自课程《Pytorch深度学习实践》Lecture 8
术语:Epoch,Batch Size,Iterations
Epoch:One forward pass and one backward pass of all the training examples.
Batch size:The number of training examples in one forward backward pass.
Iterations:Number of passes, each pass using [batch size] number of examples.
# Training cycle
for epoch in range(training_epochs):
# Loop over all batches
for i in range(total_batch):