2021-11-23 笔记（pytorch_optim_学习率调整策略，AverageMeter()）

1. 用于训练过程中训练参数记录和求平均。

   class AverageMeter():
       """ Meter for monitoring losses"""
       def __init__(self):
           self.avg = 0
           self.sum = 0
           self.cnt = 0
           self.reset()
   
       def reset(self):
           """reset all values to zeros"""
           self.avg = 0
           self.sum = 0
           self.cnt = 0
   
       def update(self, val, n=1):
           """update avg by val and n, where val is the avg of n values"""
           self.sum += val * n
           self.cnt += n
           self.avg = self.sum / self.cnt
   

 2. [Pytorch官方Lr下降策略](https://blog.csdn.net/junqing_wu/article/details/93248190?utm_medium=distribute.pc_relevant_t0.none-task-blog-BlogCommendFromBaidu-1.control&depth_1-utm_source=distribute.pc_relevant_t0.none-task-blog-BlogCommendFromBaidu-1.control)