![](https://img-blog.csdnimg.cn/20201014180756925.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
调参技巧
xungeer29
先定个小目标:paper搬运工
展开
-
深度学习调参技巧
Bag of Tricks for Image Classification with Convolutional Neural Networks arxiv 论文详解-知乎 Large-batch training Linear scaling learning rate Learning rate warmup Zero γ\gammaγ No bias decay Low-precisi...原创 2019-05-03 16:26:20 · 189 阅读 · 0 评论 -
Gradual warmup lr schedule--pytorch
Gradually warm-up(increasing) learning rate for pytorch’s optimizer. Proposed in ‘Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour’. # from:https://github.com/ildoonet/pytorch-gradual-warmup...原创 2019-06-21 14:26:16 · 6243 阅读 · 0 评论 -
Label Smooth--pytorch
import torch import torch.nn as nn class LabelSmoothSoftmaxCE(nn.Module): def __init__(self, lb_pos=0.9, lb_neg=0.005, reduction='mean', ...原创 2019-06-21 14:25:58 · 2808 阅读 · 2 评论