Bag of Tricks for Image Classification with Convolutional Neural Networks
文章目录Baseline训练测试有效训练Large-batch1. 线性增加初始学习率(Linear scaling learning rate)2. 线性增加学习率至初始学习率(Learning rate warmup)3. BN层γ=0(Zero γ)4. 偏置不衰减(No bias decay)Low-percision training模型微调原始结构结构微调训练改进余弦学习率衰减(Cos...
原创
2019-01-02 16:56:32 ·
426 阅读 ·
0 评论