刚开始阶段当迭代次数小于网络文件.cfg中设置的参数burn_in时会用以下方式计算learn_rate
in src/network.c line 95:
if (batch_num < net->burn_in) return net->learning_rate * pow((float)batch_num / net->burn_in, net->power);
so: learning_rate * (iterations/burn_in)^4
net->power is = 4 according to src/parser.c line 686
net->power = option_find_float_quiet(options, "power", 4);
so at iteration 1:
LR = 0.001 * 1/1000^4 = 10^-3 * 10^(-3*4) = 10^-15 so yeah it is written 0.