pytorch中使用MultiStepLR动态调整学习率遇到的问题（求助帖）

首先放上原博文：
pytorch中的学习率调整函数

首先看一下原博文中通过MultiStepLR实现的部分

model = AlexNet(num_classes=2)
optimizer = optim.SGD(params = model.parameters(), lr=0.05)

#在指定的epoch值，如[10,15，25，30]处对学习率进行衰减，lr = lr * gamma
scheduler = lr_scheduler.MultiStepLR(optimizer, milestones=[10,15,25,30], gamma=0.1)

plt.figure()
x = list(range(40))
y = []

for epoch in range(40):
    scheduler.step()
    lr = scheduler.get_lr()
    print(epoch, scheduler.get_lr()[0])
    y.append(scheduler.get_lr()[0])

plt.plot(x,y)

运行结果如下：

0 0.05
1 0.05
2 0.05
3 0.05
4 0.05
5 0.05
6 0.05
7 0.05
8 0.05
9 0.05
10 0.005000000000000001
11 0.005000000000000001
12 0.005000000000000001
13 0.005000000000000001
14 0.005000000000000001
15 0.0005000000000000001
16 0.0005000000000000001
17 0.0005000000000000001
18 0.0005000000000000001
19 0.0005000000000000001
20 0.0005000000000000001
21 0.0005000000000000001
22 0.0005000000000000001
23 0.0005000000000000001
24 0.0005000000000000001
25 5.0000000000000016e-05
26 5.0000000000000016e-05
27 5.0000000000000016e-05
28 5.0000000000000016e-05
29 5.0000000000000016e-05
30 5.000000000000001e-06
31 5.000000000000001e-06
32 5.000000000000001e-06
33 5.000000000000001e-06
34 5.000000000000001e-06
35 5.000000000000001e-06
36 5.000000000000001e-06
37 5.000000000000001e-06
38 5.000000000000001e-06
39 5.000000000000001e-06

学习率根据epoch进行变化完全符合我们的预期

但当我复现这段测试的时候，出现了以下问题，在指定epoch处学习率lr总会出现不符合预期的变化

import torch.optim as optim
from torch.optim.lr_scheduler import MultiStepLR
from matplotlib import pyplot as plt
from siamese_network import SiameseNetwork

model = SiameseNetwork()
optimizer = optim.SGD(params = model.parameters(), lr=0.1)

#在指定的epoch值，如[10,15，25，30]处对学习率进行衰减，lr = lr * gamma
scheduler = MultiStepLR(optimizer, milestones=[10,15,25,30], gamma=0.1)

plt.figure()
x = list(range(40))
y = []

for epoch in range(40):
    scheduler.step()
    lr = scheduler.get_lr()
    print(epoch, scheduler.get_lr()[0])
    y.append(scheduler.get_lr()[0])

plt.plot(x,y)
plt.show()

复现结果：

D:\anaconda\python.exe F:/code/my_code/深度学习/pytorch/学习率测试/test03.py
0 0.1
1 0.1
2 0.1
3 0.1
4 0.1
5 0.1
6 0.1
7 0.1
8 0.1
9 0.0010000000000000002#！！！！！！！！！！！！！！1怎么会是这样
10 0.010000000000000002
11 0.010000000000000002
12 0.010000000000000002
13 0.010000000000000002
14 0.00010000000000000003##！！！！！！！！！！！！！！1怎么会是这样
15 0.0010000000000000002
16 0.0010000000000000002
17 0.0010000000000000002
18 0.0010000000000000002
19 0.0010000000000000002
20 0.0010000000000000002
21 0.0010000000000000002
22 0.0010000000000000002
23 0.0010000000000000002
24 1.0000000000000004e-05
25 0.00010000000000000003
26 0.00010000000000000003
27 0.00010000000000000003
28 0.00010000000000000003
29 1.0000000000000004e-06
30 1.0000000000000004e-05
31 1.0000000000000004e-05
32 1.0000000000000004e-05
33 1.0000000000000004e-05
34 1.0000000000000004e-05
35 1.0000000000000004e-05
36 1.0000000000000004e-05
37 1.0000000000000004e-05
38 1.0000000000000004e-05
39 1.0000000000000004e-05

求各位大神解答，不胜感激