PyTorch深度学习实践 pytorch 实现线性回归 y=wx+b

import torch

x=torch.tensor([[1.0],[2.0],[3.0]])
y=torch.tensor([[2.0],[4.0],[6.0]])

class LinearModel(torch.nn.Module):
 def __init__(self):
  super(LinearModel,self).__init__()
  self.linear=torch.nn.Linear(1,1)

 def forward(self,x):
  x=self.linear(x)
  return x

model=LinearModel()
criterion=torch.nn.MSELoss()
# schedular
optimizer=torch.optim.SGD(model.parameters(),lr=0.01)

for epoch in range(100):
 y_pred=model(x)
 loss=criterion(y_pred,y)
 print(epoch,loss.item())
 optimizer.zero_grad()
 loss.backward()
 optimizer.step()

print('w=',model.linear.weight.item())
print('b=',model.linear.bias.item())

x_test=torch.tensor([[4.0],[5.0]])
y_test=model(x_test)
print('y_pred=',y_test.data)

总结：

1.模型，自定义网络，forward()重写

2.损失函数，criterion:MSE，CROSSENTROPY...

3.优化器，SGD

4.前向传播，y_pred=model(x)，loss=criterion(y_pred,y)

反向求导前梯度清零，optimizer.zero_grad()

5.反向求导，loss.backward()

6.更新参数，optimizer.step()