PyTorch grad.data 查看参数梯度

结论

使用 parameter.grad,data 查看参数的梯度。

示例

>>> import torch
>>> import torch.nn as nn
>>> inp = torch.randn(1, 1, 4, 4)
>>> conv = nn.Conv2d(1, 1, 3)
>>> out = torch.abs(conv(inp))  #在前向传播中使用abs函数
>>> loss = torch.mean(out)
>>> loss.backward()  #反向传播求导
>>> conv.weight.grad.data  #梯度被正常计算出来了
tensor([[[[ 0.9184, -0.7436,  0.9369],
          [ 0.1592, -0.9278,  0.2882],
          [ 0.1048, -0.6844, -0.0950]]]])