LINEAR LAYERS

Linear层

Examples1：

import torch

x = torch.randn(128, 20)         # 输入的维度是（128，20）
m = torch.nn.Linear(20, 30)      # 维度 20,30
output = m(x)
print('m.weight.shape:\n ', m.weight.shape)
print('m.bias.shape:\n', m.bias.shape)
print('output.shape:\n', output.shape)

ans = torch.mm(x, m.weight.t()) + m.bias
print('ans.shape:\n', ans.shape)

print(torch.equal(ans, output))


结果：
"""m.weight.shape:
  torch.Size([30, 20])
  
m.bias.shape:
 torch.Size([30])
 
output.shape:
 torch.Size([128, 30])
 
ans.shape:
 torch.Size([128, 30])

Examples2:

>>> m = nn.Linear(20, 30)
>>> input = torch.randn(128, 20)
>>> output = m(input)
>>> print(output.size())
torch.Size([128, 30])