torch.nn.Linear() 理解

最新推荐文章于 2024-06-07 00:11:50 发布

gz153016

最新推荐文章于 2024-06-07 00:11:50 发布

阅读量255

点赞数

分类专栏：动态深度学习框架Pytorch

本文链接：https://blog.csdn.net/gz153016/article/details/119111488

版权

动态深度学习框架Pytorch 专栏收录该内容

5 篇文章 1 订阅

订阅专栏

# -- coding: utf-8 --

import torch

x = torch.randn(128, 20)  # 输入的维度是（128，20）
m = torch.nn.Linear(20, 30)  # 20,30是指维度
output = m(x)# (128, 20)  (20, 30) -> (128, 30)

print('m.weight.shape:\n ', m.weight.shape) # torch.Size([30, 20])
print('m.bias.shape:\n', m.bias.shape) # torch.Size([30])
print('output.shape:\n', output.shape) # torch.Size([128, 30])

# ans = torch.mm(input,torch.t(m.weight))+m.bias 等价于下面的
ans = torch.mm(x, m.weight.t()) + m.bias
# y = x.A(T) + b
print('ans.shape:\n', ans.shape) # torch.Size([128, 30])

print(torch.equal(ans, output)) # # True


# m.weight.shape:
#   torch.Size([30, 20])
# m.bias.shape:
#  torch.Size([30])
# output.shape:
#  torch.Size([128, 30])
# ans.shape:
#  torch.Size([128, 30])
# True