欢迎关注,专注学术论文、机器学习、人工智能、Python技巧
以前自己的代码写得比较随意,最近阅读了很多大佬写的代码,发现真的是赏心悦目。这边就网络的定义的几种方法总结一下。首先,最简单的肯定是直接申明了
import torch
import torch.nn as nn
from torch.autograd import Variable
from collections import OrderedDict
class Net(nn.Module):
def __init__(self):
super(Net, self).__init__()
self.fc1 = nn.Linear(10,10)
self.relu1 = nn.ReLU(inplace=True)
self.fc2 = nn.Linear(10,2)
def forward(self,x):
x = self.fc1(x)
x = self.relu1(x)
x = self.fc2(x)
return x
这是最简单的定义一个网络的方法,但是当网络层数过多的时候,这么写未免太麻烦,于是Pytorch还有第二种定义网络的方法nn.ModuleList()
class Net(nn.Module):
def __init__(self):
super(Net, self).__init__()
self.base = nn.ModuleList([nn.Linear(10,10), nn.ReLU(), nn.Linear(10,2)])
def forward(self,x):
x = self.base(x)
return x
nn.ModuleList()接收的参数为一个List,这样就可以很方便的定义一个网络,比如
base = [nn.Linear(10,10) for i in range(5)]
net = nn.ModuleList(base)
最后一个方法就是nn.Sequential()
class Net(nn.Module):
def __init__(self):
super(Net, self).__init__()
self.base = nn.Sequential(nn.Linear(10,10), nn.ReLU(), nn.Linear(10,2))
def forward(self,x):
x = self.base(x)
return x
当然nn.Sequential()还有另外一种用法OrderedDict
class MultiLayerNN5(nn.Module):
def __init__(self):
super(MultiLayerNN5, self).__init__()
self.base = nn.Sequential(OrderedDict([
('0', BasicConv(1, 16, 5, 1, 2)),
('1', BasicConv(16, 32, 5, 1, 2)),
]))
self.fc1 = nn.Linear(32 * 7 * 7, 10)
def forward(self, x):
x = self.base(x)
x = x.view(x.size(0), -1)
x = self.fc1(x)
return x
除此之外,nn.Sequential还能add_module
class MultiLayerNN4(nn.Module):
def __init__(self):
super(MultiLayerNN4, self).__init__()
self.base = nn.Sequential()
self.base.add_module('0', BasicConv(1, 16, 5, 1, 2))
self.base.add_module('1', BasicConv(16, 32, 5, 1, 2))
self.fc1 = nn.Linear(32 * 7 * 7, 10)
def forward(self, x):
x = self.base(x)
x = x.view(x.size(0),-1)
x = self.fc1(x)
来看一下nn.Sequential()以及nn.ModuleList()的主要区别,我个人感觉就是nn.Sequential()里面自带了forward函数,可以直接操作输入,而nn.ModuleList()需要定义一个forward函数
tt = [nn.Linear(10,10), nn.Linear(10,2)]
n_1 = nn.Sequential(*tt)
n_2 = nn.ModuleList(tt)
x = torch.rand([1,10,10])
x = Variable(x)
n_1(x)
n_2(x)#会出现NotImplementedError
在定义比较深的网络的时候,结合nn.ModuleList()以及nn.Sequential()在代码量上会看上去十分简洁
这是分割线,最近在看denseNet的时候,又学到了一种定义网络的办法,就是直接继承nn.Sequential
class DenseLayer(nn.Sequential):
def __init__(self):
super(DenseLayer, self).__init__()
self.add_module("conv1", nn.Conv2d(1, 1, 1, 1, 0))
self.add_module("conv2", nn.Conv2d(1, 1, 1, 1, 0))
def forward(self, x):
new_features = super(DenseLayer, self).forward(x)
return torch.cat([x, new_features], 1)
#这个写法和下面的是一样的
class DenLayer1(nn.Module):
def __init__(self):
super(DenLayer1, self).__init__()
convs = [nn.Conv2d(1, 1, 1, 1, 0), nn.Conv2d(1, 1, 1, 1, 0)]
self.conv = nn.Sequential(*convs)
def forward(self, x):
return torch.cat([x, self.conv(x)], 1)
net = DenLayer1()
x = torch.Tensor([[[[1, 2], [3, 4]]]])
print(x)
x = Variable(x)
print(net(x))
学习交流
目前开通了技术交流群,群友超过500人,添加时最好备注形式为:来源+兴趣方向,方便找到志同道合的朋友
方式1、发送如下图片至微信,长按识别,关注后台回复:加群;
方式2、微信搜索公众号:机器学习社区,关注后台回复:加群;