【PyTorch】教程：torch.nn.SiLU

torch.nn.SiLU

原型

CLASS torch.nn.SiLU(inplace=False)

定义

$$silu(x)=x\ast \sigma (x),\text{where }\sigma (x)\text{ is logistic sigmoid}$$

图

代码

import torch
import torch.nn as nn

m = nn.SiLU()
input = torch.randn(4)
output = m(input)

print("input: ", input)   # input:  tensor([ 0.3852, -0.5519,  0.8902,  2.1292])
print("output: ", output) # output:  tensor([ 0.2292, -0.2017,  0.6311,  1.9029])

【参考】

SiLU — PyTorch 2.0 documentation