【PyTorch】教程：torch.nn.Mish

torch.nn.Mish

原型

CLASS torch.nn.Mish(inplace=False)

定义

$$\text{Mish}(x)=x\ast \text{Tanh}(\text{Softplus}(x))$$

图

代码

import torch
import torch.nn as nn

m = nn.Mish()
input = torch.randn(4)
output = m(input)

print("input: ", input)
print("output: ", output)

【参考】

Mish — PyTorch 1.13 documentation