ViT (未完待续)
前言
记录训练ViT遇到的问题。
可学习参数
from torchsummary import summary
vit_model = ViT(
image_size = 256,
patch_size = 32,
num_classes = 1000,
dim = 1024,
depth = 6,
heads = 16,
mlp_dim = 2048,
dropout = 0.1,
emb_dropout = 0.1
)
devi
原创
2021-09-01 20:47:12 ·
294 阅读 ·
0 评论