Transformer学习:
图解Transformer(完整版)_龙心尘-CSDN博客_transformer
NLP实操手册: 基于Transformer的深度学习架构的应用指南(综述)_王博(Kings)的博客-CSDN博客
数据准备
入库,设置随机种子
# -*- codeing = utf-8 -*-
import torch
import random
import numpy as np
SEED = 1234
random.seed(SEED)
np.random.seed(SEED)
torch.manual_seed(SEED)
torch.backends.deterministic = True
from transformers import BertTokenizer