NLP学习路径:
Word2vec->Lstm(LSTM的简化版GRU)->seq2seq->attention->The transformer(self-attention)->ELMo->openAIgpt->bert
Word2vec:
Lstm:
seq2seq:
attention:
The transformer(self-attention):
ELMo:
openAIgpt:
bert:
albert:
xlnet
NLP学习路径:
Word2vec->Lstm(LSTM的简化版GRU)->seq2seq->attention->The transformer(self-attention)->ELMo->openAIgpt->bert
Word2vec:
Lstm:
seq2seq:
attention:
The transformer(self-attention):
ELMo:
openAIgpt:
bert:
albert:
xlnet