bert
农民小飞侠
如果放弃了,那还谈什么理想
展开
-
pytorch transformers从头开始实现情感分析模型
最近用transformers用的比较多,用transformers加载预训练模型,然后做预测的教程挺多的,但是加载自己的数据进行训练的挺少的,我这里分享一下我的实现:数据准备数据来自于kaggle上面情感分析的数据,地址为:https://www.kaggle.com/lava18/google-play-store-apps?select=googleplaystore_user_reviews.csv导入函数import transformersfrom transformers impo原创 2020-11-15 18:03:49 · 1435 阅读 · 5 评论 -
bert transformers mask预测,预测缺失的mask字
今天需要用到transformer里面的bert进行mask预测,我这里分享一下我的代码:import torchfrom transformers import BertTokenizer, BertModel, BertForMaskedLM# OPTIONAL: if you want to have more information on what's happening, activate the logger as followsimport logginglogging.bas原创 2020-10-26 10:24:58 · 4745 阅读 · 6 评论 -
Chinese-ELECTRA ‘adam_m not found in checkpoint ‘
今天想利用Chinese-ELECTRA加载预训练权重来进一步训练,结果出现了下面的错误:2020-08-11 22:40:26.262591: W tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at save_restore_v2_ops.cc:184 : Not found: Key discriminator_predictions/dense/bias/adam_m not found in checkpoint原创 2020-08-11 23:30:45 · 2652 阅读 · 2 评论