Traceback (most recent call last):
File “/home/ting/SKG/train.py”, line 315, in
main()
File “/home/ting/SKG/train.py”, line 203, in main
model = utils.tool.get_model(args.model.name)(args)
File “/home/ting/SKG/models/unified/prefixtuning.py”, line 24, in init
self.tokenizer = AutoTokenizer.from_pretrained(args.bert.location, use_fast=False)
File “/root/anaconda3/envs/py3.7pytorch1.8new/lib/python3.7/site-packages/transformers/models/auto/tokenization_auto.py”, line 571, in from_pretrained
return tokenizer_class_py.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
File “/root/anaconda3/envs/py3.7pytorch1.8new/lib/python3.7/site-packages/transformers/tokenization_utils_base.py”, line 1733, in from_pretrained
resolved_vocab_files, pretrained_model_name_or_path, init_configuration, *init_inputs, **kwargs
File “/root/anaconda3/envs/py3.7pytorch1.8new/lib/python3.7/site-packages/transformers/tokenization_utils_base.py”, line 1850, in _from_pretrained
tokenizer = cls(*init_inputs, **init_kwargs)
File “/root/anaconda3/envs/py3.7pytorch1.8new/lib/python3.7/site-packages/transformers/models/t5/tokenization_t5.py”, line 148, in init
self.sp_model.Load(vocab_file)
File “/root/anaconda3/envs/py3.7pytorch1.8new/lib/python3.7/site-packages/sentencepiece/init.py”, line 367, in Load
return self.LoadFromFile(model_file)
File “/root/anaconda3/envs/py3.7pytorch1.8new/lib/python3.7/site-packages/sentencepiece/init.py”, line 171, in LoadFromFile
return _sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg)
TypeError: not a string
self.tokenizer = AutoTokenizer.from_pretrained(args.bert.location, use_fast=False),把use_fast=False删掉,改为self.tokenizer = AutoTokenizer.from_pretrained(args.bert.location)