transformers和tokenizer版本不对,重新装一下:
pip uninstall transformers -y
pip install tokenizers==0.20.0
pip install transformers==4.46.3
transformers和tokenizer版本不对,重新装一下:
pip uninstall transformers -y
pip install tokenizers==0.20.0
pip install transformers==4.46.3