RuntimeError: probability tensor contains either inf
, nan
or element < 0
解决方法:
model = AutoModelForCausalLM.from_pretrained(model_path, device_map="auto", torch_dtype=torch_dtype)
训练和推理时都修改为bfloat:
model = AutoModelForCausalLM.from_pretrained(model_path, device_map="auto", torch_dtype=torch.bfloat16)
TypeError: Accelerator.__init__() got an unexpected keyword argument 'use_seedable_sampler'
更新accelerate到最新版本
记录一些版本号:
torch 2.1.2+cu121
transformers 4.41.2
accelerate 0.31.0
peft 0.11.1