坑1
AttributeError: /home/xty/mambaforge/envs/yi_lora/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cquantize_blockwise_fp16_nf4
解决办法:
cd /home/mambaforge/envs/yi_lora/lib/python3.10/site-packages/bitsandbytes
cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so
坑2
TypeError: LoraConfig.init() got an unexpected keyword argument ‘layer_replication’
解决办法:
pip install peft==0.10.0