错误信息:
AttributeError: /home/gw00241401/anaconda3/envs/knowlm/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats
解决方法:用cuda的版本覆盖cpu版本
cp libbitsandbytes_cuda121.so libbitsandbytes_cpu.so
参考:
I followed solution offered on
- Warning: "The installed version of bitsandbytes was compiled without GPU support." #112,
replace lib/python3.9/site-packages/bitsandbytes/lib/bitsandbytes_cpu.so with lib/python3.9/site-packages/bitsandbytes/lib/bitsandbytes_cuda114.so (with my version of cuda)
- to solve following error 'CUDA SETUP: Problem: The main issue seems to be that the main CUDA runtime library was not detected', I followed that suggestion of installing conda toolkit in new env
conda install cudatoolkit