RuntimeError:
CUDA Setup failed despite GPU being available. Please run the following command to get more information:
python -m bitsandbytes
Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
bitsandbytes安装,windows环境每次都遇到这种报错,记录下。
网上有的说需要:pip install bitsandbytes-windows
,然而并卯什么卵用,
最后找了半天,github:https://github.com/jllllll/bitsandbytes-windows-webui/releases有个bitsandbytes-0.40.1.post1-py3-none-win_amd64.whl
挺管用,虽然python -m bitsandbytes
有报错,但不影响,继续跑Chinese-LLaMA-Alpaca是正常的。