大语言模型（LLM）凤凰，训练过程中报错（安装flash_attn过程中报错：No module named ‘torch‘）

最新推荐文章于 2024-06-21 20:28:35 发布

艺桥

最新推荐文章于 2024-06-21 20:28:35 发布

阅读量1.4k

点赞数 5

文章标签：语言模型 python 深度学习

本文链接：https://blog.csdn.net/creativity2021/article/details/131541172

版权

在安装大语言模型（LLM）相关库flash_attn时遇到ModuleNotFoundError: No module named 'torch'的问题。通过conda安装pytorch后，成功解决报错，安装了flash_attn的1.0.5版本。注意，CUDA版本需为11.6，否则可能引发错误。

摘要由CSDN通过智能技术生成

安装flash_attn报错，信息如下：

pip install flash_attn
Collecting flash_attn
  Using cached flash_attn-1.0.8.tar.gz (2.0 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [15 lines of output]
      Traceback (most recent call last):
        File "/home/aaa/anaconda3/envs/fenghuang/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/home/aaa/anaconda3/envs/fenghuang/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/home/aaa/anaconda3/envs/fenghuang/lib