deepspeed 安装 Windows

AI算法网奇

已于 2024-01-14 13:41:35 修改

阅读量1.9k

点赞数 6

分类专栏： python基础文章标签：人工智能

于 2024-01-14 10:30:20 首次发布

本文链接：https://blog.csdn.net/jacke121/article/details/135580343

版权

python基础专栏收录该内容

486 篇文章 57 订阅

订阅专栏

本文讲述了在Windows环境下安装DeepSpeed时遇到的模块`torch._six`缺失错误，升级安装后又遇到`aio.lib`链接问题。作者寻求解决方案，提出微软应支持自家操作系统。附有相关链接和建议。

摘要由CSDN通过智能技术生成

Window下安装deepspeed

报错No module named 'torch._six'：

升级安装

解决方法：

Window下安装deepspeed

pip install deepspeed==0.3.16

报错No module named 'torch._six'：

Traceback (most recent call last):
File "\\tsclient\B\project\motion\DragNUWA-main\aa.py", line 4, in <module>
from deepspeed.runtime.utils import see_memory_usage
File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\__init__.py", line 9, in <module>
from .runtime.engine import DeepSpeedEngine
File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\runtime\engine.py", line 18, in <module>
from deepspeed.runtime.utils import see_memory_usage
File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\runtime\utils.py", line 18, in <module>
from torch._six import inf
ModuleNotFoundError: No module named 'torch._six'

升级安装

pip install deepspeed -U

又报错，

     LINK : fatal error LNK1181: 无法打开输入文件“aio.lib”
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\Users\Administrator\AppData\Local\Temp\pip-install-sstq3xtg\deepspeed_ec1aceacdee5428b8b8e5a0f883c09d6\setup.py", line 182, in <module>
          abort(f"Unable to pre-compile {op_name}")
        File "C:\Users\Administrator\AppData\Local\Temp\pip-install-sstq3xtg\deepspeed_ec1aceacdee5428b8b8e5a0f883c09d6\setup.py", line 52, in abort
          assert False, msg
      AssertionError: Unable to pre-compile async_io
      DS_BUILD_OPS=1
       [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
       [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
       [WARNING]  One can disable async_io with DS_BUILD_AIO=0