Transformer Engine安装

u013250861

已于 2024-02-14 13:13:08 修改

阅读量1.7k

点赞数 8

分类专栏： # LLM/Transformer 图神经网络 # LLM/预训练&SFT 文章标签： transformer 深度学习人工智能

于 2024-01-07 21:37:48 首次发布

本文链接：https://blog.csdn.net/u013250861/article/details/135445372

版权

LLM/预训练&SFT 同时被 3 个专栏收录

84 篇文章 79 订阅 ¥19.90 ¥99.00

订阅专栏

超级会员免费看

LLM/Transformer

40 篇文章 13 订阅 ¥29.90 ¥99.00

订阅专栏

超级会员免费看

图神经网络

39 篇文章 16 订阅 ¥15.90 ¥99.00

订阅专栏

超级会员免费看

本文主要介绍了Transformer Engine的源码安装过程中遇到的Requirements错误和ModuleNotFoundError: No module named 'cv2'的问题。解决方法包括确认并安装OpenCV库，使用pip安装时注意PEP 517的要求。

摘要由CSDN通过智能技术生成

源码安装

Installation (from source)¶
Execute the following commands to install Transformer Engine from source:

# Clone repository, checkout stable branch, clone submodules
git clone --branch stable --recursive https://github.com/NVIDIA/TransformerEngine.git

cd TransformerEngine
export NVTE_FRAMEWORK=pytorch   # Optionally set framework
pip install .                   # Build and install

出错：

Building wheels for collected packages: transformer-engine
  Building wheel for transformer-engine (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [234 lines of output]
      /home/wyr/anaconda3/envs/megatron/lib/python3.10/site-packages/setuptools/__init__.py:80: _DeprecatedInstaller: setuptools.installer and fetch_build_eggs are deprecated.
      !!
      
              *********************