xFormers 无法加载 CUDA

报错：

WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:

    PyTorch 2.1.0+cu121 with CUDA 1201 (you have 1.12.1+cu113)

    Python  3.10.13 (you have 3.10.13)

  Please reinstall xformers (see GitHub - facebookresearch/xformers: Hackable and optimized Transformers building blocks, supporting a composable construction.)

  Memory-efficient attention, SwiGLU, sparse and more won't be available.

  Set XFORMERS_MORE_DETAILS=1 for more details

xFormers 0.0.22.post4

原因：xformers版本和torch不匹配。

解决：

1. 访问https://anaconda.org/xformers/xformers/files， 找个对应的版本

1. 下载对应的包

wget https://anaconda.org/xformers/xformers/0.0.16/download/linux-64/xformers-0.0.16-py310_cu11.3_pyt1.12.1.tar.bz2

1. 安装：conda install xformers-0.0.16-py310_cu11.3_pyt1.12.1.tar.bz2
2. 验证：python -m xformers.info