1、创建conda虚拟环境
虚拟环境名称xinference,python使用3.9的版本
conda create --name xinference python==3.9
2、查看并激活环境
conda env list
conda activate xinference
3、安装xinference
pip install "xinference[all]"
在安装过程中出现了以下错误:
不能构建Llama-cpp-python, matcha-tts, cdifflib
ERROR:Could not build wheels for
Llama-cpp-python, matcha-tts, cdifflib, which is reguired to install
pvproiect.toml-based proiects
解决方案:
sudo apt install build-essential
pip install llama-cpp-python
之后再次运行:
pip install "xinference[all]"