1.创建开发机
2.配置环境
创建demo虚拟环境并使用下方代码进行安装包下载
pip install huggingface-hub==0.17.3
pip install transformers==4.34
pip install psutil==5.9.8
pip install accelerate==0.24.1
pip install streamlit==1.32.2
pip install matplotlib==3.8.3
pip install modelscope==1.9.5
pip install sentencepiece==0.1.99
3.下载并修改模型相关文件
4.模型加载完后,与模型进行对话
conda activate demo
python /root/demo/cli_demo.py