Llama3-Tutorial之Llama3本地Web Demo部署

参考五一超级课堂---Llama3-Tutorial（Llama 3 超级课堂）---第一节 Llama 3 本地 Web Demo 部署-CSDN博客

conda remove --name llama3 --all

conda create -n llama3 python=3.10

conda activate llama3

conda install pytorch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 pytorch-cuda=12.1 -c pytorch -c nvidia

pip install streamlit==1.32.2

使用软连接
 

mkdir -p ~/model

cd ~/model

ln -s /root/share/new_models/meta-llama/Meta-Llama-3-8B-Instruct ~/model/Meta-Llama-3-8B-Instruct

cd ~

git clone https://github.com/SmartFlowAI/Llama3-Tutorial

cd ~

git clone -b v0.1.18 https://github.com/InternLM/XTuner

cd XTuner

pip install -e .

streamlit run ~/Llama3-Tutorial/tools/internstudio_web_demo.py \

  ~/model/Meta-Llama-3-8B-Instruct

终于出来了，感谢同学的笔记