环境配置(腾讯云服务器):
镜像信息:Ubuntu 20.04 GPU基础镜像(预装470驱动、docker、nvidia-docker)
实例配置:GPU计算型GN7 - 8核 32G 公网带:5Mbps GPU:1 * NVIDIA T4
服务器地域:新加坡
1.下载代码
@git clone https://github.com/Vision-CAIR/MiniGPT-4.git
2.检查GPU(这里GPU要在16G以上)
@nvidia-smi
3.查看文件
@ls
4.进入MiniGPT-4文件
@cd MiniGPT-4/
5.导入相关环境配置(时间较长耐心下载)
Getrequirements.txt in
Use-LLMs-in-Colab/requirements.txt at main · WangRongsheng/Use-LLMs-in-Colab · GitHub
!pip install -qr requirements.txt
其他配置:
!pip install -q salesforce-lavis
!pip install -q bitsandbytes
!pip install -q accelerate
!pip install -q gradio==3.27.0
!pip install -q h5py
!pip install -q typing-extensions
!pip install -q wheel
!pip install -q git+https://github.com/huggingface/transformers.git -U
6.更新权重模型
!pip install git+https://github.com/lm-sys/FastChat.git@v0.1.10
!pip install fastchat
7.下载pretrained_minigpt4并更改路径
# if you run 13B , Plaease Download Checkpoint Aligned with Vicuna 13B
#!wget https://huggingface.co/wangrongsheng/MiniGPT4/blob/main/pretrained_minigpt4.pth
# if you run 7B , Plaease Download Checkpoint Aligned with Vicuna 7B
!wget https://huggingface.co/wangrongsheng/MiniGPT47B/resolve/main/prerained_minigpt4_7b.pth
更改路径提示:
8.运行MiniGPT-4(若成功会自动下载需要的模型)
@python demo.py --cfg-path eval_configs/minigpt4_eval.yaml --gpu-id 0
9.可能的报错:
解决方法: