项目地址:https://github.com/open-compass/opencompass
本文参考opncompass进行大模型的精度评测
安装
git clone https://github.com/open-compass/opencompass.git
cd opencompass
pip install -e .
准备数据集
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip
unzip OpenCompassData-core-20231110.zip
解压后为data文件夹
完整数据集:
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-complete-20231110.zip
unzip OpenCompassData-complete-20231110.zip
运行
python run.py configs/eval_hf_llama_7b.py