https://github.com/EleutherAI/lm-evaluation-harness/tree/big-refactor
1、添加SeaExam中的m3exam和mmlu测试集。
https://huggingface.co/datasets/SeaLLMs/SeaExam
英语+东南亚语:SeaLLMs/SeaExam
requirements.txt
-e .
-e .[multilingual]
openai
accelerate-0.26.1-py3-none-any.whl
torch==2.2.2
transformers
huggingface_hub==0.26.1