基础任务(完成此任务即完成闯关)
- follow 教学文档和视频使用QLoRA进行微调模型,复现微调效果,并能成功讲出梗图.
- 尝试使用LoRA,或调整xtuner的config,如LoRA rank,学习率。看模型Loss会如何变化,并记录调整后效果(选做,使用LoRA或调整config可以二选一)
报错
qlora_finetune.py --work-dir /root/InternLM/work_dir/internvl_ft_run_8_filter --deepspeed deepspeed_zero1
Traceback (most recent call last):
File "/root/.conda/envs/xtuner/bin/xtuner", line 33, in <module>
sys.exit(load_entry_point('xtuner', 'console_scripts', 'xtuner')())
File "/root/.conda/envs/xtuner/bin/xtuner", line 22, in importlib_load_entry_point
for entry_point in distribution(dist_name).entry_points
File "/root/.conda/envs/xtuner/lib/python3.10/importlib/metadata/__init__.py", line 969, in distribution
return Distribution.from_name(distribution_name)
File "/root/.conda/envs/xtuner/lib/python3.10/importlib/metadata/__init__.py", line 548, in from_name
raise PackageNotFoundError(name)
importlib.metadata.PackageNotFoundError: No package metadata was found for xtuner