Loading a dataset cached in a LocalFileSystem is not supported(Chatglm2-6B部署微调遇到的问题记录)

项目场景：

部署与微调chatglm2-6B过程中遇到的BUG记录

---

问题描述

1、Loading a dataset cached in a LocalFileSystem is not supported.

File "/home/pai/lib/python3.9/site-packages/datasets/load.py", line 1810, in load_dataset
ds = builder_instance.as_dataset(split=split, verification_mode=verification_mode, in_memory=keep_in_memory)
File "/home/pai/lib/python3.9/site-packages/datasets/builder.py", line 1128, in as_dataset
raise NotImplementedError(f"Loading a dataset cached in a {type(self._fs).__name__} is not supported.")
NotImplementedError: Loading a dataset cached in a LocalFileSystem is not supported.

2、The NVIDIA driver on your system is too old

3、gridio问答时输入后无响应

---

原因分析：

1、fsspec==2023.10.0 这个版本有问题

2、CUDA版本过低

3、gridio调用方法更新导致

---

解决方案：

1、回退pip install fsspec==2023.9.2就好了

2、pip install torch==2.0.1

3、 pip install gradio==3.39.0