报错总结Huggingface

且行123

已于 2024-01-24 20:25:05 修改

阅读量1.1k

点赞数 9

分类专栏：研究文章标签：深度学习

于 2024-01-24 20:22:55 首次发布

本文链接：https://blog.csdn.net/m0_46288841/article/details/135830694

版权

研究专栏收录该内容

1 篇文章 0 订阅

订阅专栏

本文介绍了在使用Huggingface模型时遇到的下载问题，包括网络连接错误和数据集缺失。提供了解决方案，如将模型下载到本地并使用gitclone从HuggingFace仓库获取NaturalQuestions数据集。

摘要由CSDN通过智能技术生成

1、Huggingface模型无法下载转本地下载

报错

“Connection error, and we cannot find the requested files in the cached path.”
ValueError: Connection error, and we cannot find the requested files in the cached path. Please try again or make sure your Internet connection is on.

方法

将模型下载到本地中

使用网站Hugging Face – The AI community building the future.

下载文件

2、数据集中找不到

报错

[01.24.24 16:45:14] Preparing Training Data…
Traceback (most recent call last):
File “train.py”, line 477, in
main()
File “train.py”, line 439, in main
train_dataset, _ = get_dataset(args, args.train_datasets, args.train_dir, tokenizer, ‘train’)
File “train.py”, line 373, in get_dataset
dataset_dict_curr = util.read_squad(f’{data_dir}/{dataset}')
File “E:\SuoZihao\cs224nProject-main\robustqa_wr\util.py”, line 191, in read_squad
with open(path, ‘rb’) as f:
FileNotFoundError: [Errno 2] No such file or directory: ‘datasets\indomain_train\squad’

方法

git下载相关数据集
在这里插入图片描述

D:\Program Files\Git>set GIT_LFS_SKIP_SMUDGE=1

D:\Program Files\Git>git clone https://huggingface.co/datasets/natural_questions
Cloning into 'natural_questions'...
remote: Enumerating objects: 58, done.
remote: Total 58 (delta 0), reused 0 (delta 0), pack-reused 58
Unpacking objects: 100% (58/58), 17.91 KiB | 128.00 KiB/s, done.