huggingface的clone失败问题:
hf本身问题:
(hlb) root@intern-studio-50104036:~# git clone https://huggingface.co/datasets/burkelibbey/colors
Cloning into 'colors'...
fatal: unable to access 'https://huggingface.co/datasets/burkelibbey/colors/': Received HTTP code 503 from proxy after CONNECT
(hlb) root@intern-studio-50104036:~# git clone https://hf-mirror.com/datasets/burkelibbey/colors
Cloning into 'colors'...
remote: Enumerating objects: 27, done.
remote: Total 27 (delta 0), reused 0 (delta 0), pack-reused 27 (from 1)
Unpacking objects: 100% (27/27), 1.94 MiB | 402.00 KiB/s, done.
解决方案: 换镜像网址 https://hf-mirror.com/
大文件下载问题:
(hlb) root@intern-studio-50104036:~/demo# git lfs install
git: 'lfs' is not a git command. See 'git --help'.
The most similar command is
log
(hlb) root@intern-studio-50104036:~/demo# apt-get install git-lfs
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
git-lfs
0 upgraded, 1 newly installed, 0 to remove and 41 not upgraded.
Need to get 3316 kB of archives.
After this operation, 11.1 MB of additional disk space will be used.
Get:1 https://mirrors.aliyun.com/ubuntu focal/universe amd64 git-lfs amd64 2.9.2-1 [3316 kB]
Fetched 3316 kB in 4s (822 kB/s)
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package git-lfs.
(Reading database ... 27798 files and directories currently installed.)
Preparing to unpack .../git-lfs_2.9.2-1_amd64.deb ...
Unpacking git-lfs (2.9.2-1) ...
Setting up git-lfs (2.9.2-1) ...
(hlb) root@intern-studio-50104036:~/demo# git lfs install
Error: Failed to call git rev-parse --git-dir: exit status 128
Git LFS initialized.
(hlb) root@intern-studio-50104036:~/demo# git clone https://hf-mirror.com/datasets/liuhaotian/LLaVA-Pretrain --depth=1
fatal: destination path 'LLaVA-Pretrain' already exists and is not an empty directory.
(hlb) root@intern-studio-50104036:~/demo# git clone https://hf-mirror.com/datasets/liuhaotian/LLaVA-Pretrain --depth=1
Cloning into 'LLaVA-Pretrain'...
remote: Enumerating objects: 7, done.
remote: Counting objects: 100% (7/7), done.
remote: Compressing objects: 100% (7/7), done.
remote: Total 7 (delta 0), reused 7 (delta 0), pack-reused 0 (from 0)
Unpacking objects: 100% (7/7), 2.32 KiB | 7.00 KiB/s, done.
Filtering content: 66% (2/3), 312.68 MiB | 44.35 MiB/s
解决方案: 下载 使用git-lfs