如何在hdfs上将文件下载
I have a very large (e.g. 100GB) .gz file and would like to split it into smaller files like 8GB/each for storage/copying. How to split a gzip file to several small ones on Linux?
我有一个非常大的文件(例如100GB)。gz文件,想将其拆分成较小的文件,例如8GB /每一个,用于存储/复制。 如何在Linux上将gzip文件拆分为几个小文件?
You may use the tool split
to split a file by sizes.
您可以使用split
工具按大小拆分文件。
An example to split a large.tgz to at most 8GB smaller files is as follows.
下面是一个将large.tgz拆分为最多8GB的较小文件的示例。
split -b 8G large.tgz large.tgz.part-
The split files names are the prefix with appendix like ‘aa’, ‘ab’, ‘ac’ as follows.
拆分文件的名称是带有前缀的前缀,例如“ aa”,“ ab”,“ ac”,如下所示。
$ ll -h
total 35G
-rw-rw-r-- 1 user user 18G Jun 25 10:57 large.tgz
-rw-rw-r-- 1 user user 8.0G Jun 25 12:10 large.tgz.part-aa
-rw-rw-r-- 1 user user 8.0G Jun 25 12:15 large.tgz.part-ab
-rw-rw-r-- 1 user user 1.2G Jun 25 12:16 large.tgz.part-ac
翻译自: https://www.systutorials.com/how-to-split-a-gzip-file-to-several-small-ones-on-linux/
如何在hdfs上将文件下载