大数据平台运维之HDFS

HDFS

1.在HDFS文件系统的根目录下创建递归目录“1daoyun/file”，将附件中的BigDataSkills.txt文件，上传到1daoyun/file目录中，使用相关命令查看文件系统中1daoyun/file目录的文件列表信息，输出结果为。

[root@master ~]# hadoop fs -mkdir -p /1daoyun/file

[root@master ~]# hadoop fs -put BigDataSkills.txt/1daoyun/file

[root@master ~]# hadoop fs -ls /1daoyun/file 

Found 1 items

-rw-r--r--   3root hdfs         49 2017-05-06 09:57/1daoyun/file/BigDataSkills.txt

 

2.在HDFS文件系统的根目录下创建递归目录“1daoyun/file”，将附件中的BigDataSkills.txt文件，上传到1daoyun/file目录中，并使用HDFS文件系统检查工具检查文件是否受损，输出结果为。

[root@master ~]# hadoop fs -mkdir -p /1daoyun/file

[root@master ~]# hadoop fs -put BigDataSkills.txt/1daoyun/file

[root@master ~]# hadoop fsck/1daoyun/file/BigDataSkills.txt

DEPRECATED: Use of this script to execute hdfs commandis deprecated.

Instead use the hdfs command for it.

 

Connecting to namenode viahttp://master:50070/fsck?ugi=root&path=%2F1daoyun%2Ffile%2FBigDataSkills.txt

FSCK started by root (auth:SIMPLE) from /10.0.0.14 forpath /1daoyun/file/BigDataSkills.txt at Sun May 07 03:14:38 UTC 2017

.

/1daoyun/file/BigDataSkills.txt:  Under replicatedBP-90981007-192.168.101.10-1492713691966:blk_1073741906_1085. Target Replicasis 3 but found 2 live replica(s), 0 decommissioned replica(s) and 0decommissioning replica(s).

Status: HEALTHY

 Totalsize:    49 B

 Totaldirs:    0

 Totalfiles:   1

 Totalsymlinks:                0

 Total blocks(validated):      1 (avg. block size 49B)

 Minimallyreplicated blocks:   1 (100.0 %)

 Over-replicatedblocks:        0 (0.0 %)

 Under-replicated blocks:       1 (100.0 %)

 Mis-replicatedblocks:         0 (0.0 %)

 Defaultreplication factor:    3

 Average blockreplication:     2.0

 Corruptblocks:                0