错误如下:
/user/hive/warehouse/student01.txt: MISSING 1 blocks of total size 57 B..
/user/hive/warehouse/student2/student02.txt: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073741844
/user/hive/warehouse/student2/student02.txt: MISSING 1 blocks of total size 69 B..
/user/hive/warehouse/test_01/test_01.txt: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073741858
/user/hive/warehouse/test_01/test_01.txt: MISSING 1 blocks of total size 121 B...
/user/root/project/part-m-00000: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073742061
/user/root/project/part-m-00000: MISSING 1 blocks of total size 60 B..
/user/root/project/part-m-00001: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073742063
/user/root/project/part-m-00001: MISSING 1 blocks of total size 60 B..
/user/root/project/part-m-00002: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073742064
/user/root/project/part-m-00002: MISSING 1 blocks of total size 60 B.Status: CORRUPT
Total size: 222509237 B
Total dirs: 126
Total files: 363
Total symlinks: 0
Total blocks (validated): 348 (avg. block size 639394 B)
********************************
UNDER MIN REPL'D BLOCKS: 259 (74.425285 %)
dfs.namenode.replication.min: 1
CORRUPT FILES: 259
MISSING BLOCKS: 259
MISSING SIZE: 193388471 B
CORRUPT BLOCKS: 259
********************************
Minimally replicated blocks: 89 (25.574713 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 65 (18.678162 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 0.25574714
Corrupt blocks: 259
Missing replicas: 529 (38.305576 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Aug 02 07:03:27 EDT 2019 in 1137 milliseconds
打开hadoop页面,发现报错:There are 259 missing blocks. The following files may be corrupted
估计是因为运行hadoop的时候,出现假死的状况,我直接重启了服务器,造成块数据丢失。
解决办法:
1.查看缺失文件
hdfs fsck /
2.删除缺失的文件
hdfs/hadoop fsck -delete
3.此时进入hadoop页面,出现正常的页面