现象
在进入hdfs的ui界面时最上方出现
There are 4 missing blocks. The following files may be corrupted:
blk_1073789242 /sparklog/application_1673794941044_0008.zstd
blk_1073789243 /tmp/logs/root/bucket-logs-tfile/0008/application_1673794941044_0008/node1_41441
blk_1073789244 /tmp/logs/root/bucket-logs-tfile/0008/application_1673794941044_0008/node3_36232
blk_1073789245 /tmp/logs/root/bucket-logs-tfile/0008/application_1673794941044_0008/node2_34530
Please check the logs or run fsck in order to identify the missing blocks. See the Hadoop FAQ for common causes and potential solutions.
出现以上异常
百度翻译结果显示
缺少 4 个块。以下文件可能已损坏:
blk_1073789242 /sparklog/application_1673794941044_0008.zstd
blk_1073789243 /tmp/logs/root/bucket-logs-tfile/0008/application_1673794941044_0008/node1_41441
blk_1073789244 /tmp/logs/root/bucket-logs-tfile/0008/application_1673794941044_0008/node3_36232
blk_1073789245 /tmp/logs/root/bucket-logs-tfile/0008/application_1673794941044_0008/node2_34530
请检查日志或运行 fsck 以识别缺失的块。请参阅 Hadoop FAQ 了解常见原因和潜在解决方案。
原因:
有文件损害
解决方法:
1.查看缺失文件
hdfs fsck /
2.删除缺失的文件
hdfs fsck / -delete
直接运行hdfs fsck / -delete被污染的文件即可解决,但这样删除文件会导致这些数据丢失,索引请谨慎操作