There are 2 missing blocks The following files may be corrupted

There are 2 missing blocks. The following files may be corrupted:

这里写图片描述

步骤1,检查文件缺失情况

可以看到,
/user/hive/warehouse/mid_table/part-00000-2434bd33-8a21-4249-9c0c-17e0f4ba397b-c000.snappy.parquet
/user/hive/warehouse/mid_table/part-00000-5d5247ea-8efb-4d96-850f-01fd2fb94211-c000.snappy.parquet
确实各自都丢失了1个Block, 文件已经损坏,不可恢复。

[root@s100 service]#   hadoop fsck /user/hive/warehouse | grep parquet
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

18/05/05 10:32:30 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Connecting to namenode via http://s100:50070/fsck?ugi=root&path=%2Fuser%2Fhive%2Fwarehouse
/user/hive/warehouse/mid_table/part-00000-2434bd33-8a21-4249-9c0c-17e0f4ba397b-c000.snappy.parquet: CORRUPT blockpool BP-1561093445-172.18.18.100-1522119663560 block blk_1073901422
/user/hive/warehouse/mid_table/part-00000-2434bd33-8a21-4249-9c0c-17e0f4ba397b-c000.snappy.parquet: MISSING 1 blocks of total size 1477 B............................................................................
/user/hive/warehouse/mid_table/part-00000-4537a72d-88df-4eef-a981-fd767dd263aa-c000.snappy.parquet:  Under replicated BP-1561093445-172.18.18.100-1522119663560:blk_1073901420_160599. Target Replicas is 3 but found 2 replica(s).
/user/hive/warehouse/mid_table/part-00000-5d5247ea-8efb-4d96-850f-01fd2fb94211-c000.snappy.parquet: CORRUPT blockpool BP-1561093445-172.18.18.100-1522119663560 block blk_1073901421
/user/hive/warehouse/mid_table/part-00000-5d5247ea-8efb-4d96-850f-01fd2fb94211-c000.snappy.parquet: MISSING 1 blocks of total size 1477 B....
[root@s100 service]# 

步骤2,删除缺失文件

hadoop fsck -delete /user/hive/warehouse/mid_table/part-00000-2434bd33-8a21-4249-9c0c-17e0f4ba397b-c000.snappy.parquet
hadoop fsck -delete /user/hive/warehouse/mid_table/part-00000-5d5247ea-8efb-4d96-850f-01fd2fb94211-c000.snappy.parquet

步骤3, 检查集群健康状况

这里写图片描述

  • 2
    点赞
  • 15
    收藏
    觉得还不错? 一键收藏
  • 6
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 6
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值