hadoop报错:There are * missing blocks. The following files may be corrupted

错误如下:

/user/hive/warehouse/student01.txt: MISSING 1 blocks of total size 57 B..
/user/hive/warehouse/student2/student02.txt: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073741844

/user/hive/warehouse/student2/student02.txt: MISSING 1 blocks of total size 69 B..
/user/hive/warehouse/test_01/test_01.txt: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073741858

/user/hive/warehouse/test_01/test_01.txt: MISSING 1 blocks of total size 121 B...
/user/root/project/part-m-00000: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073742061

/user/root/project/part-m-00000: MISSING 1 blocks of total size 60 B..
/user/root/project/part-m-00001: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073742063

/user/root/project/part-m-00001: MISSING 1 blocks of total size 60 B..
/user/root/project/part-m-00002: CORRUPT blockpool BP-1635359950-127.0.0.1-1538059327626 block blk_1073742064

/user/root/project/part-m-00002: MISSING 1 blocks of total size 60 B.Status: CORRUPT
 Total size:	222509237 B
 Total dirs:	126
 Total files:	363
 Total symlinks:		0
 Total blocks (validated):	348 (avg. block size 639394 B)
  ********************************
  UNDER MIN REPL'D BLOCKS:	259 (74.425285 %)
  dfs.namenode.replication.min:	1
  CORRUPT FILES:	259
  MISSING BLOCKS:	259
  MISSING SIZE:		193388471 B
  CORRUPT BLOCKS: 	259
  ********************************
 Minimally replicated blocks:	89 (25.574713 %)
 Over-replicated blocks:	0 (0.0 %)
 Under-replicated blocks:	65 (18.678162 %)
 Mis-replicated blocks:		0 (0.0 %)
 Default replication factor:	1
 Average block replication:	0.25574714
 Corrupt blocks:		259
 Missing replicas:		529 (38.305576 %)
 Number of data-nodes:		1
 Number of racks:		1
FSCK ended at Fri Aug 02 07:03:27 EDT 2019 in 1137 milliseconds

 打开hadoop页面,发现报错:There are 259 missing blocks. The following files may be corrupted

估计是因为运行hadoop的时候,出现假死的状况,我直接重启了服务器,造成块数据丢失。

解决办法:

1.查看缺失文件

hdfs fsck /

2.删除缺失的文件

hdfs/hadoop fsck -delete

3.此时进入hadoop页面,出现正常的页面

 

  • 1
    点赞
  • 6
    收藏
    觉得还不错? 一键收藏
  • 6
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 6
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值