hdfs 块副本丢失怎么办_如何处理丢失的块以及HDFS中副本损坏的块？

最新推荐文章于 2023-02-24 14:55:52 发布

cuma2369

最新推荐文章于 2023-02-24 14:55:52 发布

阅读量3.2k

点赞数

文章标签： java 大数据 hadoop 数据库 hdfs

原文链接：https://www.systutorials.com/how-to-handle-missing-blocks-and-blocks-with-corrupt-replicas-in-hdfs/

版权

本文讨论了HDFS中块丢失和损坏副本的问题。当HDFS报告'正在复制的块'时，通常一段时间后会自动重新复制。处理这类问题的方法包括使用HDFS fsck命令识别损坏块，检查下线DataNodes，以及确保关键数据使用复制因子3。对于丢失或损坏的块，可以重启故障DataNodes，并从备份中恢复。

摘要由CSDN通过智能技术生成

hdfs 块副本丢失怎么办

One of HDFS cluster’s hdfs dfsadmin -report reports:

HDFS集群的hdfs dfsadmin -report报告之一：

Under replicated blocks: 139016
Blocks with corrupt replicas: 9
Missing blocks: 0

The “Under replicated blocks” can be re-replicated automatically after some time.

一段时间后，“正在复制的块”可以自动重新复制。

How to handle the missing blocks and blocks with corrupt replicas in HDFS?

如何处理丢失的块以及HDFS中损坏的副本块？

了解这些障碍 (Understanding these blocks)

A block is “with corrupt replicas” in HDFS if it has at least one corrupt replica along with at least one live replica. As such, a block having corrupt replicas does not indicate unavailable data, but they do indicate an increased chance that data may become unavailable.