Hadoop-9710问题

1. 概述

IBR:IBR(增量块汇报)

jira-9710描述

Description

When a DN has received a block, it immediately sends a block receipt IBR RPC to NN for reporting the block. Even if a DN has received multiple blocks at the same time, it still sends multiple RPCs. It does not scale well since NN has to process a huge number of RPCs when many DNs receiving many blocks at the same time.

 

2. 参考资料

[1].https://issues.apache.org/jira/browse/HDFS-9198 . Coalesce IBR processing in the NN
[2].https://issues.apache.org/jira/browse/HDFS-9710 . Change DN to send block receipt IBRs in batches

 

https://blog.csdn.net/androidlushangderen/article/details/101643921

趣头条百PB规模 Hadoop实践(HDFS篇)  https://blog.csdn.net/weixin_35792948/article/details/104997862

https://issues.apache.org/jira/browse/HDFS-9198

https://issues.apache.org/jira/browse/HDFS-9710

https://issues.apache.org/jira/plugins/servlet/mobile#issue/HDFS-9710