![](https://img-blog.csdnimg.cn/20201014180756754.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
Hadoop
文章平均质量分 55
fd0511
这个作者很懒,什么都没留下…
展开
-
HDFS Block Recovery过程简述
在DFSClient写文件的时候,对于文件的每一个block,生成一个pipeline,然后按照这个pipeline进行数据传输,但是可能在数据传输过程中,DFSClient发生中断,例如断网等,此时该block在NameNode中处于UnderConstruction状态,该block所在的文件的写锁(通过LeaseManager实现)被该DFSClient占据着,无法释放。为此LeaseMan原创 2014-03-29 15:07:47 · 1972 阅读 · 0 评论 -
HDFS append细节
design doc: https://issues.apache.org/jira/browse/HDFS-265转载 2014-03-31 10:57:04 · 583 阅读 · 0 评论 -
BlockReader in DFSClient
BlockReader is used by DFSInputStream to read a blockBlockReaderLocalLegacy: Enables local short circuited reads. If the DFS client is on the same machine as the datanode, then the client can r原创 2014-07-24 09:18:27 · 483 阅读 · 0 评论 -
HDFS HA
Both Primary NN and Standby NN startup in Standby Stateformat ZKFC, create znodeshould startup DFSZKFailoverController on the nodes which run Namenode instancesthe ZKFC which hold znode "/hadoop-ha/Ac原创 2014-07-24 09:33:10 · 735 阅读 · 0 评论 -
Authentication in HDFS and Hadoop common
SummaryThis wiki is to introduce authentication in HDFS and Hadoop common and will also try to discuss some common authentication methods which can be used in other places.An overall picture of原创 2014-09-29 08:58:24 · 801 阅读 · 0 评论