- 博客(6)
- 收藏
- 关注
RSS订阅原创 Authentication in HDFS and Hadoop common
Summary This wiki is to introduce authentication in HDFS and Hadoop common and will also try to discuss some common authentication methods which can be used in other places. An overall picture of
2014-09-29 08:58:24
789
原创 HDFS HA
Both Primary NN and Standby NN startup in Standby Stateformat ZKFC, create znodeshould startup DFSZKFailoverController on the nodes which run Namenode instancesthe ZKFC which hold znode "/hadoop-ha/Ac
2014-07-24 09:33:10
732
原创 BlockReader in DFSClient
BlockReader is used by DFSInputStream to read a block BlockReaderLocalLegacy: Enables local short circuited reads. If the DFS client is on the same machine as the datanode, then the client can r
2014-07-24 09:18:27
478
原创 OpenSSL vs SunJDK on AES-NI support
SunJDK support AES-NI since 7u25+ and OpenSSL support AES-NI 1.0.0c+ and found out the reason why SunJDK's implementation of CTR mode and CBC decrypt mode is slower than Diceros's implementation(which
2014-07-24 09:08:28
829
原创 HDFS Block Recovery过程简述
在DFSClient写文件的时候，对于文件的每一个block，生成一个pipeline，然后按照这个pipeline进行数据传输，但是可能在数据传输过程中，DFSClient发生中断，例如断网等，此时该block在NameNode中处于UnderConstruction状态，该block所在的文件的写锁（通过LeaseManager实现）被该DFSClient占据着，无法释放。为此LeaseMan
2014-03-29 15:07:47
1965
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人