快乐程序员的专栏

一、NameNode的HA 1、 core-site.xml  • For MRv1: fs.default.name/name> hdfs://mycluster • For YARN: fs.defaultFS hdfs://mycluster ha.zookeeper.quorum zk1.example.com:2181,zk2.examp

1、目前发布版只支持两个NN The HDFS HA feature addresses the above problems by providing the option of running two NameNodes in the same cluster, in an Active/Passive configuration. These are referred to as the

0、linux内核参数 vm.swappiness cat /proc/sys/vm/swappiness 默认是60，推荐修改成0 sysctl -w vm.swappiness=0  1、mapreduce Shuffle Handler for yarn： mapreduce.shuffle.manage.os.cache 默认开启的，true mapr

一、节点部署情况 1、cdh4.2.1 HA安装节点： ip hosts 进程 备注 10.32.71.18 master1.jnhadoop.com NameNode JournalNode ZooKeeper HdfsZkfc 默认NN启动为active 10.32.71.19 master2.j

1、dfs.name.dir or dfs.namenode.name.dir  sudo mkdir -p /data/1/dfs/nn /nfsmount/dfs/nn sudo chown -R hdfs:hdfs /data/1/dfs/nn /nfsmount/dfs/nn sudo chmod 700 /data/1/dfs/nn /nfsmount/dfs/nn

10.31.72.18   master1.jnhadoop.com  ：NN  JN  ZK  HDFSZKFC                         默认NN启动为active 10.31.72.19   master2.jnhadoop.com  ：JT   JN  ZK  MRZKFC                             默认JT启动为active 10.