hadoopHA集群安装

一.配置hadoop集群

可参考笔者另一篇文章：hadoop集群

二.zookeeper 配置与集群时间同步配置

zookeeper配置

三.hadoop集群HA配置

1.core-site.xml
设置name集群的名称
设置zookeeper 2181地址

添加代码如下：

<configuration>
        <property>
                <name>fs.defaultFS</name>
                <value>hdfs://ns</value>
        </property>
        <property>
                <name>hadoop.tmp.dir</name>
                <value>/opt/hadoop/tmp</value>
        </property>
<!--指定zookeeper地址-->
        <property>
                <name>ha.zookeeper.quorum</name>
                <value>hadoop001:2181,hadoop002:2181,hadoop003:2181</value>
        </property>

        <property>
                <name>hadoop.proxyuser.root.hosts</name>
                <value>*</value>
        </property>
        <property>
                <name>hadoop.proxyuser.root.groups</name>
                <value>*</value>
        </property>
        <property>
                <name>hadoop.native.lib</name>
                <value>false</value>
                <description>Should native hadoop libraries, if present, be used.
                </description>
        </property>
</configuration>

2.hdfs-site.xml
修改nameservices集群下面的各个nameservice服务对应的映射
设置rpc-address的地址9000
设置http-address的地址50070
设置journalnode的共享地址(各个datanode)
设置qjournal://datanode:8485;列表/集群名
设置出错处理,切换方式及隔离机制的设置
添加代码如下：

<configuration>
        <!--节点数，ha中可不配置-->
        <property>
                <name>dfs.replication</name>
                <value>3</value>
        </property>
        <!--指定名称服务，与core-site.xml中的一致-->
        <property>
                <name>dfs.nameservices</name>
                <value>ns</value>
        </property>
        <!--指定名称服务下的namenode结点-->
        <property>
                <name>dfs.ha.namenodes.ns</name>
                <value>hadoop001,hadoop002</value>
        </property>
        <!--rpc地址,9000端口-->
        <property>
                <name>dfs.namenode.rpc-address.ns.hadoop001</name>
                <value>hadoop001:9000</value>
        </property>
         <property>
                <name>dfs.namenode.rpc-address.ns.hadoop002</name>
                <value>hadoop002:9000</value>
        </property>
        <!--http地址，50070端口，即页面地址-->
        <property>
                <name>dfs.namenode.http-address.ns.hadoop001</name>
                <value>hadoop001:50070</value>
        </property>
        <property>
                <name>dfs.namenode.http-address.ns.hadoop002</name>
                <value>hadoop002:50070</value>
        </property>
        <!--namedode在journalnode(datanode)上存放数据的端口8485-->
        <property>
                <name>dfs.namenode.shared.edits.dir</name>
                <value>qjournal://hadoop001:8485;hadoop002:8485;hadoop003:8485/ns</value>
        </property>
        <!--开启namenode失败自动切换-->
        <property>
                 <name>dfs.ha.automatic-failover.enabled</name>
                 <value>true</value>
        </property>
        <!-- 配置namenode自动切换实现方式 -->
        <property>
                 <name>dfs.client.failover.proxy.provider.ns</name>
                 <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
        </property>
        <!-- 配置隔离机制方法，多个机制用换行分割，即每个机制暂用一行-->
        <property>
                 <name>dfs.ha.fencing.methods</name>
                 <value>
                     sshfence
                     shell(/bin/true)
                 </value>
        </property>
        <!--超时设置-->
        <property>
                <name>dfs.ha.fencing.ssh.connect-timeout</name>
                <value>30000</value>
        </property>
        <property>
                 <name>dfs.webhdfs.enabled</name>
                 <value>true</value>
        </property>
<!--当使用HA配置集群，则不需要secondarynamenode
        <property>
                 <name>dfs.namenode.secondary.http-address</name>
                 <value>192.168.134.102:50090</value>
        </property>
-->
</configuration>

3.yarn-site.xml
允许ha
resourcemanager集群配置
rm-ids:rm1,rm2
rm1:nm1 及端口配置8088
rm2:nm2 及端口配置8088
zookeeper配置
添加代码如下：

<configuration>
<!--HA配置-->
        <!--开启HA-->
        <property>
                <name>yarn.resourcemanager.ha.enabled</name>
                <value>true</value>
        </property>
        <!--指定rm集群id-->
        <property>
                <name>yarn.resourcemanager.cluster-id</name>
                <value>cluster_id</value>
        </property>
        <!--rm集群的名称服务-->
        <property>
                <name>yarn.resourcemanager.ha.rm-ids</name>
                <value>rm1,rm2</value>
        </property>
        <!--指定rm映射关系-->
        <property>
                <name>yarn.resourcemanager.hostname.rm1</name>
                <value>hadoop001</value>
        </property>
        <property>
                <name>yarn.resourcemanager.hostname.rm2</name>
                <value>hadoop002</value>
        </property>
        <property>
                <name>yarn.resourcemanager.webapp.address.rm1</name>
                <value>hadoop001:8088</value>
        </property>
        <property>
                <name>yarn.resourcemanager.webapp.address.rm2</name>
                <value>hadoop002:8088</value>
        </property>
        <!--配置zookeeper集群-->
        <property>
                <name>yarn.resourcemanager.zk-address</name>
                <value>hadoop001:2181,hadoop002:2181,hadoop003:2181</value>
        </property>

<!-- Site specific YARN configuration properties -->
<!--非HA模式下指定resourcemanager
        <property>
                <name>yarn.resourcemanager.hostname</name>
                <value>hadoop001</value>
        </property>
-->
         <property>
                <name>yarn.nodemanager.aux-services</name>
                <value>mapreduce_shuffle</value>
        </property>
         <property>
                <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
                <value>org.apache.hadoop.mapred.ShuffleHandler</value>
        </property>
        <property>
            <name>yarn.log-aggregation-enable</name>
            <value>true</value>
        </property>
        <!-- 日志保留时间设置7天 -->
        <property>
            <name>yarn.log-aggregation.retain-seconds</name>
            <value>604800</value>
        </property>
</configuration>

4.保证三台机器的配置文件一致
5.确保集群处于关闭状态
6.在opt目录的次级hadoop目录下删除tmp文件夹和logs文件夹,选择主节点重新format(可能需要提前启动journalnode)
在三台机器中均启动：

hadoop-daemon.sh start journalnode

7.把主节点新生成的tmp文件夹复制到备用节点

scp -r tmp hadoop002:$PWD

8.启动整个集群

start-all.sh

9.在所有机器上启动zookeeper

zkServer.sh start

10.在备用节点上启动备用resourcemanager

yarn-daemon.sh start resourcemanager

11.在一台机器上启动jobhistory

mr-jobhistory-daemon.sh start historyserver

12.主节点格式化zkfc: hdfs zkfc -formatZK
13.主备节点启动zkfc:hadoop-daemon.sh start zkfc各机器进程如图所示