在我上一篇文章中已经配置好了HDFS的高可用,接下来我们来配置yarn的高可用,其实很简单,只需要改一个yarn-site.xml配置文件即可(本文需要已经配好Hadoop集群 zookeeper集群,未配好请跳转我上一篇文章HDFS HAhttps://blog.csdn.net/qq_57193542/article/details/120535500https://blog.csdn.net/qq_57193542/article/details/120535500)
yarn-site.xml配置如下
<configuration>
<!-- 指定 MR 走 shuffle -->
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<!--YARN HA配置-->
<property>
<name>yarn.resourcemanager.ha.enabled</name>
<value>true</value>
</property>
<property>
<name>yarn.resourcemanager.cluster-id</name>
<value>cluster1</value>
</property>
<property>
<name>yarn.resourcemanager.ha.rm-ids</name>
<value>rm1,rm2</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm1</name>
<value>master</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm2</name>
<value>slave1</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm1</name>
<value>master:8088</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm2</name>
<value>slave1:8088</value>
</property>
<property>
<name>yarn.resourcemanager.zk-address</name>
<value>master:2181,slave1:2181,slave2:2181</value>
</property>
<property><!--启用RM重启的功能,默认为false-->
<name>yarn.resourcemanager.recovery.enabled</name>
<value>true</value>
</property>
<property>
<name>yarn.resourcemanager.store.class</name> <value>org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore</value>
</property>
</configuration>
将yarn先停止
[root@slave1 .ssh]# stop-yarn.sh
将配置分发给各个主机
[root@master bin]# xsync /opt/module/hadoop-3.1.3/etc/hadoop/yarn-site.xml
重启yarn(在其中一台配置了 ResourceManager的主机启动即可)
[root@master bin]# start-yarn.sh
启动效果如下
这样我们的YARN-HA 就配置好了.