zookeeper配置hadoop高可用

最新推荐文章于 2024-08-27 23:04:03 发布

zcx1203

最新推荐文章于 2024-08-27 23:04:03 发布

阅读量309

点赞数 1

本文链接：https://blog.csdn.net/zcx1203/article/details/90451091

版权

本文详细介绍了如何配置Zookeeper以实现Hadoop的高可用性。首先清理实验环境，然后准备并搭建Zookeeper集群，包括设置从节点信息、配置ID及启动。接着在各个节点上启动Zookeeper，并在主节点上配置Hadoop。最后，通过格式化Zookeeper，开启HDFS集群，验证在NameNode关闭和打开的情况下，高可用性的功能正常运行。

摘要由CSDN通过智能技术生成

zookeeper配置hadoop高可用

清理实验环境

[hadoop@server1 hadoop]$ sbin/stop-yarn.sh 
[hadoop@server1 hadoop]$ sbin/stop-dfs.sh
[hadoop@server1 hadoop]$ jps
1583 Jps

server1-3
[hadoop@server1 tmp]$ rm -rf *

准备环境

在server2 server3 server4 server5中安装jdk并配置环境变量
[hadoop@server3 ~]$ tar zxf jdk-8u181-linux-x64.tar.gz 
[hadoop@server3 ~]$ ln -s jdk1.8.0_181/ java
[hadoop@server3 ~]$ vim .bash_profile 
[hadoop@server3 ~]$ source .bash_profile 
[hadoop@server3 ~]$ jps
1647 Jps

server2 server3 server4  server5
上安装hadoop
[hadoop@server3 ~]$ tar zxf hadoop-3.0.3.tar.gz 
[hadoop@server3 ~]$ ln -s hadoop-3.0.3 hadoop
[hadoop@server1 hadoop]$ vim hadoop-env.sh
 54 export JAVA_HOME=/home/hadoop/java

搭建zookeeper 添加从节点信息

[hadoop@server2 ~]$ tar zxf zookeeper-3.4.9.tar.gz 
[hadoop@server2 ~]$ cd zookeeper-3.4.9
[hadoop@server2 zookeeper-3.4.9]$ ls
bin          dist-maven       LICENSE.txt           src
build.xml    docs             NOTICE.txt            zookeeper-3.4.9.jar
CHANGES.txt  ivysettings.xml  README_packaging.txt  zookeeper-3.4.9.jar.asc
conf         ivy.xml          README.txt            zookeeper-3.4.9.jar.md5
contrib      lib              recipes               zookeeper-3.4.9.jar.sha1
[hadoop@server2 zookeeper-3.4.9]$ cd conf/
[hadoop@server2 conf]$ ls
configuration.xsl  log4j.properties  zoo_sample.cfg
[hadoop@server2 conf]$ cp zoo_sample.cfg zoo.cfg
[hadoop@server2 conf]$ vim zoo.cfg 
server.1=172.25.76.2:2888:3888
server.2=172.25.76.3:2888:3888
server.3=172.25.76.4:2888:3888
[hadoop@server2 conf]$ scp zoo.cfg server3:/home/hadoop/zookeeper-3.4.9/conf
hadoop@server3's password: 
zoo.cfg