一、前期准备:
docker搭建hadoop集群环境之Dockerfile编写
docker搭建hadoop集群环境之镜像建立与运行
docker搭建hadoop集群环境之配置ssh免密登录
二、zookeeper配置(5个容器均进行此操作)
进入zookeeper目录:
cd /root/zookeeper/
创建data和logs文件夹:
mkdir data
mkdir logs
进入data文件夹:
cd data
新建myid文件并写入id号(hadoop01:id号’1’,hadoop02:id号’2’,hadoop03:id号’3’,hadoop04:id号’4’,hadoop05:id号’5’)
echo '1'>myid
echo '2'>myid
echo '3'>myid
echo '4'>myid
echo '5'>myid
进入conf文件夹并将zoo_sample.cfg复制为zoo.cfg
cd /root/zookeeper/conf/
cp zoo_sample.cfg zoo.cfg
修改zoo.cfg文件
vim zoo.cfg
修改项如下:
dataDir=/root/zookeeper/data
在文件末尾增加:
dataLogDir=/root/zookeeper/logs
server.1=hadoop01:2888:3888
server.2=hadoop02:2888:3888
server.3=hadoop03:2888:3888
server.4=hadoop04:2888:3888
server.5=hadoop05:2888:3888
启动zookeeper:
(5个节点均要执行)
zkServer.sh start
看到下列输出,则启动成功:
查看zookeeper状态:
zkServer.sh status
5个节点情况如下,由于zookeeper选举机制,leader和follower不一定如图所示。
hadoop01:
hadoop02:
hadoop03:
hadoop04:
hadoop05: