架构图(原理自己百度):
服务规划:
hostname | ip | zookeeper | hdfs | journalnode | rm | zkfc |
node03 | 192.168.0.3 | master | datanode | *:8088 | ||
node04 | 192.168.0.4 | follower | datanode | *:8485 | ||
node05 | 192.168.0.5 | follower | datanode | *:8485 | ||
node06 | 192.168.0.6 | datanode | *:8485 | *:8088 | ||
node07 | 192.168.0.7 | namenode:8082(rpc)/50070(http) | * | |||
node08 | 192.168.0.8 | namenode:8082/50070 | * |
临时关防火墙
在每个节点上执行:systemctl stop firewalld
这个命令是临时关闭,如果重启就失效了,永久关闭可以自行百度找到方法
zookeeper部署 :
下载zookeeper
wget https://dlcdn.apache.org/zookeeper/zookeeper-3.8.0/apache-zookeeper-3.8.0-bin.tar.gz
解压
tar -zxvf zookeeper.xxx.tar
配置
进入zookeeper下的conf目录,复制zoo_sample.cfg文件(cp zoo_sample.cfg zoo.cfg)
vim zoo.cfg
# the port at which the clients will connect
# 客户端访问端口
clientPort=2181
# 集群配置1,2,3服务id;node03(hostname或者ip):2182(集群间通信端口):2183(选举通讯端口)
## Metrics Providers
server.1=node03:2182:2183
server.2=node04:2182:2183
server.3=node05:2182:2183
配置服务id
进入z