CentOS Hadoop 集群安装详细步骤

最新推荐文章于 2024-09-15 16:24:47 发布

weixin_42232484

最新推荐文章于 2024-09-15 16:24:47 发布

阅读量2.3k

点赞数

文章标签： hadoop centos zookeeper

本文链接：https://blog.csdn.net/weixin_42232484/article/details/123953349

版权

本文档详细介绍了如何在CentOS系统上安装配置Hadoop和Zookeeper集群，包括设置静态IP、时间同步、主机名与SSH配置、JDK安装、Hadoop与Zookeeper的配置和启动步骤，确保集群的正常运行。

摘要由CSDN通过智能技术生成

-------------------------设置固定IP
vi /etc/sysconfig/network-scripts/ifcfg-eth0
进入vi界面，按下键盘i键进入编辑状态，按方向键定位并修改如下信息：
BOOTPROTO=static
ONBOOT=yes
IPADDR=192.168.10.32 #网络IP地址
NETMASK=255.255.255.0 #网络子网地址
GATEWAY=192.168.10.1 #网关地址
DNS1=61.128.128.68
nmcli c reload
--------------------------同步时间
systemctl start chronyd
systemctl enable chronyd
vi /etc/chrony.conf
#pool 2.centos.pool.ntp.org iburst （这一行注释掉，增加以下两行）：
server ntp.aliyun.com iburst
server cn.ntp.org.cn iburst

systemctl restart chronyd.service
--------------------------预备
vi /etc/hosts
192.168.10.30 node1
192.168.10.31 node2
192.168.10.32 node3
192.168.10.33 node4

yum install -y tar
sudo systemctl stop firewalld.service
sudo systemctl disable firewalld.service
hostnamectl set-hostname node4

ssh-keygen -t rsa
每台机器
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node1
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node2
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node3
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node4
-----------------------JDK
/opt/
tar -xf jdk-8u202-linux-x64.tar.gz
vi /etc/profile
export JAVA_HOME=/opt/jdk1.8.0_202
export PATH=$PATH:$JAVA_HOME/bin
export ZOOKEEPER_HOME=/opt/zookeeper-3.7.0
export PATH=$PATH:$ZOOKEEPER_HOME/bin:$ZOOKEEPER_HOME/conf
export HADOOP_HOME=/opt/hadoop-3.3.1
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
source /etc/profile
----------------------zookeeper
/opt
cp zoo_sample.cfg zoo.cfg
vi zoo.cfg
dataDir=/opt/zookeeper-3.7.0/data
server.1=node1:2888:3888
server.2=node2:2888:3888
server.3=node3:2888:3888
zkServer.sh start