centos7搭建kafka集群
之前没有接触过kafka,公司让做kafka性能测试,所以顺便学习了一下,接下来的几篇文章按照我的学习路线展开。今天分享一下基于centos7的kafka集群搭建。
三台物理机
node-1 192.168.1.108 centos7
node-2 192.168.1.109 centos7
node-3 192.168.1.110 centos7
Step1. 三台物理机均配置jdk环境
- 下载jdk安装包
(1)去官网下载jdk-8u221-linux-x86.tar.gz安装包
官网地址为:jdk安装包下载地址
下载需要账号密码,这位大佬给共享了可用的账号密码
下载之后解压到指定位置:/usr/local,然后执行以下操作:
# cd /usr/local
# tar -zxvf jdk-8u221-linux-x86.tar.gz
# mv jdk1.8.0_221 jdk1.8
# vim /etc/profile
export JAVA_HOME=/usr/local/jdk1.8
export CLASSPATH=.:${JAVA_HOME}/jre/lib/rt.jar:${JAVA_HOME}/lib/dt.jar:${JAVA_HOME}/lib/tools.jar
export PATH=$PATH:${JAVA_HOME}/bin
# source /etc/profile
验证jdk是否安装成功
#java -version
Step2. 三台物理机均安装zookeeper
# wget http://archive.apache.org/dist/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
# tar -zxvf zookeeper-3.4.6.tar.gz
# mv zookeeper-3.4.6 zookeeper
# cd zookeeper
# mkdir data
# mkdir logs
# cd data
# vim myid
1(node-1上为1,node-2上为2,node-3上为3)
# cd /usr/local/zookeeper/conf
# cp zoo_sample.cfg zoo.cfg
# vi zoo.cfg
dataDir=/usr/local/zookeeper/data
dataLogDir=/usr/local/zookeeper/logs
server.1=192.168.1.108:2888:3888
server.2=192.168.1.109:2888:3888
server.3=192.168.1.110:2888:3888
# cd /usr/local/zookeeper/bin
# cd /usr/local/zookeeper/bin
#####启动zookeeper
# ./zkServer.sh start ../conf/zoo.cfg
# ./zkServer.sh status
Step3. 三台物理机均安装kafka
# cd /usr/local
# wget https://archive.apache.org/dist/kafka/1.1.0/kafka_2.11-1.1.0.tgz
# tar -zxvf kafka_2.11-1.1.0.tgz
# mv kafka_2.11-1.1.0 kafka
# vi /etc/profile
export KAFKA_HOME=/usr/local/kafka
export PATH=${KAFKA_HOME}/bin:$PATH
# source /etc/profile
# cd kafka
# vi server.properties
broker.id=1
log.dirs=/tmp/kafka_log
listeners=PLAINTEXT://localhost:9092
zookeeper.connect=192.168.1.108:2181,192.168.1.109:2181,192.168.1.110:2181
#####启动kafka
# cd /usr/local/kafka/bin
# /kafka-server-start.sh -daemon config/server.properties
#####验证是否启动成功
# jps(看是否已经启动kafka进程)
搭建完成!
参考链接
https://www.freesion.com/article/1862939312/
https://www.imooc.com/article/262018