kafka之分布式集群搭建

最新推荐文章于 2024-07-04 11:28:51 发布

爱你魔力转圈圈

最新推荐文章于 2024-07-04 11:28:51 发布

阅读量123

点赞数

分类专栏： kafka 文章标签： kafka 大数据

本文链接：https://blog.csdn.net/qq_42706464/article/details/107891082

版权

kafka 专栏收录该内容

11 篇文章 0 订阅

订阅专栏

kafka集群搭建

1.解压
2.环境变量
3.server.properties
4.log4j.properties
5.启动
6.集群的启停脚本

1.解压

sudo chmod 777 kafka_2.13-2.5.0.tgz
sudo tar -zxvf kafka_2.13-2.5.0.tgz -C /home/hdfs/software

sudo ln -s kafka_2.13-2.5.0 kafka

2.环境变量

sudo vi /etc/profile

export KAFKA_HOME=/home/hdfs/software/kafka
export PATH= $P A T H :$ KAFKA_HOME/bin

source /etc/profile

3.server.properties

sudo mkdir /home/hdfs/software/kafka/data
sudo chown hdfs:root -R /home/hdfs/software/kafka/data
sudo chmod 777 /home/hdfs/software/kafka/data

cd kafka/config
sudo vi server.properties

broker.id=1

log.dirs=/home/hdfs/software/kafka/data
zookeeper.connect=192.168.157.132:2181,192.168.157.133:2181,192.168.157.134:2181

4.log4j.properties

sudo mkdir /home/hdfs/software/kafka/logs
sudo chown hdfs:root -R /home/hdfs/software/kafka/logs
sudo chmod 777 /home/hdfs/software/kafka/logs
sudo vi log4j.properties

替换
${kafka.logs.dir}=====>/home/hdfs/software/kafka/logs

5.启动

sudo bin/kafka-server-start.sh -daemon config/server.properties
sudo bin/kafka-server-stop.sh

6.集群的启停脚本

sudo vi kk.sh

#!/bin/bash
case $1 in

"start"){
for i in 192.168.157.132 192.168.157.133 192.168.157.134
do
   echo "***************$i***************"
   ssh $i "source /etc/profile;/home/hdfs/software/kafka/bin/kafka-server-start.sh -daemon  /home/hdfs/software/kafka/config/server.properties"
done
};;

"stop"){
for i in 192.168.157.132 192.168.157.133 192.168.157.134
do
   echo "***************$i***************"
   ssh $i "/home/hdfs/software/kafka/bin/kafka-server-stop.sh /home/hdfs/software/kafka/config/server.properties"
done
};;
esac