Kafka集群搭建

搭建zookeeper集群

搭建kafka集群

1.解压安装包

tar -zxvf shared/kafka_2.11-0.11.0.1.tgz -C module/
mv kafka_2.11-0.11.0.1 kafka
mkdir logs
cd config/
vim server.properties

# 0,1,2
broker.id=0
delete.topic.enable=true

log.dirs=/opt/module/kafka/logs

zookeeper.connect=192.168.130.129:2181,192.168.130.130:2181,192.168.130.131:2181

#broker 的全局唯一编号，不能重复

#配置连接 Zookeeper 集群地址

配饰环境变量

 vim /etc/profile
source /etc/profile

export KAFKA_HOME=/opt/module/kafka
export PATH=$PATH:$KAFKA_HOME/bin

配置其他机器

修改broker.id 不能重复

启动集群

每台机器执行启动命令

kafka-server-start.sh -daemon config/server.properties

kafka命令

# 查看topic
kafka-topics.sh --zookeeper 192.168.130.129:2181 --list

# 创建topic
kafka-topics.sh --zookeeper 192.168.130.129:2181 --create --replication-factor 3 --partitions 1 --topic topic-hello

关闭kakfa

kafka-server-stop.sh stop