kafka集群安装（独立zookeeper集群）

1 集群环境

192.168.100.200

192.168.100.201

192.168.100.202

2 按照步骤

[root@localhost local]# tar -zxvf kafka_2.11-0.10.1.0.tgz

[root@localhost local]# cd kafka_2.11-0.10.1.0/

[root@localhost kafka_2.11-0.10.1.0]# mkdir logs

[root@localhost kafka_2.11-0.10.1.0]# cd config/

[root@localhost config]# vi server.properties

         broker.id=0

         listeners=PLAINTEXT://192.168.100.200:9092

         advertised.listeners=PLAINTEXT://192.168.100.200:9092

         log.dirs=/usr/local/kafka_2.11-0.10.1.0/logs/

         zookeeper.connect=192.168.100.200:2181,192.168.100.201:2181,192.168.100.202:2181

[root@localhost local]# scp -r /usr/local/kafka_2.11-0.10.1.0 192.168.100.201:/usr/local/

[root@localhost local]# scp -r /usr/local/kafka_2.11-0.10.1.0 192.168.100.202:/usr/local/

在其它两个节点上修改

         broker.id=1

         listeners=PLAINTEXT://192.168.100.201:9092

         advertised.listeners=PLAINTEXT://192.168.100.201:9092

         broker.id=2

         listeners=PLAINTEXT://192.168.100.202:9092

         advertised.listeners=PLAINTEXT://192.168.100.202:9092

启动（每一个节点）

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-server-start.sh -daemon /usr/local/kafka_2.11-0.10.1.0/config/server.properties &

[root@localhost kafka_2.11-0.10.1.0]# jps

进程名为Kafka

3 验证

创建一个主题wangyl，备份3，分区2

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --create --topic wangyl  --replication-factor 3 --partitions 2 --zookeeper 192.168.100.200:2181

查看主题

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --list --zookeeper 192.168.100.200:2181

生产消费模式验证

生产端

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-console-producer.sh --broker-list 192.168.100.200:9092 --sync --topic wangyl

消费端

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-console-consumer.sh --zookeeper 192.168.100.200:2181 --topic  wangyl --from-beginning

列出该主题的详细信息

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --describe --zookeeper 192.168.100.200:2181 --topic wangyl