注意:先部署zookeeper服务,再部署kafka服务
kafka消息队列服务安装部署
基础环境:三台服务器:
IP1:192.168.37.21
IP2:192.168.37.22
IP3::192.168.37.23
说明:确保zookeeper集群已经在上面三台服务器上部署成功
一、安装jdk环境变量
参考地址:
https://blog.csdn.net/qq_35663625/article/details/98848947
二、安装kafka(三台机器都执行)
$ cd /data/service/ ##安装地址根据自己的实际情况而定
$ wget http://mirrors.tuna.tsinghua.edu.cn/apache/kafka/2.3.0/kafka_2.11-2.3.0.tgz
$ tar xf kafka_2.11-2.3.0.tgz
$ mv kafka_2.11-2.3.0 kafka
$ cd kafka
$ mkdir kafka-logs ##创建自定义日志文件
$ cd config/
$ vim server.properties ##修改下面四个参数
listeners = PLAINTEXT://192.168.37.21:9092 ##填写自己服务的实际IP,每台机器不一样
broker.id=1 ##第一台机器填1,第二台机器填2,第三台机器填3
log.dirs=/data/service/kafka/kafka-logs
zookeeper.connect=192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181
说明:如果是单机版的话,默认即可,我们什么都不需要改动。现在我们是要配置集群,所以需要配置一些参数
1、broker.id:每台机器不能一样;
2、zookeeper.connect:因为是3台zookeeper服务器,所以在这里zookeeper.connect设置为3台;
三、启动kafka(前提是先启动了zookeeper)
$ /data/service/kafka/bin/kafka-server-start.sh -daemon /data/service/kafka/config/server.properties
四、jps命令检查是否启动成功
五、模拟创建topic,查看topic
#############创建topic
$ /data/service/kafka/bin/kafka-topics.sh --create --zookeeper 192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181 --replication-factor 2 --partitions 1 --topic test
Created topic "test".
#############查看topic
$ /data/service/kafka/bin/kafka-topics.sh --list --zookeeper 192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181
test
#####zookeeper里面查看topic
$ /data/service/zookeeper-3.5.5/bin/zkCli.sh -server 192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181
[zk: 192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181(CONNECTED) 0] ls /
[admin, brokers, cluster, config, consumers, controller, controller_epoch, isr_change_notification, latest_producer_id_block, log_dir_event_notification, zookeeper]
[zk: 192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181(CONNECTED) 1] ls /brokers
[ids, seqid, topics]
[zk: 192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181(CONNECTED) 2] ls /brokers/topics
[test, test1, test2]
[zk: 192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181(CONNECTED) 3] ls /brokers/topics/test
test test1 test2
[zk: 192.168.37.21:2181,192.168.37.22:2181,192.168.37.23:2181(CONNECTED) 3] ls /brokers/topics/test
[partitions]
zookeeper安装部署参考上一篇博客:
https://blog.csdn.net/qq_35663625/article/details/98848947
好了,这就是kafka消息队列服务安装部署的方法了,如有问题可与博主交流讨论!