实例环境
centos7.6
kafka_2.12-2.5.0.tgz
java8
环境准备
java环境安装:
centos7默认yum安装java8:yum install java -y
kafka包下载:
下载地址:https://mirrors.tuna.tsinghua.edu.cn/apache/kafka/
下载2.5.0版本:wget https://mirrors.tuna.tsinghua.edu.cn/apache/kafka/2.5.0/kafka_2.12-2.5.0.tgz
解压包:
tar -zvxf kafka_2.12-2.5.0.tgz
mv /opt/kafka_2.12-2.5.0 /opt/kafka
kafka配置启动
先启动zookeeper,再启动kafka:
cd /opt/kafka/bin
./zookeeper-server-start.sh ../config/zookeeper.properties
./kafka-server-start.sh ../config/server.properties
配置system服务启动:
vim /etc/systemd/system/zookeeper.service
[Unit]
Description=Apache Zookeeper server
Documentation=http://zookeeper.apache.org
Requires=network.target remote-fs.target
After=network.target remote-fs.target
[Service]
Type=simple
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-abnormal
User=root
Group=root
[Install]
WantedBy=multi-user.target
vim /etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka Server
Documentation=http://kafka.apache.org/documentation.html
Requires=zookeeper.service
[Service]
Type=simple
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-abnormal
[Install]
WantedBy=multi-user.target
启动服务:
systemctl start zookeeper #启动zookeeper
systemctl enable zookeeper #开机自启动
systemctl start kafka #启动kafka
systemctl enable kafka #开机自启动
kafka简单使用
创建topic:bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
查询topic:bin/kafka-topics.sh --list --zookeeper localhost:2181
查看topic详细信息:bin/kafka-topics.sh --describe --zookeeper localhost:2181 --topic test
产生消息:bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
消费消息:bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning
-----------日常记录---------------