安装kafka2.7.0

说明

记一次安装kafka记录, 内容参考: https://www.cnblogs.com/zhaoshizi/p/12154518.html

什么是kafka

Kafka是由Apache软件基金会开发的一个开源流处理平台，由Scala和Java编写。Kafka是一种高吞吐量的分布式发布订阅消息系统，它可以处理消费者在网站中的所有动作流数据。
------ 来源百度百科

下载kafka2.7.0

• 下载页面

https://kafka.apache.org/downloads

• bash下载

:~$ wget https://downloads.apache.org/kafka/2.7.0/kafka_2.12-2.7.0.tgz

安装kafka

• 解压到指定文件夹

:~$ ls -al | grep 'kafka'
-rw-rw-r--  1 *** ***  68684719  1月 24 15:32 kafka_2.12-2.7.0.tgz
:~$ sudo tar -zxvf ./kafka_2.12-2.7.0.tgz -C /opt/
.
.

• 修改文件权限

:~$ cd /opt/
:/opt$ sudo chgrp -R root ./kafka_2.12-2.7.0/
:/opt$ sudo chown -R root ./kafka_2.12-2.7.0/
:/opt$ cd ./kafka_2.12-2.7.0/
:/opt/kafka_2.12-2.7.0$

启动kafka

– 启动Zookeeper

:/opt/kafka_2.12-2.7.0$ ./bin/zookeeper-server-start.sh -daemon ./config/zookeeper.properties
mkdir: cannot create directory ‘/opt/kafka_2.12-2.7.0/bin/../logs’: Permission denied
/opt/kafka_2.12-2.7.0/bin/kafka-run-class.sh: line 316: /opt/kafka_2.12-2.7.0/bin/../logs/zookeeper.out: No such file or directory
:/opt/kafka_2.12-2.7.0$ sudo mkdir -p ./logs/
:/opt/kafka_2.12-2.7.0$ sudo chgrp -R ***(${UAER_GROUP}) ./logs/
:/opt/kafka_2.12-2.7.0$ sudo chown -R ***(${UAER_GROUP}) ./logs/
:/opt/kafka_2.12-2.7.0$ ./bin/zookeeper-server-start.sh -daemon ./config/zookeeper.properties
:/opt/kafka_2.12-2.7.0$ 

• 关闭Zookeeper

:/opt/kafka_2.12-2.7.0$ ./bin/zookeeper-server-stop.sh -daemon ./config/zookeeper.properties
:/opt/kafka_2.12-2.7.0$ 

– 启动kafka

:/opt/kafka_2.12-2.7.0$ ./bin/kafka-server-start.sh -daemon ./config/server.properties
:/opt/kafka_2.12-2.7.0$ 

– 停止kafka

:/opt/kafka_2.12-2.7.0$ ./bin/kafka-server-stop.sh ./config/server.properties
:/opt/kafka_2.12-2.7.0$ 

测试kafka

• 创建并查看topic

:/opt/kafka_2.12-2.7.0$ ./bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
Created topic test.
:/opt/kafka_2.12-2.7.0$ ./bin/kafka-topics.sh --list --zookeeper localhost:2181
test

• 发送消息

:/opt/kafka_2.12-2.7.0$ ./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
>test
>

• 接收消息

:/opt/kafka_2.12-2.7.0$ ./bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning
test

• 查看topic&删除topic

:/opt/kafka_2.12-2.7.0$ ./bin/kafka-topics.sh --zookeeper localhost:2181 --describe  --topic test
Topic: test	PartitionCount: 1	ReplicationFactor: 1	Configs: 
	Topic: test	Partition: 0	Leader: 0	Replicas: 0	Isr: 0
:/opt/kafka_2.12-2.7.0$ ./bin/kafka-topics.sh --zookeeper localhost:2181 --delete  --topic test
Topic test is marked for deletion.
Note: This will have no impact if delete.topic.enable is not set to true.