APACHE KAFKA之基础

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.
kafka是开源的分布式事件流平台，被成千上万的公司用于高性能数据管道，数据流分析，数据集成和关键任务的应用程序。

安装kafka

下载最新版本kafka

windows环境下修改路径

1. zookeeper.properties

dataDir=D:\\kafka_2.13-2.8.0\\bin\\windows

2. server.properties

log.dirs=D:\\kafka_2.13-2.8.0\\bin\\windows\\logs

启动后系统自动创建两个目录，其中logs存放日志，version-2存放镜像文件

启动kafka

启动zookeeper

zookeeper-server-start ..\..\config\zookeeper.properties

启动Server

kafka-server-start ..\..\config\server.properties

创建topic

D:\kafka_2.13-2.8.0\bin\windows>kafka-topics.bat --create --zookeeper localhost:2181 
--replication-factor 1 --partition 1 --topic kafka-topic-test

Created topic kafka-topic-test.

D:\kafka_2.13-2.8.0\bin\windows>kafka-topics --list --zookeeper localhost:2181

kafka-topic-test

通讯

生产者

D:\kafka_2.13-2.8.0\bin\windows>kafka-console-consumer --bootstrap-server localhost:9092 
--topic kafka-topic-test --from-beginning
Hello world!

默认Broker的地址和端口

producer.properties

format: host1:port1,host2:port2 …

bootstrap.servers=localhost:9092

消费者

D:\kafka_2.13-2.8.0\bin\windows>kafka-console-consumer --bootstrap-server localhost:9092 
--topic kafka-topic-test --from-beginning
Hello world!