kafka

kafka学习

一、什么是kafka

二、kafka的优势

三、kafka环境搭建

3.1、官网 https://kafka.apache.org/downloads下载二进制压缩包，解压到任意磁盘位置。

3.2、window搭建单机伪集群

1、将解压得到的文件复制三份，分别命名kafka1， kafka2和kafka3。
2、启动zookeeper
第一步：分配端口
clientPort 2181 / 2182 / 2183
server.1=192.168.3.2:6010:6001
server.2=192.168.3.2:6011:6002
server.3=192.168.3.2:6012:6003
第二步：分别配置3个节点的config/zookeeper.properties

# disable the per-ip limit on the number of connections since this is a non-production config
maxClientCnxns=0
# Disable the adminserver by default to avoid port conflicts.
# Set the port to something non-conflicting if choosing to enable this
admin.enableServer=false
# admin.serverPort=8080
#initLimit is timeouts ZooKeeper uses to limit the length of time the ZooKeeper servers in quorum have to connect to a leader.
initLimit=10
#syncLimit limits how far out of date a server can be from a leader.
syncLimit=5
# the directory where the snapshot is stored.
dataDir=D:\\learn\\kafka\\cluster\\kafka1\\data\\zookeeper
# the port at which the clients will connect
clientPort=2181
# server.id=ip:通信端口:选举端口
server.1=192.168.3.2:6010:6001
server.2=192.168.3.2:6011:6002
server.3=192.168.3.2:3030:3031

第三步：在每个节点下的该目录下创建一个myid文件，里面分别写入1、2、3。
第四步：启动每个节点的zookeeper
`zookeeper-server-start.bat …/…/config/zookeeper.properties
3、启动kafka
第一步：分配端口
kaffka监听端口：9092 / 9093 / 9094
第二步：配置config/server.properties
主要配置

# The id of the broker. This must be set to a unique integer for each broker.
broker.id=1
listeners=PLAINTEXT://192.168.2.3:9092
# A comma separated list of directories under which to store log files
log.dirs=D:\\learn\\kafka\\cluster\\kafka1\\data\\kafka
# Zookeeper connection string (see zookeeper docs for details).
# This is a comma separated host:port pairs, each corresponding to a zk
# server. e.g. "127.0.0.1:3000,127.0.0.1:3001,127.0.0.1:3002".
# You can also append an optional chroot string to the urls to specify the
# root directory for all kafka znodes.
zookeeper.connect=192.168.3.2:2181, 192.168.3.2:2182, 192.168.3.2:2183

第三步 启动kafka

kafka-server-start.bat ../../config/server.properties

3、命令行测试

查询topic。因为还没创建，所以是空的

kafka-topics.bat --bootstrap-server 192.168.3.2:9092  --list

创建topic quickstart-events

kafka-topics.bat --bootstrap-server 192.168.3.2:9094 --create --topic quickstart-events

查看topic quickstart-events

kafka-topics.bat --bootstrap-server 192.168.3.2:9094 --describe --topic quickstart-events

删除topic quickstart-events

kafka-topics.bat --bootstrap-server 192.168.3.2:9094 --delete --topic quickstart-events

待完善…