kafka操作命令

创建topic

[root@master01 ~]# kafka-topics --create --zookeeper master01:2181 --replication-factor 1 --partitions 1 --topic car
19/04/25 15:04:06 INFO zookeeper.ClientCnxn: Socket connection established, initiating session, client: /192.168.108.81:41457, server: master01/192.168.108.81:2181
19/04/25 15:04:06 INFO zookeeper.ClientCnxn: Session establishment complete on server master01/192.168.108.81:2181, sessionid = 0x16a4ea1469b09ed, negotiated timeout = 30000
19/04/25 15:04:06 INFO zkclient.ZkClient: zookeeper state changed (SyncConnected)
19/04/25 15:04:06 INFO admin.AdminUtils$: Topic creation {"version":1,"partitions":{"0":[256]}}
Created topic "car".
19/04/25 15:04:06 INFO zkclient.ZkEventThread: Terminate ZkClient event thread.
19/04/25 15:04:06 INFO zookeeper.ZooKeeper: Session: 0x16a4ea1469b09ed closed
19/04/25 15:04:06 INFO zookeeper.ClientCnxn: EventThread shut down

查看topic

[root@master01 ~]# kafka-topics --zookeeper master01:2181 --describe --topic car
19/04/25 15:07:21 INFO zookeeper.ClientCnxn: Socket connection established, initiating session, client: /192.168.108.81:41972, server: master01/192.168.108.81:2181
19/04/25 15:07:21 INFO zookeeper.ClientCnxn: Session establishment complete on server master01/192.168.108.81:2181, sessionid = 0x16a4ea1469b09f6, negotiated timeout = 30000
19/04/25 15:07:21 INFO zkclient.ZkClient: zookeeper state changed (SyncConnected)
Topic:car	PartitionCount:1	ReplicationFactor:1	Configs:
	Topic: car	Partition: 0	Leader: 256	Replicas: 256	Isr: 256
19/04/25 15:07:21 INFO zkclient.ZkEventThread: Terminate ZkClient event thread.
19/04/25 15:07:21 INFO zookeeper.ZooKeeper: Session: 0x16a4ea1469b09f6 closed
19/04/25 15:07:21 INFO zookeeper.ClientCnxn: EventThread shut down

消费者

[root@slave02 ~]# kafka-console-consumer --zookeeper master01:2181 --topic car --from-beginning

[root@slave02 ~]# ./kafka-console-consumer.sh --bootstrap-server master01:9092 --topic car --from-beginning --group group1

生产者

[root@master01 ~]# kafka-console-producer --broker-list master01:9092 --topic car

增加分区

kafka-topics.sh --zookeeper master01:2181  --alte  --topic car  --partitions 4

删除主题

kafka-topics.sh --zookeeper master01:2181  --delete  --topic car

列出主题

kafka-topics.sh --zookeeper master01:2181  --list

列出主题的详细信息

kafka-topics.sh --zookeeper master01:2181  --describe

列出消费者群主

kafka-consumer-groups.sh --zookeeper master01:2181 --list（旧版本）
kafka-consumer-groups.sh --new-consumer ---bootstrap-server master01:9092 --list（新版本）

列出消费者群主详细信息

kafka-consumer-groups.sh --zookeeper master01:2181 --describe --group testgroup

删除消费者群主

kafka-consumer-groups.sh --zookeeper master01:2181  --delete --group testgroup

删除消费者群主topic的偏移量

kafka-consumer-groups.sh --zookeeper master01:2181  --delete --group testgroup --topic my-topic

查询某个topic的偏移量

kafka-consumer-offset-checker.sh --zookeeper master01:2181 --topic my-topic --group testgroup 

导出偏移量

kafka-run-class.sh kafka.tools.ExportZkOffsets --zkconnect master01:2181 --group testgroup --output-file offsets.txt

导入偏移量

kafka-run-class.sh kafka.tools.ImportZkOffsets --zkconnect master01:2181 --group testgroup --input-file offsets.txt

垃圾回收器选项

• MaxGCPauseMillis：每次垃圾回收默认停顿时间，默认200ms
• InitiatingHeapOccupancyPercent：启动垃圾回收之前可以使用的堆内存百分比，默认是45（45%）
• 修改方式：

-XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true”

[root@slave02 ~]# kafka-server-start.sh -daemon config/server.preporties