kafka系列-kafka常用操作

假设现在kafka有3个节点

master60:2181,node61:2181,node62:2181

cd $kafkaPath

列出kafka所有的topic

./bin/kafka-topics.sh --zookeeper master60:2181,node61:2181,node62:2181 -list

查看kafka某一topic的描述

./bin/kafka-topics.sh --describe --zookeeper master60:2181 --topic topic-train

查看kafka的某一队列的某一组的消费信息（offset保存在zk）

./bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --group kafka-consumer-1 --topic topic-user --zookeeper master60:2181,node61:2181,node62:2181

删除topic-user（清除保存在zk的offset）

bin/kafka-topics.sh --delete --zookeeper master60:2181,node61:2181,node62:2181 --topic topic-user

bin/kafka-topics.sh --zookeeper master60:2181,node61:2181,node62:2181 -list

cd $zookeeperPath/bin

./zkCli.sh

ls /consumers

rmr /consumers/kafka-consume-*

ls /brokers/topics

rmr /brokers/topics/topic-user

ls /admin/delete_topics

rmr /admin/delete_topics/topic-user

ls /config/topics

rmr /config/topics/topic-user

quit

然后在master60，node61，node62分别操作

cd /home/var/local/kafka/data/

rm -rf topic-user-*

创建topic test

bin/kafka-topics.sh --create --zookeeper master60:2181,node61:2181,node62:2181 --replication-factor 1 --partitions 3 --topic test

bin/kafka-console-consumer.sh --topic __consumer_offsets --zookeeper master60:2181,node61:2181,node62:2181 --from-beginning

bin/kafka-console-consumer.sh --zookeeper master60:2181,node61:2181,node62:2181 --topic topic-user --from-beginning