集群配置:
node01:Zookeeper + Kafka
node02:Zookeeper
node03:Zookeeper
开启Zookeeper和Kafka
zkServer.sh start
cd $KAFKA_HOME
bin/kafka-server-start.sh config/server.properties
创建topic
didiOrder和didiGps分别创建一个分区一个副本(node01上操作)
> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic didiOrder
Created topic "didiOrder".
> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic didiGps
Created topic "didiGps".
bin/kafka-topics.sh --create --zookeeper nimbus:2181,zookeeper1:2181,zookeeper2:2181 --replication-factor 3 --partitions 3 --topic didiOrder
导入数据
> bin/kafka-console-producer.sh --broker-list 192.168.171.132:9092 --topic didiOrder30G < didiorder
> bin/kafka-console-producer.sh --broker-list 192.168.171.132:9092 --topic didiGps30G < didigps
消费消息
> bin/kafka-console-consumer.sh --bootstrap-server 192.168.171.101:9092 --topic didiGps --from-beginning
# 若没有任何返回或没有响应,则该topic中没有数据内容;否则有
查看topic
bin/kafka-topics.sh --list --zookeeper nimbus:2181
删除topic
bin/kafka-topics.sh --zookeeper nimbus:2181 --delete --topic topicName