【Kafka】导入数据

集群配置：

node01：Zookeeper + Kafka
node02：Zookeeper
node03：Zookeeper

开启Zookeeper和Kafka

zkServer.sh start
cd $KAFKA_HOME
bin/kafka-server-start.sh config/server.properties

创建topic

didiOrder和didiGps分别创建一个分区一个副本（node01上操作）

> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic didiOrder
Created topic "didiOrder".

> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic didiGps
Created topic "didiGps".

bin/kafka-topics.sh --create --zookeeper nimbus:2181,zookeeper1:2181,zookeeper2:2181 --replication-factor 3 --partitions 3 --topic didiOrder

导入数据

> bin/kafka-console-producer.sh --broker-list 192.168.171.132:9092 --topic didiOrder30G < didiorder
> bin/kafka-console-producer.sh --broker-list 192.168.171.132:9092 --topic didiGps30G < didigps

消费消息

> bin/kafka-console-consumer.sh --bootstrap-server 192.168.171.101:9092 --topic didiGps --from-beginning    
# 若没有任何返回或没有响应，则该topic中没有数据内容；否则有

查看topic

bin/kafka-topics.sh  --list --zookeeper nimbus:2181

删除topic

bin/kafka-topics.sh --zookeeper nimbus:2181 --delete --topic topicName