创建kafka topic
bin/kafka-topics.sh --create --topic topicname --replication-factor 1 --partitions 1 --zookeeper localhost:2181
查询topic,进入kafka目录:
bin/kafka-topics.sh --list --zookeeper localhost:2181
查询topic内容:
bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic topicName --from-beginning
往topics中写入数据
./bin/kafka-console-producer.sh --topic topicName --broker-list u210:9092
实际项目应用:
- 调度项目kafka存储地址
/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/kafka$
- 查看topic列表(zk是2181端口,broker是9092端口)
bin/kafka-topics.sh --list --zookeeper ck234:2181/kafka
- kafka生产
bin/kafka-console-producer.sh --broker-list 10.9.20.234:9092 --topic kafka_spark
- kafka消费
bin/kafka-console-consumer.sh --bootstrap-server ck234:9092 --topic flink-kafka --group flinkmysql