读取Kafka集群的消息

最新推荐文章于 2024-08-17 19:52:53 发布

在意一下

最新推荐文章于 2024-08-17 19:52:53 发布

阅读量911

点赞数

本文链接：https://blog.csdn.net/fduffyyg/article/details/84192596

版权

本文档详细介绍了如何从Kafka集群中读取消息，包括启动Zookeeper、本地启动多个Brokers、Producer如何写入消息到Topic以及Consumer如何读取指定Topic的所有消息。

摘要由CSDN通过智能技术生成

分享一下我老师大神的人工智能教程！零基础，通俗易懂！http://blog.csdn.net/jiangjunshow

也欢迎大家转载本篇文章。分享知识，造福人民，实现我们中华民族伟大复兴！

读取Kafka集群的消息

1. 先启动zookeeper
2. 本地启动多个brokers
3. producer产生多个消息，分布在一个topic的2个partition中
4. consumer读取所有brokers的指定topic的所有消息

1 先启动zookeeper

kafka安装包自带了zookeeper程序，很方便。进入bin目录，运行下面的脚本

[dean@dell_xps_13 bin]$ ./zookeeper-server-start.sh ../config/zookeeper.properties [2016-04-29 16:03:41,484] INFO Reading configuration from: ../config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)[2016-04-29 16:03:41,484] WARN Either no config or no quorum defined in config, running  in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)[2016-04-29 16:03:41,498] INFO Reading configuration from: ../config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)[2016-04-29 16:03:41,499] INFO Starting server (org.apache.zookeeper.server.ZooKeeperServerMain)[2016-04-29 16:03:41,503] INFO Server environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT (org.apache.zookeeper.server.ZooKeeperServer