kafka-python 操作备忘

最新推荐文章于 2022-03-06 10:37:16 发布

Xiaohuansong

最新推荐文章于 2022-03-06 10:37:16 发布

阅读量409

点赞数

分类专栏： python笔记

本文链接：https://blog.csdn.net/sinat_15793123/article/details/82110316

版权

python笔记专栏收录该内容

3 篇文章 0 订阅

订阅专栏

手动设置偏移量数据

from kafka import KafkaConsumer
from kafka import TopicPartition

tp = TopicPartition(topic='test-pos-kafka-python', partition=0)

consumer = KafkaConsumer(bootstrap_servers="kafka1.local.zichan360.com:9092,kafka2.local.zichan360.com:9092,kafka3.local.zichan360.com:9092")

consumer.assign([tp])
print consumer.partitions_for_topic("test-pos-kafka-python")
print consumer.assignment()
# 从topic test-pos-kafka-python 的400偏移量开始 重新消费
consumer.seek(tp, 400)
print consumer.position(tp)
for msg in consumer:
    print msg.value, msg.partition, msg.offset