kafka_2.12-2.1.0 消费者设置最新offset，跳过历史数据，从最新的数据开始消费

最新推荐文章于 2024-09-06 11:39:05 发布

百里山川

最新推荐文章于 2024-09-06 11:39:05 发布

阅读量8.5k

点赞数

本文链接：https://blog.csdn.net/qq_37670707/article/details/89677599

版权

/**
*
* <跳过历史数据，从最新的数据开始消费>
*
* @param consumer
* @param topic
* @throws
*/
public static void assignOffset(KafkaConsumer<String, String> consumer) {
if (consumer == null) {
return;
}
Map<TopicPartition, OffsetAndMetadata> offsetMap = new HashMap<TopicPartition, OffsetAndMetadata>();
consumer.poll(100);
Set assignment = consumer.assignment();
consumer.seekToEnd(assignment);
for (TopicPartition topicPartition : assignment) {
long position = consumer.position(topicPartition);
offsetMap.put(topicPartition, new OffsetAndMetadata(position));
consumer.commitAsync(offsetMap, null);
}
}