kafka Commit cannot be completed since the group has already rebalanced and assigned the partitions

k8s helm 部署 kafka集群,启动一个producer ,再起一个consumer, 报错如下

root@kafka-0:/#  kafka-console-consumer --topic test --bootstrap-server kafka-headless.flink.svc.cluster.local:9092
[2021-12-10 06:20:04,901] ERROR [Consumer clientId=consumer-1, groupId=console-consumer-46805] Offset commit failed on partition test-1 at offset 3: The request timed out. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
^C^C^C^C[2021-12-10 06:20:32,637] ERROR [Consumer clientId=consumer-1, groupId=console-consumer-46805] Offset commit failed on partition test-1 at offset 3: The coordinator is not aware of this member. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2021-12-10 06:20:32,637] WARN [Consumer clientId=consumer-1, groupId=console-consumer-46805] Synchronous auto-commit of offsets {test-1=OffsetAndMetadata{offset=3, metadata=''}, test-0=OffsetAndMetadata{offset=4, metadata=''}, test-2=OffsetAndMetadata{offset=2, metadata=''}} failed: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
producer
root@kafka-0:/# kafka-console-producer --topic test --broker-list kafka-headless.flink.svc.cluster.local:9092

在这里插入图片描述

consumer
root@kafka-0:/#  kafka-console-consumer --topic test --bootstrap-server kafka-headless.flink.svc.cluster.local:9092

在这里插入图片描述

参考:https://www.cnblogs.com/zhuguangzhe/p/11424460.html

一个consumer在生产消息,另一个consumer在消费它的消息,他们不能在一个groupid 下面,更改其中一个的group id 即可
在这里插入图片描述
#########################

1 partitions have leader brokers without a matching listener, including [test-0] (org.apache.kafka.clients.NetworkClient)

在这里插入图片描述
在这里插入图片描述
一个kafka pod宕了、待其重启后,恢复正常…

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值