Kafka bug 记录
问题描述:
Kafka集群在运行时蓝屏,意外宕机。重启后Kafka会自动挂掉。
报错信息:
[2021-09-28 20:21:52,487] WARN [RequestSendThread controllerId=0] Controller 0's connection to broker hadoop103:9092 (id: 1 rack: null) was unsuccessful (kafka.controller.RequestSendThread)
java.io.IOException: Connection to hadoop103:9092 (id: 1 rack: null) failed.
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:71)
at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:296)
at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:250)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
[2021-09-28 20:21:52,610] WARN [RequestSendThread controllerId=0] Controller 0's connection to broker hadoop103:9092 (id: 1 rack: null) was unsuccessful (kafka.controller.RequestSendThread)
java.io.IOException: Connection to hadoop103:9092 (id: 1 rack: null) failed.
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:71)
at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:296)
at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:250)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
[2021-09-28 20:21:52,841] WARN [RequestSendThread controllerId=0] Controller 0's connection to broker hadoop103:9092 (id: 1 rack: null) was unsuccessful (kafka.controller.RequestSendThread)
java.io.IOException: Connection to hadoop103:9092 (id: 1 rack: null) failed.
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:71)
at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:296)
at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:250)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
[2021-09-28 20:21:52,944] WARN [RequestSendThread controllerId=0] Controller 0's connection to broker hadoop103:9092 (id: 1 rack: null) was unsuccessful (kafka.controller.RequestSendThread)
java.io.IOException: Connection to hadoop103:9092 (id: 1 rack: null) failed.
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:71)
at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:296)
at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:250)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
[2021-09-28 20:21:53,047] WARN [RequestSendThread controllerId=0] Controller 0's connection to broker hadoop103:9092 (id: 1 rack: null) was unsuccessful (kafka.controller.RequestSendThread)
java.io.IOException: Connection to hadoop103:9092 (id: 1 rack: null) failed.
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:71)
at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:296)
at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:250)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
[2021-09-28 20:21:53,117] DEBUG The stop replica request (delete = false) sent to broker 1 is StopReplicaRequestInfo([Topic=__consumer_offsets,Partition=40,Replica=1],false),StopReplicaRequestInfo([Topic=topic_log,Partition=1,Replica=1],false),StopReplicaRequestInfo([Topic=topic_log,Partition=0,Replica=1],false),StopReplicaRequestInfo([Topic=__consumer_offsets,Partition=22,Replica=1],false),StopReplicaRequestInfo([Topic=__consumer_offsets,Partition=10,Replica=1],false),StopRepli