kafka故障

这篇博客介绍了在使用Kafka 1.1.0时遇到的两个常见故障及其解决方案。一是配置的broker.id与meta.properties中的不匹配,解决方法包括修改server.properties和meta.properties文件。二是Socket服务器无法绑定到指定IP和端口,通过在server.properties中添加port参数来修复。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

(1)Configured broker.id 3 doesn't match stored broker.id 2 in meta.properties

版本:kafka 1.1.0

操作:修改server.properties中的broker id 
一般会得到如下错误:

[2018-07-18 11:05:14,825] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
kafka.common.InconsistentBrokerIdException: Configured broker.id 3 doesn't match stored broker.id 2 in meta.properties. If you moved your data, make sure your configured broker.id matches. If
     you intend to create a new broker, you should remove all data in your data directories (log.dirs).
     at kafka.server.KafkaServer.getBrokerIdAndOfflineDirs(KafkaServer.scala:673)
     at kafka.server.KafkaServer.startup(KafkaServer.scala:209)
     at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
     at kafka.Kafka$.main(Kafka.scala:92)
     at kafka.Kafka.main(Kafka.scala)
 [2018-07-18 11:05:14,842] INFO shutting down (kafka.server.KafkaServer)
 [2018-07-18 11:05:14,846] WARN  (kafka.utils.CoreUtils$)
 java.lang.NullPointerException
     at kafka.server.KafkaServer.$anonfun$shutdown$6(KafkaServer.scala:569)
     at kafka.utils.CoreUtils$.swallow(CoreUtils.scala:85)
     at kafka.server.KafkaServer.shutdown(KafkaServer.scala:569)
     at kafka.server.KafkaServer.startup(KafkaServer.scala:326)
     at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
     at kafka.Kafka$.main(Kafka.scala:92)
     at kafka.Kafka.main(Kafka.scala)
 [2018-07-18 11:05:14,854] INFO [ZooKeeperClient] Closing. (kafka.zookeeper.ZooKeeperClient)

更正办法:手动修改meta.properties文件,在配置的log.dir下

vim /data1/platform/kafka/meta.properties 

如果你想改kafka的broker id,比如第一遍写错了,应该遵循两个步骤: 
1. 改server.prorperties文件配置; 
2. 改meta.properties,默认情况下,应该在/tmp/kafka-logs目录下; 
同时需注意数据存在多个目录时,需要修改多个目录的meta.propertie。

(2)kafka.common.KafkaException: Socket server failed to bind to 192.168.17.64:9092: 无法指定被请求的地址.

错误报告:

 kafka.common.KafkaException: Socket server failed to bind to 192.168.17.64:9092: 无法指定被请求的地址.
     at kafka.network.Acceptor.openServerSocket(SocketServer.scala:404)
     at kafka.network.Acceptor.<init>(SocketServer.scala:308)
     at kafka.network.SocketServer.$anonfun$createAcceptorAndProcessors$1(SocketServer.scala:126)
     at kafka.network.SocketServer.$anonfun$createAcceptorAndProcessors$1$adapted(SocketServer.scala:122)
     at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:59)
     at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:52)
     at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
     at kafka.network.SocketServer.createAcceptorAndProcessors(SocketServer.scala:122)
     at kafka.network.SocketServer.startup(SocketServer.scala:84)
     at kafka.server.KafkaServer.startup(KafkaServer.scala:247)
     at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
     at kafka.Kafka$.main(Kafka.scala:92)
     at kafka.Kafka.main(Kafka.scala)

更改方法:在所有机器的server.properties中添加port参数

port=9092

说明:listeners表示非kafka集群内的机器访问kafka

listeners = PLAINTEXT://192.168.17.134:9092

 

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值