kafka自动宕机问题解决

在Spark和Flink项目运行中,遇到Kafka集群频繁宕机的问题。排查日志后发现所有节点的myid配置相同,原因是使用`xsync`工具错误地同步了配置文件,导致所有机器上的myid都变成了'2',破坏了Kafka集群的正确配置。解决方法是修正各节点的myid配置,确保集群中每台机器的角色配置独一无二。
摘要由CSDN通过智能技术生成

最近在做Spark和Flink项目的时候,总是发现Kafka在启动成功之后一小段时候就自动宕机

通过查询日志发现

Connecting to localhost:2181
2021-02-12 01:20:56,083 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
2021-02-12 01:20:56,087 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=hadoop104
2021-02-12 01:20:56,087 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_144
2021-02-12 01:20:56,089 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2021-02-12 01:20:56,089 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/opt/module/jdk1.8.0_144/jre
2021-02-12 01:20:56,089 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/opt/module/zookeeper-3.4.10/bin/../build/classes:/opt/module/zookeeper-3.4.10/bin/../build/lib/*.jar:/opt/module/zookeeper-3.4.10/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/module/zookeeper-3.4.10/bin/../lib/slf4j-api-1.6.1.jar:/opt/module/zookeeper-3.4.10/bin/../lib/netty-3.10.5.Final.jar:/opt/module/zookeeper-3.4.10/bin/../lib/log4j-1.2.16.jar:/opt/module/zookeeper-3.4.10/bin/../lib/jline-0.9.94.jar:/opt/module/zookeeper-3.4.10/bin/../zookeeper-3.4.10.jar:/opt/module/zookeeper-3.4.10/bin/../src/java/lib/*.jar:/opt/module/zookeeper-3.4.10/bin/../conf:
2021-02-12 01:20:56,089 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2021-02-12 01:20:56,089 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2021-02-12 01:20:56,090 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2021-02-12 01:20:56,090 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
2021-02-12 01:20:56,090 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2021-02-12 01:20:56,090 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=2.6.32-754.el6.x86_64
2021-02-12 01:20:56,090 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=atguigu
2021-02-12 01:20:56,090 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/home/atguigu
2021-02-12 01:20:56,090 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/opt/module/kafka
2021-02-12 01:20:56,091 [myid:] - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=localhost:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@1a86f2f1
Welcome to ZooKeeper!
2021-02-12 01:20:56,133 [myid:] - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@1032] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2021-02-12 01:20:56,205 [myid:] - WARN  [main-SendThread(localhost:2181):ClientCnxn$SendThread@1162] 
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值