hadoop tyarn冲突_hadoop集群启动yarn时出现的问题和解决方法

在启动Hadoop HDFS和YARN集群时遇到ResourceManager未启动的问题,日志显示因Session过期无法创建/yarn-leader-election/yrc目录。解决方案是检查Zookeeper中是否存在该目录,若缺失则手动创建,并随后重启YARN集群。
摘要由CSDN通过智能技术生成

1、问题

使用start-all.sh 启动hdfs和yarn集群 ,启动后发现resourcemanager没启动,查看日志报错:

ad9b7cbbc6703d4c768d65140811e499.png

2020-06-01 09:42:21,280 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.resourcemanager.AdminService failed in state INITED; cause: org.apache.hadoop.service.ServiceStateException: java.io.IOException: Couldn't create /yarn-leader-election/yrc

org.apache.hadoop.service.ServiceStateException: java.io.IOException: Couldn't create /yarn-leader-election/yrc

at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)

at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)

at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)

at org.apache.hadoop.yarn.server.resourcemanager.AdminService.serviceInit(AdminService.java:142)

at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)

at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)

at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:267)

at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)

at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)

Caused by: java.io.IOException: Couldn't create /yarn-leader-election/yrc

at org.apache.hadoop.ha.ActiveStandbyElector.ensureParentZNode(ActiveStandbyElector.java:305)

at org.apache.hadoop.yarn.server.resourcemanager.EmbeddedElectorService.serviceInit(EmbeddedElectorService.java:95)

at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)

... 7 more

Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /yarn-leader-election/yrc

at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)

at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)

at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)

at org.apache.hadoop.ha.ActiveStandbyElector$3.run(ActiveStandbyElector.java:965)

at org.apache.hadoop.ha.ActiveStandbyElector$3.run(ActiveStandbyElector.java:962)

at org.apache.hadoop.ha.ActiveStandbyElector.zkDoWithRetries(ActiveStandbyElector.java:1006)

at org.apache.hadoop.ha.ActiveStandbyElector.createWithRetries(ActiveStandbyElector.java:962)

at org.apache.hadoop.ha.ActiveStandbyElector.ensureParentZNode(ActiveStandbyElector.java:299)

... 9 more

查看进程:

fe3a45dc252eea6af308a65425a86915.png

2、解决方法:

进入zookeeper目录:查看有无 /yarn-leader-election目录,如果没有手动创建一下: create  /yarn-leader-election/yrc/

2022e7fc290d3aca7ea367d336097055.png

然后重启yarn集群 :start-yarn.sh

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值