Failed to initialize container executor

ClouderaManager启动NodeManager失败！报错Failed to initialize container executor

原网址：https://www.cnblogs.com/zhzhang/p/5711161.html

报错信息：

2016-07-27 10:53:14,102 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container exec

utor initialization is : 24

ExitCodeException exitCode=24: Invalid configuration provided in /etc/hadoop/conf.cloudera.yarn/container-executor.cfg

 

        at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)

        at org.apache.hadoop.util.Shell.run(Shell.java:455)

        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)

        at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:181)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:209)

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:462)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509)

2016-07-27 10:53:14,111 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:

2016-07-27 10:53:14,111 INFO org.apache.hadoop.service.AbstractService: Service NodeManager failed in state INITED; cause: o

rg.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor

org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:211)

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:462)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509)

Caused by: java.io.IOException: Linux container executor not configured properly (error=24)

        at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:187)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:209)

        ... 3 more

Caused by: ExitCodeException exitCode=24: Invalid configuration provided in /etc/hadoop/conf.cloudera.yarn/container-executo

r.cfg

 

解决办法：

　　看到ClouderaManager启动NodeManager失败，读取的配置文件是/etc/hadoop/conf.cloudera.yarn/container-executor.cfg，这个文件为空。

参考/module/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/etc/hadoop/conf.empty/container-executor.cfg配置文件，将对应信息写入到/etc/hadoop/conf.cloudera.yarn/container-executor.cfg文件中，问题解决。

echo "yarn.nodemanager.linux-container-executor.group=yarn" > /etc/hadoop/conf.cloudera.yarn/container-executor.cfg

pwd

/opt/cm-5.4.7/run/cloudera-scm-agent/process/6895-yarn-NODEMANAGER 

yarn.nodemanager.local-dirs

rm -rf /yarn/nm/usercache/*
rm -rf /mnt/sd01/yarn/nm/usercache/userlxg
rm -rf /mnt/sd02/yarn/nm/usercache/userlxg
rm -rf /mnt/sd03/yarn/nm/usercache/userlxg

还没有发现副作用，发现再更新。

 

【参考】http://blog.csdn.net/yangzongzhao/article/details/41867793