HADOOP3 部署踩过的坑

1.  

问题：datanode

2018-08-16 18:29:53,212 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain java.lang.RuntimeException: Cannot start secure DataNode due to incorrect config. See https://cwiki.apache.org/confluence/display/HADOOP/Secure+DataNode for detail s. at org.apache.hadoop.hdfs.server.datanode.DataNode.checkSecureConfig(DataNode.java:1509) at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1363) at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:497) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2769) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677) at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719) at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863) at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887) 2018-08-16 18:29:53,213 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.lang.RuntimeException: Cannot start secure DataNode due to incorrect conf ig. See https://cwiki.apache.org/confluence/display/HADOOP/Secure+DataNode for details. 2018-08-16 18:29:53,224 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:

解决方法：

配置文件问题，请认真检查每一项的name和value是否正确

 

问题：nodemanager

************************************************************/ 2018-08-16 18:30:01,445 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT] 2018-08-16 18:30:01,883 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationExecutor: Shell execution returned exit code: 24. Privileged Execution Operation Stderr: File /opt/hadoop/etc/hadoop/container-executor.cfg must be owned by root, but is owned by 2380   Stdout: Full command array for failed execution: [/opt/hadoop/bin/container-executor, --checksetup] 2018-08-16 18:30:01,884 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container executor initialization is : 24 org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationException: ExitCodeException exitCode=24: File /opt/hadoop/etc/hadoo p/container-executor.cfg must be owned by root, but is owned by 2380   at org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationExecutor.executePrivilegedOperation(PrivilegedOperationEx ecut