CentOS release 6.5 64位 Hadoop 2.2.0 启动异常

       编译部署了一套hadoop集群，但是启动时报WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable错误，开启debug模式启动，发现动态库获取路径为/home/hadoop/local/opt/hadoop//lib，实际动态库路径为/home/hadoop/local/opt/hadoop/lib/native，将native所有动态库复制一份到上级目录，再执行启动命令，正常。

[hadoop@Master ~]$ start-dfs.sh
14/07/09 22:15:48 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [Master.Hadoop]
Master.Hadoop: starting namenode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-namenode-Master.Hadoop.out
Slave2.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave2.Hadoop.out
Slave1.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave1.Hadoop.out
Slave3.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave3.Hadoop.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-secondarynamenode-Master.Hadoop.out
14/07/09 22:16:22 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[hadoop@Master ~]$ stop-all.sh 
This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh
14/07/09 22:19:51 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Stopping namenodes on [Master.Hadoop]
Master.Hadoop: stopping namenode
Slave3.Hadoop: stopping datanode
Slave1.Hadoop: no datanode to stop
Slave2.Hadoop: stopping datanode
Stopping secondary namenodes [0.0.0.0]
0.0.0.0: no secondarynamenode to stop
14/07/09 22:20:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
stopping yarn daemons
no resourcemanager to stop
Slave1.Hadoop: no nodemanager to stop
Slave2.Hadoop: no nodemanager to stop
Slave3.Hadoop: no nodemanager to stop
no proxyserver to stop
[hadoop@Master ~]$ export HADOOP_ROOT_LOGGER=DEBUG,console
[hadoop@Master ~]$ start-dfs.sh
14/07/09 22:21:18 DEBUG lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
14/07/09 22:21:18 DEBUG lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
14/07/09 22:21:18 DEBUG impl.MetricsSystemImpl: UgiMetrics, User and group related metrics
14/07/09 22:21:19 DEBUG security.Groups:  Creating new Groups object
14/07/09 22:21:19 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
14/07/09 22:21:19 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
14/07/09 22:21:19 DEBUG util.NativeCodeLoader: java.library.path=/home/hadoop/local/opt/hadoop//lib
14/07/09 22:21:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/07/09 22:21:19 DEBUG security.JniBasedUnixGroupsMappingWithFallback: Falling back to shell based
14/07/09 22:21:19 DEBUG security.JniBasedUnixGroupsMappingWithFallback: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
14/07/09 22:21:19 DEBUG security.Groups: Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000
14/07/09 22:21:19 DEBUG security.UserGroupInformation: hadoop login
14/07/09 22:21:19 DEBUG security.UserGroupInformation: hadoop login commit
14/07/09 22:21:19 DEBUG security.UserGroupInformation: using local user:UnixPrincipal: hadoop
14/07/09 22:21:19 DEBUG security.UserGroupInformation: UGI loginUser:hadoop (auth:SIMPLE)
14/07/09 22:21:19 DEBUG security.UserGroupInformation: PrivilegedAction as:hadoop (auth:SIMPLE) from:org.apache.hadoop.hdfs.tools.GetConf.run(GetConf.java:314)
14/07/09 22:21:19 DEBUG impl.MetricsSystemImpl: StartupProgress, NameNode startup progress
Starting namenodes on [Master.Hadoop]
Master.Hadoop: starting namenode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-namenode-Master.Hadoop.out
Slave1.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave1.Hadoop.out
Slave2.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave2.Hadoop.out
Slave3.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave3.Hadoop.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-secondarynamenode-Master.Hadoop.out
14/07/09 22:21:46 DEBUG lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
14/07/09 22:21:46 DEBUG lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
14/07/09 22:21:46 DEBUG impl.MetricsSystemImpl: UgiMetrics, User and group related metrics
14/07/09 22:21:46 DEBUG security.Groups:  Creating new Groups object
14/07/09 22:21:46 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
14/07/09 22:21:46 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
14/07/09 22:21:46 DEBUG util.NativeCodeLoader: java.library.path=/home/hadoop/local/opt/hadoop//lib
14/07/09 22:21:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/07/09 22:21:46 DEBUG security.JniBasedUnixGroupsMappingWithFallback: Falling back to shell based
14/07/09 22:21:46 DEBUG security.JniBasedUnixGroupsMappingWithFallback: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
14/07/09 22:21:47 DEBUG security.Groups: Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000
14/07/09 22:21:47 DEBUG security.UserGroupInformation: hadoop login
14/07/09 22:21:47 DEBUG security.UserGroupInformation: hadoop login commit
14/07/09 22:21:47 DEBUG security.UserGroupInformation: using local user:UnixPrincipal: hadoop
14/07/09 22:21:47 DEBUG security.UserGroupInformation: UGI loginUser:hadoop (auth:SIMPLE)
14/07/09 22:21:47 DEBUG security.UserGroupInformation: PrivilegedAction as:hadoop (auth:SIMPLE) from:org.apache.hadoop.hdfs.tools.GetConf.run(GetConf.java:314)
[hadoop@Master hadoop]$ cd lib/native/
[hadoop@Master native]$ ll
总用量 3600
-rw-r--r--. 1 hadoop hadoop  733642 7月   9 21:42 libhadoop.a
-rw-r--r--. 1 hadoop hadoop 1487284 7月   9 21:42 libhadooppipes.a
lrwxrwxrwx. 1 hadoop hadoop      18 7月   9 21:39 libhadoop.so -> libhadoop.so.1.0.0
-rwxr-xr-x. 1 hadoop hadoop  412310 7月   9 21:42 libhadoop.so.1.0.0
-rw-r--r--. 1 hadoop hadoop  582040 7月   9 21:42 libhadooputils.a
-rw-r--r--. 1 hadoop hadoop  273458 7月   9 21:42 libhdfs.a
lrwxrwxrwx. 1 hadoop hadoop      16 7月   9 21:39 libhdfs.so -> libhdfs.so.0.0.0
-rwxr-xr-x. 1 hadoop hadoop  181162 7月   9 21:42 libhdfs.so.0.0.0
[hadoop@Master native]$ file libhadoop.so.1.0.0 
libhadoop.so.1.0.0: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, not stripped
[hadoop@Master native]$ pwd
/home/hadoop/local/opt/hadoop/lib/native
[hadoop@Master native]$ cp - r ./* ../
[hadoop@Master hadoop]$ start-dfs.sh 
Starting namenodes on [Master.Hadoop]
Master.Hadoop: starting namenode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-namenode-Master.Hadoop.out
Slave1.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave1.Hadoop.out
Slave2.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave2.Hadoop.out
Slave3.Hadoop: starting datanode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-datanode-Slave3.Hadoop.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /home/hadoop/local/opt/hadoop/logs/hadoop-hadoop-secondarynamenode-Master.Hadoop.out
[hadoop@Master hadoop]$ jps
13676 Jps
4881 JobHistoryServer
13409 NameNode
[hadoop@Master hadoop]$ start-yarn.sh 
starting yarn daemons
starting resourcemanager, logging to /home/hadoop/local/opt/hadoop//logs/yarn-hadoop-resourcemanager-Master.Hadoop.out
Slave2.Hadoop: starting nodemanager, logging to /home/hadoop/local/opt/hadoop/logs/yarn-hadoop-nodemanager-Slave2.Hadoop.out
Slave1.Hadoop: starting nodemanager, logging to /home/hadoop/local/opt/hadoop/logs/yarn-hadoop-nodemanager-Slave1.Hadoop.out
Slave3.Hadoop: starting nodemanager, logging to /home/hadoop/local/opt/hadoop/logs/yarn-hadoop-nodemanager-Slave3.Hadoop.out
[hadoop@Master native]$ jps
13991 Jps
4881 JobHistoryServer
13409 NameNode
13724 ResourceManager