1.1. hadoop错误
1.1.1. 启动错误
[root@xuegod63 hadoop-2.6.2]#sbin/start-all.sh
This script is Deprecated. Instead use start-dfs.sh andstart-yarn.sh
17/05/15 18:58:59 WARN util.NativeCodeLoader: Unable to loadnative-hadoop library for your platform... using builtin-java classes whereapplicable
Starting namenodes on [xuegod63]
The authenticity of host 'xuegod63 (192.168.1.63)' can't beestablished.
RSA key fingerprint is06:42:3e:1a:f6:55:f1:ac:4d:15:c5:ac:c4:d8:0c:26.
Are you sure you want to continue connecting (yes/no)? yes
xuegod63: Warning: Permanently added 'xuegod63' (RSA) to thelist of known hosts.
xuegod63: starting namenode, logging to/usr/local/hadoop-2.6.2/logs/hadoop-root-namenode-xuegod63.out
The authenticity of host 'localhost (::1)' can't beestablished.
RSA key fingerprint is06:42:3e:1a:f6:55:f1:ac:4d:15:c5:ac:c4:d8:0c:26.
Are you sure you want to continue connecting (yes/no)? yes
localhost: Warning: Permanently added 'localhost' (RSA) tothe list of known hosts.
localhost: starting datanode, logging to/usr/local/hadoop-2.6.2/logs/hadoop-root-datanode-xuegod63.out
Starting secondary namenodes [xuegod63]
xuegod63: starting secondarynamenode, logging to/usr/local/hadoop-2.6.2/logs/hadoop-root-secondarynamenode-xuegod63.out
17/05/15 18:59:43 WARN util.NativeCodeLoader:Unable to load native-hadoop library for your platform... using builtin-javaclasses where applicable
starting yarn daemons
resourcemanager running as process 3400. Stop it first.
localhost: starting nodemanager, logging to/usr/local/hadoop-2.6.2/logs/yarn-root-nodemanager-xuegod63.out
[root@xuegod63 hadoop-2.6.2]#
[root@xuegod63 hadoop-2.6.2]#
[root@xuegod63 hadoop-2.6.2]#
解决办法:
下载hadoop-native包,解压到lib/native目录下即可。
1.1.2. hadoop创建目录错误
现错误提示:mkdir:org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot createdirectory /hbase. Name node is in safe mode
解决方法:
进入Hadoop的bin目录运行命令手动离开安全模式:
[root@localhost85bin]#
[root@localhost85bin]# ./hadoop dfsadmin -safemode leave
[root@localhost85bin]#
出错原因:
这是因为在分布式文件系统启动的时候,开始的时候会有安全模式,当分布式文件系统处于安全模式的情况下,文件系统中的内容不允许修改也不允许删除,直到安全模式结束。安全模式主要是为了系统启动的时候检查各个DataNode上数据块的有效性,同时根据策略必要的复制或者删除部分数据块。运行期通过命令也可以进入安全模式。在实践过程中,系统启动的时候去修改和删除文件也会有安全模式不允许修改的出错提示,只需要等待一会即可。
2.6以前解决办法:
离开安全模式方法: bin/Hadoop dfsadmin -safemode leave
root@localhost85 hadoop-2.7.3]# bin/hadoop dfsadmin-safemode leave
root@localhost85 hadoop-2.7.3]# bin/hadoop dfsadmin-safemode -report
新版(2.7.3)推荐使用hdfs命令关闭安全模式:bin/hdfs dfsadmin -safemode leave
root@localhost85 hadoop-2.7.3]#
[root@localhost85 hadoop-2.7.3]# bin/hdfs dfsadmin -safemodeleave
Safe mode is OFF
You have new mail in /var/spool/mail/root
[root@localhost85 hadoop-2.7.3]#
在hdfs-site.xml中把dfs.safemode.threshold.pct设置为0即可关闭safemode