问题描述
今天在搭建hadoop伪分布式集群时,启动hadoop,报如下异常情况,hadoop002(也就我设置的Secondary namenode)拒绝连接,启动Secondary namenode失败。
[root@hadoop1 ~]# start-all.sh
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
20/07/03 01:09:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [hadoop1]
hadoop1: starting namenode, logging to /opt/install/hadoop/logs/hadoop-root-namenode-hadoop1.out
hadoop4: starting datanode, logging to /opt/install/hadoop/logs/hadoop-root-datanode-hadoop4.out
hadoop1: starting datanode, logging to /opt/install/hadoop/logs/hadoop-root-datanode-hadoop1.out
hadoop2: starting datanode, logging to /opt/install/hadoop/logs/hadoop-root-datanode-hadoop2.out
hadoop3: starting datanode, logging to /opt/install/hadoop/logs/hadoop-root-datanode-hadoop3.out
Starting secondary namenodes [hadoop002]
hadoop002: ssh: connect to host hadoop002 port 22: Connection refused
20/07/03 01:10:07 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /opt/install/hadoop/logs/yarn-root-resourcemanager-hadoop1.out
hadoop2: starting nodemanager, logging to /opt/install/hadoop/logs/yarn-root-nodemanager-hadoop2.out
hadoop4: starting nodemanager, logging to /opt/install/hadoop/logs/yarn-root-nodemanager-hadoop4.out
hadoop3: starting nodemanager, logging to /opt/install/hadoop/logs/yarn-root-nodemanager-hadoop3.out
hadoop1: starting nodemanager, logging to /opt/install/hadoop/logs/yarn-root-nodemanager-hadoop1.out
问题分析
无法连接到hadoop002,原因有以下几种:
(1)hadoop002这个hostname是否存在,进入到设置hadoop002的这个配置主机名文件中:vi /etc/hostname,查看名称是否正确
(2)hosts中hadoop002的ip地址与名称是否一一对应
(3)hdfs-site.sh配置文件中的Secondary namenode配置是否正确(我的问题就是出现在这里,我自己的第二个主机名实际设置的是hadoop2,而之前使用的配置文件在copy的时候是hadoop002,所有copy有风险,这里建议还是使用ip地址代替使用主机名)
<property>
<name>dfs.namenode.secondary.http-address</name>
<value>hadoop2:50090</value> ----这里建议使用ip地址代替hadoop2
</property>