在配置完HADOOP HA并已启动各节点及服务后,运行MR程序,报连接错误。能从NN节点PING通各DN节点。
[root@hdp1 hadoop-2.6.2]# ping hdp3
PING hdp3 (10.163.205.207) 56(84) bytes of data.
64 bytes from hdp3 (10.163.205.207): icmp_seq=1 ttl=61 time=0.503 ms
^C
--- hdp3 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 950ms
rtt min/avg/max/mdev = 0.503/0.503/0.503/0.000 ms
[root@hdp1 hadoop-2.6.2]# bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.2.jar pi 2 1000
Number of Maps = 2
Samples per Map = 1000
16/08/11 23:24:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/08/11 23:24:43 INFO hdfs.DFSClient: Exception in createBlockOutputStream
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
at org.apache.hadoop.hdfs.DFSOutputStream.createSocketForPipeline(DFSOutputStream.java:1610)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1408)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1361)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:588)
16/08/11 23:24:43 INFO hdfs.DFSClient: Abandoning BP-1310170383-10.161.70.131-1470844172085:blk_1073741849_1025
16/08/11 23:24:43 INFO hdfs.DFSClient: Excluding datanode 10.161.70.131:50010