dfs 访问拒绝_bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.2.jar pi 2 1000 连接拒绝...

在配置好HADOOP HA环境并启动所有服务后,执行MapReduce任务时遇到连接拒绝错误。尽管能从NameNode节点ping通DataNode节点,但在运行`bin/hadoop jar`命令时,出现`java.net.ConnectException: Connection refused`,提示无法建立BlockOutputStream,导致任务失败。进一步调查和解决这个问题是关键。
摘要由CSDN通过智能技术生成

在配置完HADOOP HA并已启动各节点及服务后,运行MR程序,报连接错误。能从NN节点PING通各DN节点。

[root@hdp1 hadoop-2.6.2]# ping hdp3

PING hdp3 (10.163.205.207) 56(84) bytes of data.

64 bytes from hdp3 (10.163.205.207): icmp_seq=1 ttl=61 time=0.503 ms

^C

--- hdp3 ping statistics ---

1 packets transmitted, 1 received, 0% packet loss, time 950ms

rtt min/avg/max/mdev = 0.503/0.503/0.503/0.000 ms

[root@hdp1 hadoop-2.6.2]# bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.2.jar pi 2 1000

Number of Maps = 2

Samples per Map = 1000

16/08/11 23:24:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

16/08/11 23:24:43 INFO hdfs.DFSClient: Exception in createBlockOutputStream

java.net.ConnectException: Connection refused

at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)

at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)

at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)

at org.apache.hadoop.hdfs.DFSOutputStream.createSocketForPipeline(DFSOutputStream.java:1610)

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1408)

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1361)

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:588)

16/08/11 23:24:43 INFO hdfs.DFSClient: Abandoning BP-1310170383-10.161.70.131-1470844172085:blk_1073741849_1025

16/08/11 23:24:43 INFO hdfs.DFSClient: Excluding datanode 10.161.70.131:50010

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值