上传文件突然报错

最新推荐文章于 2023-02-20 16:11:44 发布

V丶Chao

最新推荐文章于 2023-02-20 16:11:44 发布

阅读量471

点赞数

文章标签： hadoop hdfs 大数据 spark hive

本文链接：https://blog.csdn.net/u011698800/article/details/107607910

版权

2018/04/04
上传文件的时候，突然报错，查看了一下

[root@node1 ss]# hadoop fs -copyFromLocal xab xx
18/04/04 22:05:24 INFO hdfs.DataStreamer: Exception in createBlockOutputStream
java.net.NoRouteToHostException: No route to host
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
        at org.apache.hadoop.hdfs.DataStreamer.createSocketForPipeline(DataStreamer.java:259)
        at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1699)
        at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1655)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:710)
18/04/04 22:05:24 WARN hdfs.DataStreamer: Abandoning BP-1187837941-10.245.142.250-1522850560697:blk_1073741825_1001
18/04/04 22:05:24 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[10.245.142.251:50010,DS-10a9876c-3c53-4d49-8be6-7f854e7b1804,DISK]
18/04/04 22:05:24 INFO hdfs.DataStreamer: Exception in createBlockOutputStream
java.net.NoRouteToHostException: No route to host
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
        at org.apache.hadoop.hdfs.DataStreamer.createSocketForPipeline(DataStreamer.java:259)
        at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1699)
        at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1655)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:710)
18/04/04 22:05:24 WARN hdfs.DataStreamer: Abandoning BP-1187837941-10.245.142.250-1522850560697:blk_1073741826_1002
18/04/04 22:05:24 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[10.245.142.252:50010,DS-f30e8667-22ae-4f8c-906f-b2c5ae87e798,DISK]

没有清除防火墙规则。