Call From hdp-1/192.168.234.129 to hdp-1:8020 failed on connection exception: java.net.ConnectExcept

最新推荐文章于 2023-05-11 20:41:35 发布
最新推荐文章于 2023-05-11 20:41:35 发布
阅读量2.3k 收藏
点赞数
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/Romantic_sir/article/details/104305279
版权

分享一个我大晚上提交Hadoop作业到Yarn上因为一个小小小小错误解决了一晚上的问题！

报错：Exception in thread "main" java.net.ConnectException: Call From hdp-1/192.168.234.129 to hdp-1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

20/02/13 23:56:17 INFO client.RMProxy: Connecting to ResourceManager at hdp-1/192.168.234.129:8032
20/02/13 23:56:17 WARN ipc.Client: Failed to connect to server: hdp-1/192.168.234.129:8020: try once and fail.
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495)
        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:681)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:777)
        at org.apache.hadoop.ipc.Client$Connection.access$3500(Client.java:409)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1542)
        at org.apache.hadoop.ipc.Client.call(Client.java:1373)
        at org.apache.hadoop.ipc.Client.call(Client.java:1337)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)
        at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:787)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:398)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:163)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:155)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:335)
        at com.sun.proxy.$Proxy11.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1700)
        at org.apache.hadoop.hdfs.DistributedFileSystem$27.doCall(DistributedFileSystem.java:1436)
        at org.apache.hadoop.hdfs.DistributedFileSystem$27.doCall(DistributedFileSystem.java:1433)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1433)
        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1436)
        at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:145)
        at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:268)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:141)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1341)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1338)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1807)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1338)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359)
        at com.fengrui.clickLog.AccessLogDriver.main(AccessLogDriver.java:37)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:234)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Exception in thread "main" java.net.ConnectException: Call From hdp-1/192.168.234.129 to hdp-1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:801)
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:732)
        at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1485)
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)
        at org.apache.hadoop.ipc.Client.call(Client.java:1337)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)
        at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:787)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:398)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:163)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:155)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:335)
        at com.sun.proxy.$Proxy11.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1700)
        at org.apache.hadoop.hdfs.DistributedFileSystem$27.doCall(DistributedFileSystem.java:1436)
        at org.apache.hadoop.hdfs.DistributedFileSystem$27.doCall(DistributedFileSystem.java:1433)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1433)
        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1436)
        at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:145)
        at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:268)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:141)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1341)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1338)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1807)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1338)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359)
        at com.fengrui.clickLog.AccessLogDriver.main(AccessLogDriver.java:37)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:234)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495)
        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:681)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:777)
        at org.apache.hadoop.ipc.Client$Connection.access$3500(Client.java:409)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1542)
        at org.apache.hadoop.ipc.Client.call(Client.java:1373)
        ... 38 more

解决方法：

作业的输入路径和输出路径一时疏忽少写了：9000

应该把:9000加上问题解决

真醉了真醉了，大家以后仔细点，浪费时间！！！

冯小瑞
关注
hadoop01:8020 failed on connection exception: java.net.ConnectException: 拒绝接
超人归来
05-28 1万+
实验中使用hdfs报错，怎么也能连接hadoop，重启还是报错，仔细排查下[root@hadoop01 ~]# hadoop fs -ls /ls: Call From hadoop01/172.16.18.133 to hadoop01:8020 failed on connection exception: java.net.ConnectException: 拒绝接; For more de...
hadoop Apache版本的启动命令
北京小辉
05-08 1113
start-all.sh 启动所有的Hadoop守护进程。包括NameNode、 Secondary NameNode、DataNode、JobTracker、 TaskTrack stop-all.sh 停止所有的Hadoop守护进程。包括NameNode、 Secondary NameNode、DataNode、JobTracker、 TaskTrack start-dfs.sh 启动Ha
Caused by: java.net.ConnectException: Call From hadoop1/192.168.1.201 to hadoop1:8020 failed on conn
胖胖的博客
07-27 2085
Caused by: java.net.ConnectException: Call From hadoop1/192.168.1.201 to hadoop1:8020 failed on conn
spark连接HDFS报错：8020 failed on connection exception: java.net.ConnectException: 拒绝连接 解决方法
balalaxstar的博客
05-11 4517
一、接口错误 spark连接HDFS时直接报错，可能是hadoop中core-site.xml配置的集群端口时9000，而spark写的是8020，改为9000即可。 二、hdfs文件丢失 当初次连接成功，并且获取表结构也成功，但是一获取表数据时就报错 拒绝连接 ，这时要到MySQL中查看该数据库或者该表的文件是否真的存在于指定位置，当文件丢失时也会报错。报错内容会显示文件端口丢失。 ...
Ambari+HDP+HDP-UTILS.rar
03-28
标题中的"Ambari+HDP+HDP-UTILS.rar"表明这是一份与Apache Ambari、Hortonworks Data Platform (HDP)以及HDP-UTILS相关的压缩包资源。这些组件在大数据处理和管理领域具有重要作用，主要用于简化Hadoop生态系统的...
HDP-GPL-2.6.4.0-centos7-rpm.tar.gz
09-04
标题 "HDP-GPL-2.6.4.0-centos7-rpm.tar.gz" 提供的信息表明，这是一个与HDP（Hortonworks Data Platform）相关的开源版本，具体为2.6.4.0版，面向CentOS 7操作系统的RPM（Red Hat Package Manager）格式的软件包。...
HDP-UTILS-1.1.0.22-centos7.tar.gz
10-25
标题 "HDP-UTILS-1.1.0.22-centos7.tar.gz" 提供的是一个软件包的名称，这通常代表了一个特定版本的工具集合，用于在CentOS 7操作系统上与Hadoop Distributed File System (HDFS)相关的操作。HDP全称为Hortonworks ...
HDP-GPL-3.1.0.0-centos7-gpl.tar.gz
05-06
《Ambari最新版安装详解：HDP-GPL-3.1.0.0-centos7-gpl.tar.gz深度解析》 在大数据处理领域，Apache Ambari是一款至关重要的工具，它提供了直观的Web界面，使得Hadoop集群的部署、管理和监控变得简单易行。本文将...
Error From hadoop100to localhost:8020 failed on connection exception:java.net.Connection exception
weixin_47951828的博客
04-15 3213
出现Error From hadoop100/192.168.118.100 to localhost:8020 failed on connection exception:java.net.ConnectException:拒绝连接的解决: 1.首先，需确保选择的地址为你的hadoop地址： 选择 Window 菜单下的 Preference，此时会弹出一个窗体，窗体的左侧会多出 Hadoop Map/Reduce 选项，点击此选项，选择 Hadoop 的安装目录 2.New Hadoop Locati
mkdir: Call From hadoop102/192.168.6.102 to hadoop102:8020 failed on connection exception: java.net.
weixin_43797368的博客
10-08 4155
mkdir: Call From hadoop102/192.168.6.102 to hadoop102:8020 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused 少走弯路之出现这个BUG是不是你的hdfs没有启起来。。。。。。。这个BUG很脑残，哈哈 ...
Call From master/192.168.170.128 to master:8020 failed on connection exception: java.net.ConnectExce
热门推荐
qiweiqian的博客
06-11 1万+
在执行一个Hadoop的文件读写任务是发生这个错误：Call From master/192.168.170.128 to master:8020 failed on connection exception: java.net.ConnectException: Connection。 意思大致是无法连接到master的8020端口。该问题造成的主要原因是和Hadoop以及Linux系
Call From linux01/192.168.133.3 to linux01:8020 failed on connection exception: 拒绝连接
是故事啊~关注我~
06-01 3682
执行hdfs命令：hdfsdfs -ls / 报错：DEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it. ls: Call From linux01/192.168.133.3 to linux01:8020 failed on connection exception: 拒绝连接; For more details see :http://..
连接hadoop集群或 Error: Call From hadoop/127.0.1.1 to localhost:8020 failed on connection exception: java
m0_62510411的博客
05-11 1376
Error: Call From hadoop/127.0.1.1 to localhost:8020 failed on connection exception: java.net.ConnectException: 拒绝连接: For more details see: http://wiki.apache.org/hadoop/ConnectionRefused。就好了，如果代码运行还出错，说是拒绝连接，看看你的代码中 ---读取文件的地址写对了没。
Hadoop报错java.net.ConnectException: Call From xxx to localhost:8020 failed on connection exception
给我一点温度
08-16 7674
运行Spark时报错，java.net.ConnectException: Call From xxx to localhost:8020 failed on connection exception, caused by:java.net.ConnectException:拒绝连接 提示可以去Hadoop官网上找答案，网址如下：https://cwiki.apache.org/conflue...
Call From linux01/192.168.x.x to linux01:8020 failed on connection exception: 拒绝连接； For more details
是故事啊~关注我~
01-22 3249
测试的时候使用HDFS展示文件的时候报错，正好排查了一下 在执行hdfs命令：hdfs dfs -ls / 报错信息如下： DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. ls: Call From linux01/192.168.x.x to linux01:8020 failed on connection exception: 拒绝连接;
Exception in thread “main“ java.net.ConnectException: Call From hadoop101/192.168.10.12 to hadoop101
qq_32118757的博客
01-27 2105
Exception in thread "main" java.net.ConnectException: Call From hadoop101/192.168.10.12 to hadoop101:8020 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
Call From hadoop102/192.168.10.102 to hadoop102:8020 failed on connection exception: java.net.Connec
qq_43668173的博客
03-20 1万+
Call From hadoop102/192.168.10.102 to hadoop102:8020 failed on connection exception: java.net.ConnectException: 拒绝连接; 2021-03-20 08:41:20,294 INFO client.RMProxy: Connecting to ResourceManager at hadoop103/192.168.10.103:8032 java.net.ConnectException: Cal
电商数仓3.0：启动集群时出现：java.net.ConnectException:拒绝连接问题
weixin_45072918的博客
04-09 2989
在启动hdfs出现拒绝连接的问题，网上搜索之后发现是由于多次对NameNode进行格式化，导致
"Connection refused: no further information: /192.168.0.1:8082
最新发布
08-25
这个错误通常表示在建立连接时出现问题，具体的错误信息是"Connection refused: no further information"。这个错误可能有多种原因。根据您提供的引用内容，这个错误可能是因为端口未开放或容器未与服务器进行端口映射导致的。 解决这个问题的一个方案是将9848这个端口暴露出来。您可以使用以下命令将nacos容器进行重新部署，并将9848端口映射到服务器上： docker run -it -d \ --name nacos-smile \ -e MODE=standalone \ -v /home/smile/docker/nacos:/nacos \ --restart=always \ -p 8848:8848 \ -p 9848:9848 \ nacos/nacos-server:latest 这个命令将会重新部署nacos容器，并将8848和9848两个端口映射到服务器上。这样，您应该就能够成功连接到192.168.0.1:8082了。<span class="em">1</span><span class="em">2</span><span class="em">3</span> #### 引用[.reference_title] - *1* [Call From hdp-1/192.168.234.129 to hdp-1:8020 failed on connection exception: java.net.ConnectExcept](https://download.csdn.net/download/weixin_38642349/14886000)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_2"}}] [.reference_item style="max-width: 50%"] - *2* *3* [[bug]AnnotatedConnectException: Connection refused: no further information: /192.168.0.100:9848](https://blog.csdn.net/qq_43073558/article/details/128885009)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_2"}}] [.reference_item style="max-width: 50%"] [ .reference_list ]
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值