spark-client 一直 accepted,org.apache.spark.SparkException: Failed to connect to driver!

AM Container for appattempt_1555480141477_0003_000002 exited with exitCode: 10
Failing this attempt.Diagnostics: [2019-04-17 14:01:27.662]Exception from container-launch.
Container id: container_1555480141477_0003_02_000001
Exit code: 10
[2019-04-17 14:01:27.667]Container exited with a non-zero exit code 10. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/yarn/nm/filecache/84/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.0.1-1.cdh6.0.1.p0.590678/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
19/04/17 13:59:18 INFO util.SignalUtils: Registered signal handler for TERM
19/04/17 13:59:18 INFO util.SignalUtils: Registered signal handler for HUP
19/04/17 13:59:18 INFO util.SignalUtils: Registered signal handler for INT
19/04/17 13:59:19 INFO yarn.ApplicationMaster: Preparing Local resources
19/04/17 13:59:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
19/04/17 13:59:19 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1555480141477_0003_000002
19/04/17 13:59:19 INFO spark.SecurityManager: Changing view acls to: yarn,hdfs
19/04/17 13:59:19 INFO spark.SecurityManager: Changing modify acls to: yarn,hdfs
19/04/17 13:59:19 INFO spark.SecurityManager: Changing view acls groups to:
19/04/17 13:59:19 INFO spark.SecurityManager: Changing modify acls groups to:
19/04/17 13:59:19 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, hdfs); groups with view permissions: Set(); users with modify permissions: Set(yarn, hdfs); groups with modify permissions: Set()
19/04/17 13:59:20 INFO yarn.ApplicationMaster: Waiting for Spark driver to be reachable.
19/04/17 14:01:27 ERROR yarn.ApplicationMaster: Failed to connect to driver at 192.168.157.1:54385, retrying ...
19/04/17 14:01:27 ERROR yarn.ApplicationMaster: Uncaught exception:
org.apache.spark.SparkException: Failed to connect to driver!
at org.apache.spark.deploy.yarn.ApplicationMaster.waitForSparkDriver(ApplicationMaster.scala:577)
at org.apache.spark.deploy.yarn.ApplicationMaster.runExecutorLauncher(ApplicationMaster.scala:433)
at org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:256)
at org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$main$1.apply$mcV$sp(ApplicationMaster.scala:764)
at org.apache.spark.deploy.SparkHadoopUtil$$anon$2.run(SparkHadoopUtil.scala:67)
at org.apache.spark.deploy.SparkHadoopUtil$$anon$2.run(SparkHadoopUtil.scala:66)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:66)
at org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:762)
at org.apache.spark.deploy.yarn.ExecutorLauncher$.main(ApplicationMaster.scala:785)
at org.apache.spark.deploy.yarn.ExecutorLauncher.main(ApplicationMaster.scala)
19/04/17 14:01:27 INFO yarn.ApplicationMaster: Final app status: FAILED, exitCode: 10, (reason: Uncaught exception: org.apache.spark.SparkException: Failed to connect to driver!)
19/04/17 14:01:27 INFO yarn.ApplicationMaster: Unregistering ApplicationMaster with FAILED (diag message: Uncaught exception: org.apache.spark.SparkException: Failed to connect to driver!)
19/04/17 14:01:27 INFO yarn.ApplicationMaster: Deleting staging directory hdfs://gw-master:8020/user/hdfs/.sparkStaging/application_1555480141477_0003
19/04/17 14:01:27 INFO util.ShutdownHookManager: Shutdown hook called
[2019-04-17 14:01:27.667]Container exited with a non-zero exit code 10. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :

自身遇到主要问题是因为本地机开着虚拟机网卡,而且在适配器中排第一个,提示Failed to connect to driver at 192.168.157.1:54385, retrying ...

可关闭虚拟网卡在进行运行

  • 1
    点赞
  • 2
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值