workming:请教一下,Spark On YARN总会失败,信息如下:|@|2014-01-03 16:14:06,675 WARN [main] yarn.ApplicationMaster (Logging.scala:logWarning(60)) - Failed to connect to driver at namenode1:3039, retrying ...|@|2014-01-03 16:14:06,775 WARN [main] yarn.ApplicationMaster (Logging.scala:logWarning(60)) - Failed to connect to driver at namenode1:3039, retrying ...|@|2014-01-03 16:14:06,878 WARN [main] yarn.ApplicationMaster (Logging.scala:logWarning(60)) - Failed to connect to driver at namenode1:3039, retrying ...|@|2014-01-03 16:14:06,979 INFO [main] yarn.ApplicationMaster (Logging.scala:logInfo(48)) - Waiting for Spark context initialization|@|2014-01-03 16:14:06,979 INFO [main] yarn.ApplicationMaster (Logging.scala:logInfo(48)) - Waiting for Spark context initialization ... 0|@|2014-01-03 16:14:07,509 INFO [Thread-3] ipc.Client (Client.java:handleConnectionFailure(783)) - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)|@|2014-01-03 16:14:08,510 INFO [Thread-3] ipc.Client (Client.java:handleConnectionFailure(783)) - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)|@||@|
mysql tdh_socket_thread_num_TDH_Socket与HandlerSocket和MySQL的特性优缺点对比
最新推荐文章于 2021-02-15 23:26:48 发布
这篇博客记录了在尝试运行Spark作业时遇到的问题,具体表现为应用Master无法连接到driver,日志中反复显示尝试连接到namenode1的3039端口失败。应用等待Spark上下文初始化但一直未成功,同时客户端尝试重连服务器但多次失败。
摘要由CSDN通过智能技术生成