spark-submit代码 Error communicating with MapOutp utTracker错误解决_sparkexception: error communicating with mapoutput-CSDN博客

本文链接：https://blog.csdn.net/tiger1334/article/details/70807729

本文介绍了在使用`spark-submit`时遇到`Error communicating with MapOutputTracker`错误的解决方法，强调了在SparkConf中设置`setMaster("local")`的重要性，以避免提交作业时出现问题。

摘要由CSDN通过智能技术生成

spark-submit --master spark://ip:port --class com.deng.sparkTest.Test SparkTest-1.0-SNAPSHOT.jar

注意SparkConf设置setMaster("local")，否则提交后会报错：

17/04/26 16:08:29 ERROR MapOutputTrackerMaster: Error communicating with MapOutp
utTracker
java.lang.InterruptedException
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireShare
dNanos(AbstractQueuedSynchronizer.java:1326)
        at scala.concurrent.impl.Promise$DefaultPromise.tryAwait(Promise.scala:2
08)
        at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:218)

        at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223
)
        at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:107)
        at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockConte
xt.scala:53)
        at scala.concurrent.Await$.result(package.scala:107)
        at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:75)
        at org.apache.spark.rpc.RpcEndpointRef.askWithRetry(RpcEndpointRef.scala
:101)
        at org.apache.spark.rpc.RpcEndpointRef.askWithRetry(RpcEndpointRef.scala
:77)
        at org.apache.spark.MapOutputTracker.askTracker(MapOutputTracker.scala:1
10)
        at org.apache.spark.MapOutputTracker.sendTracker(MapOutputTracker.scala:
120)
        at org.apache.spark.MapOutputTrackerMaster.stop(MapOutputTracker.scala:4
68)
        at org.apache.spark.SparkEnv.stop(SparkEnv.scala:93)