spark运行出现的错误案例

最新推荐文章于 2024-07-15 18:02:27 发布

mas2005

最新推荐文章于 2024-07-15 18:02:27 发布

阅读量2.6k

点赞数 1

分类专栏： spark 文章标签： spark错误记录

本文链接：https://blog.csdn.net/mas2005/article/details/81145123

版权

spark 专栏收录该内容

5 篇文章 0 订阅

订阅专栏

1.错误描述：

org.apache.spark.SparkException: Only one SparkContext may be running in this JVM (see SPARK-2243). To ignore this error, set spark.driver.allowMultipleContexts = true. The currently running SparkContext was created at:
org.apache.spark.SparkContext.<init>(SparkContext.scala:75)
recommend_util$.<init>(recommend_util.scala:10)
recommend_util$.<clinit>(recommend_util.scala)
recommend_demo1$.main(recommend_demo1.scala:11)
recommend_demo1.main(recommend_demo1.scala)
   at org.apache.spark.SparkContext$$anonfun$assertNoOtherContextIsRunning$2.apply(SparkContext.scala:2456)
   at org.apache.spark.SparkContext$$anonfun$assertNoOtherContextIsRunning$2.apply(SparkContext.scala:2452)
   at scala.Option.foreach(Option.scala:257)
   at org.apache.spark.SparkContext$.assertNoOtherContextIsRunning(SparkContext.scala:2452)
   at org.apache.spark.SparkContext$.setActiveContext(SparkContext.scala:2554)
   at org.apache.spark.SparkContext.<init>(SparkContext.scala:2408)
   at recommend_demo1$.main(recommend_demo1.scala:15)
   at recommend_demo1.main(recommend_demo1.scala)

解决办法：

sparkConf.set("spark.driver.allowMultipleContexts","true");