SparkStreaming报错: Only one SparkContext may be running in this JVM (see SPARK-2243)

最新推荐文章于 2022-05-24 09:58:47 发布

x²＋(y－√³x²)²＝1

最新推荐文章于 2022-05-24 09:58:47 发布

阅读量1.7k

点赞数

分类专栏： Spark

本文链接：https://blog.csdn.net/qq_45083975/article/details/109759997

版权

Spark 专栏收录该内容

7 篇文章 0 订阅

订阅专栏

报错信息：

Exception in thread "main" org.apache.spark.SparkException: 
Only one SparkContext may be running in this JVM (see SPARK-2243). 
To ignore this error, set spark.driver.allowMultipleContexts = true. 
The currently running SparkContext was created at:
org.apache.spark.api.java.JavaSparkContext

原因：

出现这个问题的原因就是你创建了多个 SparkContext ,就像下面这种用法,只需要干掉J avaSparkContext 就可:

SparkConf conf = new SparkConf()
   			.setAppName(“myapplication”).setMaster(“local[4]”);
JavaSparkContext jsc = new JavaSparkContext(conf);
JavaStreamingContext stream = new JavaStreamingContext(conf, Durations.seconds(10));

解决这个问题两种方式:

方式1：

SparkConf conf = new SparkConf()
				.setAppName(“myapplication”)  .setMaster(“local[4]”);
 JavaStreamingContext stream = new JavaStreamingContext(conf, Durations.seconds(10));

方式2：

SparkConf conf = new SparkConf()
.setAppName(“myapplication”).setMaster(“local[4]”);
JavaSparkContext jsc = new JavaSparkContext(conf);
JavaStreamingContext stream = new JavaStreamingContext(jsc, Durations.seconds(10));