Error starting the context, marking it as stopped

于 2022-08-18 20:46:36 发布
阅读量516 收藏
点赞数 1
分类专栏： Kafka 文章标签： kafka scala spark
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/ztx22555/article/details/126413485
版权

导包还是需要小心一点的
在这里插入图片描述
删除包之前的包
在这里插入图片描述
修改之后的包
在这里插入图片描述

2022-08-1820:40:06,816 ERROR --- [                                              main] org.apache.spark.streaming.StreamingContext                                     (line:   94) : Error starting the context, marking it as stopped
org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:820)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:631)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:612)
	at org.apache.spark.streaming.kafka010.Subscribe.onStart(ConsumerStrategy.scala:92)
	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.consumer(DirectKafkaInputDStream.scala:73)
	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.start(DirectKafkaInputDStream.scala:258)
	at org.apache.spark.streaming.DStreamGraph.$anonfun$start$7(DStreamGraph.scala:55)
	at org.apache.spark.streaming.DStreamGraph.$anonfun$start$7$adapted(DStreamGraph.scala:55)
	at scala.collection.Iterator.foreach(Iterator.scala:943)
	at scala.collection.Iterator.foreach$(Iterator.scala:943)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
	at scala.collection.parallel.ParIterableLike$Foreach.leaf(ParIterableLike.scala:974)
	at scala.collection.parallel.Task.$anonfun$tryLeaf$1(Tasks.scala:53)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at scala.util.control.Breaks$$anon$1.catchBreak(Breaks.scala:67)
	at scala.collection.parallel.Task.tryLeaf(Tasks.scala:56)
	at scala.collection.parallel.Task.tryLeaf$(Tasks.scala:50)
	at scala.collection.parallel.ParIterableLike$Foreach.tryLeaf(ParIterableLike.scala:971)
	at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute(Tasks.scala:153)
	at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute$(Tasks.scala:149)
	at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.compute(Tasks.scala:440)
	at java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1067)
	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1703)
	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:172)
	at ... run in separate thread using org.apache.spark.util.ThreadUtils ... ()
	at org.apache.spark.streaming.StreamingContext.liftedTree1$1(StreamingContext.scala:585)
	at org.apache.spark.streaming.StreamingContext.start(StreamingContext.scala:577)
	at com.tianyi.spark.SparkKafkaConsumer$.main(SparkKafkaConsumer.scala:35)
	at com.tianyi.spark.SparkKafkaConsumer.main(SparkKafkaConsumer.scala)
Caused by: org.apache.kafka.common.KafkaException: class org.codehaus.jackson.map.deser.std.StringDeserializer is not an instance of org.apache.kafka.common.serialization.Deserializer
	at org.apache.kafka.common.config.AbstractConfig.getConfiguredInstance(AbstractConfig.java:374)
	at org.apache.kafka.common.config.AbstractConfig.getConfiguredInstance(AbstractConfig.java:392)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:713)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:631)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:612)
	at org.apache.spark.streaming.kafka010.Subscribe.onStart(ConsumerStrategy.scala:92)
	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.consumer(DirectKafkaInputDStream.scala:73)
	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.start(DirectKafkaInputDStream.scala:258)
	at org.apache.spark.streaming.DStreamGraph.$anonfun$start$7(DStreamGraph.scala:55)
	at org.apache.spark.streaming.DStreamGraph.$anonfun$start$7$adapted(DStreamGraph.scala:55)
	at scala.collection.Iterator.foreach(Iterator.scala:943)
	at scala.collection.Iterator.foreach$(Iterator.scala:943)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
	at scala.collection.parallel.ParIterableLike$Foreach.leaf(ParIterableLike.scala:974)
	at scala.collection.parallel.Task.$anonfun$tryLeaf$1(Tasks.scala:53)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at scala.util.control.Breaks$$anon$1.catchBreak(Breaks.scala:67)
	at scala.collection.parallel.Task.tryLeaf(Tasks.scala:56)
	at scala.collection.parallel.Task.tryLeaf$(Tasks.scala:50)
	at scala.collection.parallel.ParIterableLike$Foreach.tryLeaf(ParIterableLike.scala:971)
	at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute(Tasks.scala:153)
	at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute$(Tasks.scala:149)
	at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.compute(Tasks.scala:440)
	at java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1067)
	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1703)
	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:172)
Exception in thread "main" org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:820)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:631)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:612)
	at org.apache.spark.streaming.kafka010.Subscribe.onStart(ConsumerStrategy.scala:92)
	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.consumer(DirectKafkaInputDStream.scala:73)
	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.start(DirectKafkaInputDStream.scala:258)
	at org.apache.spark.streaming.DStreamGraph.$anonfun$start$7(DStreamGraph.scala:55)
	at org.apache.spark.streaming.DStreamGraph.$anonfun$start$7$adapted(DStreamGraph.scala:55)
	at scala.collection.Iterator.foreach(Iterator.scala:943)
	at scala.collection.Iterator.foreach$(Iterator.scala:943)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
	at scala.collection.parallel.ParIterableLike$Foreach.leaf(ParIterableLike.scala:974)
	at scala.collection.parallel.Task.$anonfun$tryLeaf$1(Tasks.scala:53)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at scala.util.control.Breaks$$anon$1.catchBreak(Breaks.scala:67)
	at scala.collection.parallel.Task.tryLeaf(Tasks.scala:56)
	at scala.collection.parallel.Task.tryLeaf$(Tasks.scala:50)
	at scala.collection.parallel.ParIterableLike$Foreach.tryLeaf(ParIterableLike.scala:971)
	at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute(Tasks.scala:153)
	at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute$(Tasks.scala:149)
	at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.compute(Tasks.scala:440)
	at java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1067)
	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1703)
	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:172)
	at ... run in separate thread using org.apache.spark.util.ThreadUtils ... ()
	at org.apache.spark.streaming.StreamingContext.liftedTree1$1(StreamingContext.scala:585)
	at org.apache.spark.streaming.StreamingContext.start(StreamingContext.scala:577)
	at com.tianyi.spark.SparkKafkaConsumer$.main(SparkKafkaConsumer.scala:35)
	at com.tianyi.spark.SparkKafkaConsumer.main(SparkKafkaConsumer.scala)
Caused by: org.apache.kafka.common.KafkaException: class org.codehaus.jackson.map.deser.std.StringDeserializer is not an instance of org.apache.kafka.common.serialization.Deserializer
	at org.apache.kafka.common.config.AbstractConfig.getConfiguredInstance(AbstractConfig.java:374)
	at org.apache.kafka.common.config.AbstractConfig.getConfiguredInstance(AbstractConfig.java:392)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:713)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:631)
	at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:612)
	at org.apache.spark.streaming.kafka010.Subscribe.onStart(ConsumerStrategy.scala:92)
	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.consumer(DirectKafkaInputDStream.scala:73)
	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.start(DirectKafkaInputDStream.scala:258)
	at org.apache.spark.streaming.DStreamGraph.$anonfun$start$7(DStreamGraph.scala:55)
	at org.apache.spark.streaming.DStreamGraph.$anonfun$start$7$adapted(DStreamGraph.scala:55)
	at scala.collection.Iterator.foreach(Iterator.scala:943)
	at scala.collection.Iterator.foreach$(Iterator.scala:943)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
	at scala.collection.parallel.ParIterableLike$Foreach.leaf(ParIterableLike.scala:974)
	at scala.collection.parallel.Task.$anonfun$tryLeaf$1(Tasks.scala:53)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at scala.util.control.Breaks$$anon$1.catchBreak(Breaks.scala:67)
	at scala.collection.parallel.Task.tryLeaf(Tasks.scala:56)
	at scala.collection.parallel.Task.tryLeaf$(Tasks.scala:50)
	at scala.collection.parallel.ParIterableLike$Foreach.tryLeaf(ParIterableLike.scala:971)
	at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute(Tasks.scala:153)
	at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute$(Tasks.scala:149)
	at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.compute(Tasks.scala:440)
	at java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1067)
	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1703)
	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:172)

Process finished with exit code 1

建议可以把包都给删除，在重新导一下包

长不大的蜡笔小新
关注
  • 1
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 1
    评论
专栏目录
C40-Marking-the-player-car
04-05
在游戏开发领域，"C40-Marking-the-player-car"是一个可能涉及到的特定功能或模块，主要用于在游戏中识别和区分玩家所控制的车辆。这个功能对于多人在线竞技游戏、赛车模拟或者任何包含车辆元素的游戏至关重要，因为...
ebt_mark.rar_The Chain
09-23
The mark target can be used in any chain, I believe adding a mangle table just for marking is total overkill. Marking a frame doesn t really change anything in the frame anyway.
Error starting the context, marking it as stopped org.apache.kafka.common.KafkaException: Failed to ...
weixin_30552635的博客
08-18 662
ERROR [main] [org.apache.spark.streaming.StreamingContext] - Error starting the context, marking it as stopped org.apache.kafka.common.KafkaException: Failed to construct kafka consumer a...
ERROR StreamingContext: Error starting the context, marking it as stopped
yxf19034516的博客
12-16 2927
问题描述： 今天帮别人调试flume+kafka+sparkstreaming的整合，在运行的时候报了以下错误： ERROR StreamingContext: Error starting the context, marking it as stopped org.apache.kafka.common.KafkaException: Failed to construct kafka ...
Spark的StreamingContext连接Kafka错误ERROR StreamingContext: Error starting the context, marking it as sto
《@书山有径%》的博客
12-18 1372
Spark StreamingContext连接Kafka错误 ERROR StreamingContext: Error starting the context, marking it as stopped org.apache.kafka.common.KafkaException: Failed to construct kafka consumer at org.apache.kafka.clients.consumer.KafkaConsumer.(KafkaConsumer.java:702
Ubuntu环境下，eclipse 编写c程序，报错error starting process
同销万古愁的博客
03-04 1788
这是一个很小的问题，个人觉得碰巧发生了，很难想到是这个原因，上网查的时候，很多人都是新建Hello Word ANSI C Project程序可以运行，然后自己写的程序出问题，但是我的连helloword都报错，error starting process。查了很多地方，按大家说的做，都不行。最后在http://stackoverflow.com/questions/11390163/runnin...
第7课：Spark Streaming源码解读之JobScheduler内幕实现和深度思考
luobailian的专栏
05-15 2065
本期内容： 1. JobScheduler内幕实现 2. JobScheduler深度思考   所有工作的关键都是jobScheduler SparkStreaming至少要设置两条线程是因为一条用于接收数据，一条用于计算，调度和执行分离开。 源码 StreamingContext.scala Start() /**  * Start the execution of the
SAE AS478-2022 Identification Marking Methods.pdf
最新发布
09-26
SAE AS478-2022 Identification Marking Methods.pdf
dct2_embed_mod.rar_MOD_water marking
07-13
Image Water marking code
software20180831_fiberlaser_lasersoftware_ezcad_Laser-Marking_
09-30
标题中的"software20180831_fiberlaser_lasersoftware_ezcad_Laser-Marking_"表明这是一个关于2018年8月31日发布的一款光纤激光打标机使用的软件，该软件的核心是ezcad系统，专门用于激光标记应用。描述中的"fiber ...
IllegalArgumentException:requirement failed: No output operations registered, so nothing to execute
厚积薄发
04-01 2559
ERROR StreamingContext: Error starting the context, marking it as stopped java.lang.IllegalArgumentException: requirement failed: No output operations registered, so nothing to execute at scal...
Spark Streaming 消费kafka数据出现No current assignment for partition崩溃
dinghua_xuexi的专栏
07-06 3666
问题概述 我们用spark streaming 消费kafka数据，偶尔会出现该问题，其本质原因是多个进程以相同的kafka group id 并行消费同一个topic导致的，碰到该问题，应首先从迅速下面2个方面排查： 多个应用程序使用了相同的kafka group id 去消费同一个topic 一个应用程序，在内部不小心间接地启动了2个消费进程，这2个进程使用了相同的kafka group id 去消费同一个topic 前一个好说，比较容易排查，后一个需要仔细排查程序细节，如果预先没有...
springboot中报Error starting ApplicationContext错误解决方法
上善若水滴世界
08-09 6796
前言 新手在使用springboot经常犯的错误,在引用其他项目中的类,经常会出现这样的错误。 错误再现 *************************** APPLICATION FAILED TO START *************************** Description: Field commonRepository in com.example.student.s...
spark-streaming系列------- 1. spark-streaming的Job调度 上
u012684933的专栏
09-10 2204
这段时间分析了下spark-streming任务调度的源码，成果分享一下。     类似于spark-core，spark-streaming有自己的一套任务调度，具体代码在spark-streaming的scheduler包里面。     我以Kafka DirectDStream数据接收为例，画了一张整体的流程图： 在将这张图之前，需要先明确spark-strea
spark streaming 错误集锦
wzq294328238的专栏
05-27 8081
问题1：No output streams registered, so nothing to execute解决原因：没有触发DStream需要的aciton 解决方法：使用以下方法之一触发：print() foreachRDD() saveAsObjectFiles() saveAsTextFiles() saveAsHadoopFiles()
Error starting ApplicationContext. 错误解决
qq_45806995的博客
11-07 4056
问题描述： 今天写了一个简单的springboot项目，运行后报错：Error starting ApplicationContext. To display the auto-configuration report re-run your application with ‘debug’ enabled. 解决方法： 在启动类的**@EnableAutoConfiguration或@SpringBootApplication**中添加(exclude = {DataSourceAutoConfigura
Agent configuration for 'a1' does not contain any valid channels. Marking it as invalid
05-24
这个错误通常意味着你的机器人（bot）没有被正确配置为使用至少一个有效通道（channel）与用户进行交互。 在配置机器人时，您需要将其与至少一个通道进行连接，这些通道可以是 Slack、Facebook Messenger、Telegram 等。这样，用户就可以通过这些通道与机器人进行交互。 您可以检查机器人的配置文件，确保至少有一个通道被正确地配置和启用。如果您使用的是某个聊天机器人开发平台，例如 Dialogflow 或 Botpress，您还需要确保已正确配置机器人与您的通道进行集成。 如果您仍然无法解决此问题，请查阅机器人配置文档，或者寻求相关技术支持。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

长不大的蜡笔小新

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值