sparkStreaming+kafka SparkException: java.nio.channels.ClosedChannelException异常报错

A阿楠521

于 2019-09-09 18:43:23 发布

阅读量1.5k

点赞数

CC 4.0 BY-SA版权

分类专栏： kafka 文章标签： sparkStreaming+kafka报错

本文链接：https://blog.csdn.net/qq_43412289/article/details/100670865

在运行sparkStreaming+kafka的时候报错 java io报错，

如果broker-list的端口不对或者kafka服务端未启动，会遇到以下错误：

Exception in thread "main" org.apache.spark.SparkException: java.nio.channels.ClosedChannelException
	at org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)
	at org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)
	at scala.util.Either.fold(Either.scala:97)
	at org.apache.spark.streaming.kafka.KafkaCluster$.checkErrors(KafkaCluster.scala:365)
	at org.apache.spark.streaming.kafka.KafkaUtils$.getFromOffsets(KafkaUtils.scala:222)
	at org.apache.spark.streaming.kafka.KafkaUtils$.createDirectStream(KafkaUtils.scala:484)
	at com.xxx.spark.main.xxx.createStream(xxx.scala:223)
	at com.xxx.spark.main.xxx.createStreamingContext(xxx.