spark streaming 整合kafka 报错 KafkaConsumer is not safe for multi-threaded access

问题描述

spark streaming 使用 直连方式 读取kafka 数据，使用窗口时出现
java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
报错信息如图：

代码

object testScala {
   
  def main(args: Array[String]): Unit = {
   
    val conf = new SparkConf()
      .setAppName("fs01")
      .setMaster("local[*]")
    conf.set("spark.streaming.stopGracefullyOnShutdown", "true")
    conf.set("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
    conf.set("spark.streaming.kafka.max