pioneer_LL的博客

原创 spark Streaming newFilesOnly无法处理已有文件记录

val sparkconf = new SparkConf().setAppName("st").setMaster("local[2]") val ssc = new StreamingContext(sc, Seconds(60)) val path = "C:\\Users\\Desktop\\files\\*" val lines: DStream[String] = ssc.fileStream[LongWritable, Text, TextInputFormat](path, (t: ...