spark Streaming newFilesOnly无法处理已有文件记录
val sparkconf = new SparkConf().setAppName("st").setMaster("local[2]")val ssc = new StreamingContext(sc, Seconds(60))val path = "C:\\Users\\Desktop\\files\\*"val lines: DStream[String] = ssc.fileStream[LongWritable, Text, TextInputFormat](path, (t: ...
原创
2022-05-31 16:50:17 ·
158 阅读 ·
0 评论