![](https://img-blog.csdnimg.cn/20201014180756928.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
spark streaming
瓦力冫
喜欢看点书,跑跑步,热爱游戏编程
展开
-
spark streaming networkwordcount
package com.immooc.sparkimport org.apache.spark.SparkConfimport org.apache.spark.storage.StorageLevelimport org.apache.spark.streaming.{Seconds, StreamingContext}object NetworkWordCount { de...原创 2018-06-19 17:52:43 · 301 阅读 · 0 评论 -
spark streaming 文件系统
package com.immooc.sparkimport org.apache.spark.SparkConfimport org.apache.spark.storage.StorageLevelimport org.apache.spark.streaming.{Seconds, StreamingContext}object FileWordCount { def mai...原创 2018-06-19 17:54:47 · 282 阅读 · 0 评论 -
spark streaming foreachRDD 使用
package com.immooc.sparkimport java.sql.DriverManagerimport org.apache.spark.SparkConfimport org.apache.spark.streaming.{Seconds, StreamingContext}object ForeachRDDApp { def main(args: Array[...原创 2018-06-19 17:56:16 · 583 阅读 · 0 评论 -
spark streaming 中使用 spark sql
package com.immooc.sparkimport org.apache.spark.{SparkConf, rdd}import org.apache.spark.rdd.RDDimport org.apache.spark.storage.StorageLevelimport org.apache.spark.streaming.{Seconds, StreamingCon...原创 2018-06-19 18:06:25 · 2298 阅读 · 1 评论 -
spark streaming kafka 整合
package com.test.sparkimport org.apache.kafka.clients.consumer.ConsumerRecordimport org.apache.kafka.common.serialization.StringDeserializerimport org.apache.spark.SparkConfimport org.apache.spark...原创 2018-06-19 18:20:47 · 303 阅读 · 0 评论