- 博客(3)
- 收藏
- 关注
RSS订阅原创 sparkstreaming与sparksql结合使用统计wordcount
package com.imooc.sparkimport org.apache.spark.SparkConfimport org.apache.spark.rdd.RDDimport org.apache.spark.sql.SparkSessionimport org.apache.spark.streaming.{Seconds, StreamingContext, Time}// spark streming 整合sparksql 完成词频统计object sqlnetworkw
2021-01-15 15:08:33
163
原创 sparkstreaming --通过updatebykey统计有状态的数据
package com.imooc.sparkimport org.apache.spark.SparkConfimport org.apache.spark.streaming.{Seconds, StreamingContext}//统计有状态的流式计算object stateful { def main(args: Array[String]): Unit = { val conf = new SparkConf().setAppName("stateful").setMas
2021-01-14 18:42:48
104
原创 spark-streaming将实时数据写入到mysql 中
package com.imooc.sparkimport java.sql.DriverManagerimport com.imooc.spark.stateful.updateFunctionimport org.apache.spark.SparkConfimport org.apache.spark.streaming.{Seconds, StreamingContext}object foreachrdd { def main(args: Array[String]): Uni
2021-01-14 18:41:41
1052
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人