![](https://img-blog.csdnimg.cn/20201014180756927.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
spark
firefaith
这个作者很懒,什么都没留下…
展开
-
Spark updateWithState
import org.apache.kafka.common.serialization.StringDeserializer import org.apache.spark.SparkConf import org.apache.spark.streaming.dstream.DStream import org.apache.spark.streaming.kafka010.ConsumerS...原创 2018-03-28 18:47:24 · 251 阅读 · 0 评论 -
RDD 辅助功能 implicts
object RDDImplict{ implicit class RDDOps[T](rdd: RDD[T]) { def partitionBy(f: T => Boolean): (RDD[T], RDD[T]) = { val passes = rdd.filter(f) val fails = rdd.filter(e => !f(e)) // Spar...原创 2018-11-02 17:33:06 · 235 阅读 · 0 评论