spark
firefaith
这个作者很懒,什么都没留下…
展开
-
Spark updateWithState
import org.apache.kafka.common.serialization.StringDeserializerimport org.apache.spark.SparkConfimport org.apache.spark.streaming.dstream.DStreamimport org.apache.spark.streaming.kafka010.ConsumerS...原创 2018-03-28 18:47:24 · 255 阅读 · 0 评论 -
RDD 辅助功能 implicts
object RDDImplict{implicit class RDDOps[T](rdd: RDD[T]) { def partitionBy(f: T => Boolean): (RDD[T], RDD[T]) = { val passes = rdd.filter(f) val fails = rdd.filter(e => !f(e)) // Spar...原创 2018-11-02 17:33:06 · 244 阅读 · 0 评论