Java Spark
这个超人不会灰
这个作者很懒,什么都没留下…
展开
-
Spark自定义累加器
package com.sparkproject.abc;import org.apache.spark.AccumulatorParam;public class UDFAccumulatorClass implements AccumulatorParam { private static final long serialVersionUID = 1L; @Ov原创 2017-12-15 19:46:25 · 1476 阅读 · 0 评论 -
广播变量和累加器
package com.sparkproject.abc;import org.apache.spark.Accumulator;import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.function.FlatMapFu原创 2017-12-15 19:53:27 · 284 阅读 · 0 评论 -
SparkSQL中的DataFrame的两种创建方式。
动态创建:package com.sparkproject.abc;import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java原创 2017-12-15 19:56:25 · 515 阅读 · 0 评论