本篇分析一个spark例子程序。
程序实现的功能是:分别统计包含字符a、b的行数。
java源码如下:
package sparkTest;
import org.apache.spark.SparkConf;
import org.apache.spark.api.java.JavaRDD;
import org.apache.spark.api.java.JavaSparkContext;
import org.apache.spark.api.java.function.Function;
public class SimpleApp {
<span style="white-space:pre"> </span>
<span style="white-space:pre"> </span>public static void main(String[] args) {
<span style="white-space:pre"> </span>String logFile = "file:///usr/local/spark/README.md"; // Should be some file on your system
<span style="white-space:pre"> </span>SparkConf conf = new SparkConf().setAppName("Simple Application").setMaster("local");
<span style="white-space:pre"> </span>JavaSparkContext sc = new JavaSparkContext(