完成:
1、Wordcount程序开发环境搭建,eclipse+intellj idea
2、wordcount程序开发,本地单机运行,出统计结果
3、结合源码追踪Wordcount中RDD数据流,并作出简单图示
遗留问题:
1、intelligent idea环境中运行报错Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps;
at org.apache.spark.util.Utils$.getCallSite(Utils.scala:1434)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:76)
at firstTest$.main(firstTest.scala:11)
at firstTest.main(firstTest.scala)