【大数据语言】Scala
自然语言处理-nlp
熟能生巧
展开
-
toDF需要导入的包
//导入隐饰操作,否则RDD无法调用toDF方法 import sparkSession.implicits._原创 2017-10-26 10:00:02 · 4169 阅读 · 0 评论 -
尽量使用reduceByKey代替groupByKey
val words = Array("one", "two", "two", "three", "three", "three")val wordPairsRDD = sc.parallelize(words).map(word => (word, 1)) val wordCountsWithReduce = wordPairsRDD .reduceByKey(_ + _)转载 2018-05-18 18:46:11 · 3272 阅读 · 0 评论 -
idea安装scala插件后没有new》Scala class选项
=>file=>project structure => +号 =>选择本机scala的安装路径 =>apply=>oknew后有了Scala class原创 2018-06-11 16:37:12 · 3487 阅读 · 0 评论