Scala实现WordCount

最新推荐文章于 2023-11-20 15:31:37 发布

墨卿风竹

最新推荐文章于 2023-11-20 15:31:37 发布

阅读量1.9k

点赞数 1

文章标签： Scala实现WordCount

本文链接：https://blog.csdn.net/qq_43688472/article/details/85012965

版权

世上没有什么困难的事，只有不去努力的人，即使一个小小的问题，如果你都不去操作的话，你永远不能体会那个过程，，一遍不行，我们来2遍，，，，反反复复，千锤百炼，，，
—————————————送给正在努力的你

Scala实现WordCount

object ScalaWordCountAPP {
  def main(args: Array[String]): Unit = {
    val lins = List("hello java python", "hello java", "hello scala java scala hello")
    //切开压平
    val words = lins.flatMap(_.split(" "))
    //把每个单词生成一个一个的tuple
    val tuples = words.map((_, 1))
    //一key进行分组
    val grouped = tuples.groupBy(_._1)
    //统计value的长度
    val sumed = grouped.mapValues(_.size)
    //排序
    val sorted = sumed.toList.sortBy(_._2)
    //降序排列
    val result =sorted.reverse
    println( result)

  }
 }

结果显示

List((hello,4), (java,3), (scala,2), (python,1))
Process finished with exit code 0

在xshell上操作流程

scala> val lins = List("hello java python", "hello java", "hello scala java scala hello")
lins: List[String] = List(hello java python, hello java, hello scala java scala hello)

scala>  val words = lins.flatMap(_.split(" "))
words: List[String] = List(hello, java, python, hello, java, hello, scala, java, scala, hello)

scala>  val tuples = words.map((_, 1))
tuples: List[(String, Int)] = List((hello,1), (java,1), (python,1), (hello,1), (java,1), (hello,1), (scala,1), (java,1), (scala,1), (hello,1))

scala> val grouped = tuples.groupBy(_._1)
grouped: scala.collection.immutable.Map[String,List[(String, Int)]] = Map(scala -> List((scala,1), (scala,1)), java -> List((java,1), (java,1), (java,1)), hello -> List((hello,1), (hello,1), (hello,1), (hello,1)), python -> List((python,1)))

scala> val sumed = grouped.mapValues(_.size)
sumed: scala.collection.immutable.Map[String,Int] = Map(scala -> 2, java -> 3, hello -> 4, python -> 1)

scala> val sorted = sumed.toList.sortBy(_._2)
sorted: List[(String, Int)] = List((python,1), (scala,2), (java,3), (hello,4))

scala> val result =sorted.reverse
result: List[(String, Int)] = List((hello,4), (java,3), (scala,2), (python,1))
整体来一遍：
scala> 
scala> lins.flatMap(_.split(" ")).map((_, 1)).groupBy(_._1).mapValues(_.size).toList.sortBy(_._2)
res8: List[(String, Int)] = List((python,1), (scala,2), (java,3), (hello,4))

万事皆有方法，现在的你没有找到，没有关系，只要你不断坚持，终会发现，，，
—————————————送给正在寻找问题的你