pythonshell中编写spark程序(wordcount)
sc.textFile("hdfs://linux01:9000/data/wordcount").flatMap(lambda line:line.split(" ")).map(lambda word:(word,1)).reduceByKey(lambda x,y:x + y).sortBy(lambda t:t[1],False).collect()
pythonshell中编写spark程序(wordcount)
sc.textFile("hdfs://linux01:9000/data/wordcount").flatMap(lambda line:line.split(" ")).map(lambda word:(word,1)).reduceByKey(lambda x,y:x + y).sortBy(lambda t:t[1],False).collect()