spark on yarn实例练习

1、spark on yarn作业提交（yarn-client模式）

bin/spark-submit \
--class dajiangtai.averageAge \
--master yarn-client \
--num-executors 1 \
--driver-memory 1g \
--executor-memory 1g \
--executor-cores 1 \
lib/wordcount-1.0-SNAPSHOT.jar \
hdfs://192.168.101.128:9000/test/age.txt \
hdfs://192.168.101.128:9000/test/result1

2、求平均年龄

3、求男女最大身高

4、寻找搜索频率最高的K个关键词（注意case用法）

转载于:https://www.cnblogs.com/VillageKnight-Ding/p/8150545.html