1、spark standalone Cilent 端模式
setMaster(“local”)不写 写了就是在本地运行
运行脚本 word.sh
/usr/local/spark-2.2.0-bin-2.6.0-cdh5.7.0/bin/spark-submit
–class com.etc.WordCount
–master spark://master:7077
/usr/local/SparkWordCount-1.0-SNAPSHOT.jar
2.spark-submit 在yarn 上运行
脚本:
/usr/local/spark-2.2.0-bin-2.6.0-cdh5.7.0/bin/spark-submit
–master yarn
–class org.apache.spark.examples.SparkPi
–deploy-mode client \ /cluster
–driver-memory 1g
–executor-memory 1g
–executor-cores 2
–queue default
/usr/local/spark-2.2.0-bin-2.6.0-cdh5.7.0/examples/jars/spark-examples_2.11-2.2.0.jar
100
需要配置一些文件,显示最后的日志文件
**地址:**https://blog.csdn.net/qq_38038143/article/details/88641288
结果图: