黑曼巴

我这里使用spark2.4.4版本；1.入口脚本与入口类进入org.apache.spark.deploy.SparkSubmit类的main方法override def main(args: Array[String]): Unit = { val submit = new SparkSubmit() { self => override protected def parseArguments(args: Array[String]): SparkSubm

/** * The high-level scheduling layer that implements stage-oriented scheduling. It computes a DAG of * stages for each job, keeps track of which RDDs and stage outputs are materialized, and finds a * minimal schedule to run the job. It then submits sta

待完善

待完善

待完善

在介绍之前，我先附上spark 官方文档地址：http://spark.apache.org/docs/latest/api/java/org/apache/spark/launcher/package-summary.html源码github地址：https://github.com/yyijun/framework/tree/master/framework-spark1.主要提交参数说明 spark-submit \ --master yarn \ --...