spark集群外submit

    除了远程调试之外，其实也可以在部署spark master/slave的机器外，如：

装部署有yarn的（yarn slave）机器上submit任务，这个地球人都知道；

或者是单独装有spark的机器（并未配置到spark的master/slave中）上以stand alone提交任务，这个大家应该很少遇见（类似于idea里面的远程调试）；

当然此时的driver一样都在提交的机器上（默认的client模式），这个在master的log文件其实能看出来（sparkUI更方便）：

spark-root-org.apache.spark.deploy.master.Master-1-master.out。

...

18/05/15 07:38:43 INFO Master: Registering app testSystem
18/05/15 07:38:43 INFO Master: Registered app testSystem with ID app-20180515073843-2305
18/05/15 07:38:43 INFO Master: Launching executor app-20180515073843-2305/0 on worker worker-20180404142647-192.168.2.9-44567
18/05/15 07:38:43 INFO Master: Launching executor app-20180515073843-2305/1 on worker worker-20180404142647-192.168.2.8-47648
18/05/15 07:38:43 INFO Master: Launching executor app-20180515073843-2305/2 on worker worker-20180404142646-192.168.2.2-53613
18/05/15 07:38:43 INFO Master: Launching executor app-20180515073843-2305/3 on worker worker-20180404142646-192.168.2.33-22895
18/05/15 07:38:43 INFO Master: Launching executor app-20180515073843-2305/4 on worker worker-20180404142649-192.168.2.15-52673
18/05/15 08:13:18 INFO Master: Received unregister request from application app-20180515073843-2305
18/05/15 08:13:18 INFO Master: Removing app app-20180515073843-2305
18/05/15 08:13:18 INFO Master: slave16:42428 got disassociated, removing it.
18/05/15 08:13:18 INFO Master: 192.168.2.16:9619 got disassociated, removing it.
18/05/15 08:13:18 WARN Master: Got status update for unknown executor app-20180515073843-2305/3
18/05/15 08:13:20 WARN Master: Got status update for unknown executor app-20180515073843-2305/1
18/05/15 08:13:20 WARN Master: Got status update for unknown executor app-20180515073843-2305/2
18/05/15 08:13:21 WARN Master: Got status update for unknown executor app-20180515073843-2305/0

18/05/15 08:13:21 WARN Master: Got status update for unknown executor app-20180515073843-2305/4

附：