DC/OS运行spark
1、
提交命令如下:
dcos spark run –submit-args=’–deploy-mode cluster –num-executors 4 –executor-cores 1 –executor-memory 2G –conf spark.mesos.coarse=false –conf spark.driver.cores=1 –conf spark.driver.memory=2g –class com.smart.ml.streaming.SalesPurchasingPreStreaming http://10.251.130.101/spark-ml-jar/ml-kmeans-streaming.jar “10.174.229.47:2181,10.174.229.117:2181” “smart_ml_test” “smart_salespurchasing_test” “2”’
注意:前面放运行参数,后面放class和jar,最后放出入参数。
2、
杀死一个spark:
dcos spark kill driver-20170106070034-0005(TASK ID)