Spark stop all 失败

spark stop all 不成功，提示如下

[root@sm61 sbin]# ./stop-all.sh
s92.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s95.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s76.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s93.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s74.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s78.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s71.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s73.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s72.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s99.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s75.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s94.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s77.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s96.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s97.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s98.spark.starv.com: no org.apache.spark.deploy.worker.Worker to stop
s91.spark.starv.com: ssh: connect to host s91.spark.starv.com port 22: No route to host
no org.apache.spark.deploy.master.Master to stop

因为没有 找到进程的 ID ，所以 无法stop， 那么 进程的 ID 存储在 哪呢 ？

spark-daemon.sh 里有这样一句话：

if [ "$SPARK_PID_DIR" = "" ]; then
  SPARK_PID_DIR=/tmp
fi

如果没有 配置$SPARK_PID_DIR这个环境变量，那么就在/tmp里面，但是因为系统会定期清空/tmp目录。

所以在 conf/spark-evn.sh 配置了 这个 环境变量。然后重启。

 

 

转载于:https://www.cnblogs.com/soupwater/p/7159064.html