启动spark异常:failed to launch: nice -n 0 /usr/local/spark/bin/spark-class org.apache.spark.deploy.work

第一次启动spark出现异常:failed to launch: nice -n 0 /usr/local/spark/bin/spark-class

日志:

starting org.apache.spark.deploy.master.Master, logging to
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.master.Master-1-master.out
slave1: starting org.apache.spark.deploy.worker.Worker, logging to
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.worker.Worker-1-slave1.out
slave2: starting org.apache.spark.deploy.worker.Worker, logging to
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.worker.Worker-1-slave2.out
slave2: failed to launch: nice -n 0 /usr/local/spark/bin/spark-class
org.apache.spark.deploy.worker.Worker --webui-port 8081
spark://master:7077 slave2: full log in
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.worker.Worker-1-slave2.out
slave1: failed to launch: nice -n 0 /usr/local/spark/bin/spark-class
org.apache.spark.deploy.worker.Worker --webui-port 8081
spark://master:7077 slave1: full log in
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.worker.Worker-1-slave1.out

搜索了一下查找资料:
https://www.ibm.com/support/knowledgecenter/en/SSCTFE_1.1.0/com.ibm.azk.v1r1.azka100/topics/azkic_u_troubleshooting-spark.htm

An error occurs when starting the master, but the master starts correctly
Symptom

When starting the master, the following error occurs: bash-4.2$
$SPARK_HOME/sbin/start-master.sh starting
org.apache.spark.deploy.master.Master, logging to
/u/user/Billy/logs/spark–org.apache.spark.deploy.master.Master-1-ALPS.out
failed to launch org.apache.spark.deploy.master.Master: full log in
/u/user/Billy/logs/spark–org.apache.spark.deploy.master.Master-1-ALPS.out

Cause

Apache Spark polls for a number of seconds to repeatedly check to see
if the master started successfully. If your system is under heavy
load, this message might appear, but it generally means that the check
finished polling for success before the master startup completed.

Apache Spark轮询几秒钟,以反复检查主服务器是否成功启动。 如果您的系统负载很重,可能会显示此消息,但这通常意味着检查在主启动完成之前完成了轮询以确保成功。

Response

Check the master log, or issue the ps command and look for the master
process to definitively see whether or not the master started
successfully.

检查主日志,或发出ps命令并查找主进程以明确查看主服务器是否已成功启动。

  • 1
    点赞
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值