解决通过spark-shell 连接集群产生的不能连接master问题

最新推荐文章于 2022-10-16 18:07:15 发布

lwnowhy

最新推荐文章于 2022-10-16 18:07:15 发布

阅读量7.6k

点赞数 1

文章标签： spark 内存不足

本文链接：https://blog.csdn.net/lwnowhy/article/details/25223999

版权

spark集群启动后通过MASTER=spark://spark01:7077 ./spark-shell 连接报以下错误

14/05/07 01:13:23 INFO AppClient$ClientActor: Executor updated: app-20140507011322-0000/1 is now RUNNING
14/05/07 01:13:23 INFO AppClient$ClientActor: Executor updated: app-20140507011322-0000/0 is now RUNNING
14/05/07 01:13:23 INFO AppClient$ClientActor: Executor updated: app-20140507011322-0000/0 is now FAILED (class java.io.IOException: Cannot run program "java" (in directory "/cloud/spark-0.9.1/work/app-20140507011322-0000/0"): java.io.IOException: error=2, No such file or directory)
14/05/07 01:13:23 INFO SparkDeploySchedulerBackend: Executor app-20140507011322-0000/0 removed: class java.io.IOException: Cannot run program "java" (in directory "/cloud/spark-0.9.1/work/app-20140507011322-0000/0"): java.io.IOException: error=2, No such file or directory
14/05/07 01:13:23 INFO AppClient$ClientActor: Executor added: app-20140507011322-0000/2 on worker-20140507011221-spark03-50612 (spark03:50612) with 1 cores
14/05/07 01:13:23 INFO SparkDeploySchedulerBackend: Granted executor ID app-20140507011322-0000/2 on hostPort spark03:50612 with 1 cores, 512.0 MB RAM
14/05/07 01:13:23 INFO AppClient$ClientActor: Executor updated: app-20140507011322-0000/1 is now FAILED (class java.io.IOException: Cannot run program "java" (in directory "/cloud/spark-0.9.1/work/app-20140507011322-0000/1"): java.io.IOException: error=2, No such file or directory)
14/05/07 01:13:23 INFO SparkDeploySchedulerBackend: Executor app-20140507011322-0000/1 removed: class java.io.IOException: Cannot run program "java" (in directory "/cloud/spark-0.9.1/work/app-20140507011322-0000/1"): java.io.IOException: error=2, No such file or directory
14/05/07 01:13:23 INFO AppClient$ClientActor: Executor added: app-20140507011322-0000/3 on worker-20140507011221-spark02-33183 (spark02:33183) with 1 cores
14/05/07 01:13:23 INFO SparkDeploySchedulerBackend: Granted executor ID app-20140507011322-0000/3 on hostPort spark02:33183 with 1 cores, 512.0 MB RAM
14/05/07 01:13:23 INFO AppClient$ClientActor: Executor updated: app-20140507011322-0000/3 is now RUNNING
14/05/07 01:13:23 INFO AppClient$ClientActor: Executor updated: app-20140507011322-0000/2 is now RUNNING
14/05/07 01:13:23 INFO AppClient$ClientActor: Executor updated: app-20140507011322-0000/2 is now FAILED (class java.io.IOException: Cannot run program "java" (in directory "/cloud/spark-0.9.1/work/app-20140507011322-0000/2"): java.io.IOException: error=2, No such file or directory)
14/05/07 01:13:23 INFO SparkDeploySchedulerBackend: Executor app-20140507011322-0000/2 removed: class java.io.IOException: Ca