1. 问题描述
启动spark时报错,使用start_all.sh
或在slave节点上start_slave.sh
都报相同的错。
- 报错信息如下:
19/04/20 04:35:49 INFO Utils: Successfully started service 'sparkWorker' on port 45265.
19/04/20 04:35:49 INFO Worker: Starting Spark worker 192.168.182.130:45265 with 1 cores, 1024.0 MB RAM
19/04/20 04:35:49 INFO Worker: Running Spark version 2.4.1
19/04/20 04:35:49 INFO Worker: Spark home: /opt/spark
19/04/20 04:35:50 INFO Utils: Successfully started service 'WorkerUI' on port 8081.
19/04/20 04:35:50 INFO WorkerWebUI: Bound WorkerWebUI to 0.0.0.0, and started at http://slave1:8081
19/04/20 04:35:50 INFO Worker: Connecting to master master:7077...
19/04/20 04:35:50 WARN Worker: Failed to connect to master master:7077
org.apache.spark.SparkException: Exception thrown in awaitResult:
at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:226)
at org.apach