【Spark】Spark常见错误

1、报错 ERROR TaskSchedulerImpl: Lost executor 3 on 172.16.0.24: Unable to create executor due to Unable to register with external shuffle server due to : Failed to connect to /172.16.0.24:7337

在spark-defaults.conf文件中添加：

spark.shuffle.service.enabled  true

2、spark-submit后运行程序连接不上子节点

java.net.ConnectException: Connectionrefused

INFOzookeeper.ClientCnxn: Opening socket connection to serverlocalhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknownerror)
估计是用到了Hbase：

将Hbase目录中conf下hbase-site.xml拷贝到spark的conf目录下