使用Spark-shell --master yarn 命令报错:
Dynamic allocation of excutors requires the external shuffle service. You may enable this through spark.shuffle.service.enable
问题描述:使用Spark-shell --master yarn 命令报错: Dynamic allocation of excutors requires the external shuffle service. You may enable this through spark.shuffle.service.enable原因分析:检查服务端与客户端spark.shuffle.service.enable配置不对导致解决方案:将spark.shuffle.service.enabl