环境:
spark:2.4.4
maven:apache-maven-3.6.2
java: 1.8
背景:
修改了spark源码,想基于此用spark的make-distribution.sh脚本重新打可部署的tar包,命令如下:
./dev/make-distribution.sh --name test-spark --tgz -Phadoop-2.7 -Phive -Phive-thriftserver -Pyarn -Pkubernetes -Psparkr -DskipTests
问题:
报错:
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-kubernetes_2.11: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.: CompileFailed -> [Help 1]
办法:
针对此问题,网上一般尝试方法:
1. 添加依赖:
<dependency>
<groupId>net.alchim31.maven</groupId>
<artifactId>scala-maven-plugin</artifactId>
<version>3.2.2</version>
</dependency>