Spark源码阅读_1：Spark2.4.3 win10 IDEA 源码编译调试踩坑

---

1.安装包准备

jdk1.8
maven3.5.4
scala2.11.2
git2.32.0
spark2.4.3【spark-2.4.3.tgz 】
注意：安装过程，自行百度，版本要一致，我是认真看了pom文件确定的版本。

---

2.报错

在源码根目录运行cmd,执行

./build/mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.5 -DskipTests clean package

报错如下：

[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 54.874 s
[INFO] Finished at: 2021-07-04T23:49:50+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.8:run (default) on project spark-core_2.11: An Ant BuildException has occured: Execute failed: java.io.IOException: Cannot run program "bash" (in directory "F:\SRC_learn\spark-2.4.3\core"): CreateProcess error=2, 系统找不到指定的文件。
[ERROR] around Ant part ...<exec executable="bash">... @ 4:27 in F:\SRC_learn\spark-2.4.3\core\target\antrun\build-main.xml

---

3.日志分析

分析不能执行bash命令

Cannot run program "bash"

---

4.解决方案

改为在GitBash中运行编译指令


最终编译成功

---