Intelij IDEA编译spark源码过程
- 下在spark源码包,解压
- intellij安装scala plugin
- 使用intellij ieda open project功能打开源码文件夹
此后,idea会自动下载所有的依赖包,下载完后 build -> Make Project 即可编译!!
推荐使用新版本的ieda,建议本机预先安装sbt环境,将sbt所需文件下载好
sbt的安装配置参见:http://blog.csdn.net/tanglizhe1105/article/details/50528801
sbt建立intellij ieda工程参见:http://blog.csdn.net/tanglizhe1105/article/details/50528824
Spark build error 1
D:\spark-1.6.0\external\flume-sink\src\main\scala\org\apache\spark\streaming\flume\sink\SparkAvroCallbackHandler.scala
Error:(45, 66) not found: type SparkFlumeProtocol
val transactionTimeout: Int, val backOffInterval: Int) extends SparkFlumeProtocol with Logging {
^
Error:(