hudi-0.10.0编译

一、系统环境

1. 操作系统

Linux 3.10.0-862.el7.x86_64 #1 SMP 2018 x86_64 x86_64 x86_64 GNU/Linux

2. hadoop版本

hadoop-3.1.3 

3. maven版本

maven-3.8.4

4. maven的镜像源

<mirrors>
    <mirror>
      <id>alimaven</id>
      <name>aliyun maven</name>
      <url>http://maven.aliyun.com/nexus/content/groups/public</url>
      <mirrorOf>central</mirrorOf>
    </mirror>

    <mirror>
      <id>alimaven</id>
      <mirrorOf>*</mirrorOf>
      <name>阿里云spring插件仓库</name>
      <url>http://maven.aliyun.com/repository/spring-plugin</url>
    </mirror>

    <mirror>
      <id>repo2</id>
      <mirrorOf>central</mirrorOf>
      <name>Mirror from Maven Repo2</name>
      <url>https://repo.spring.io/plugins-release</url>
    </mirror>

    <mirror>
      <id>UK</id>
      <mirrorOf>central</mirrorOf>
      <name>UK Central</name>
      <url>https://uk.maven.org/maven2</url>
    </mirror>

    <mirror>
      <id>jboss-public-repository-group</id>
      <mirrorOf>central</mirrorOf>
      <name>JBoss Public Repository Group</name>
      <url>https://repository.jboss.org/nexus/content/groups/public</url>
    </mirror>

    <mirror>
      <id>CN</id>
      <mirrorOf>central</mirrorOf>
      <name>OSChina Central</name>
      <url>https://maven.oschina.net/content/groups/public</url>
    </mirror>

    <mirror>
      <id>google-maven-central</id>
      <mirrorOf>central</mirrorOf>
      <name>GCS Maven Central mirror Asia Pacific</name>
      <url>https://maven-central-asia.storage-download.googleapis.com/maven2</url>
    </mirror>

    <mirror>
      <id>confluent</id>
      <mirrorOf>confluent</mirrorOf>
      <name>confluent maven</name>
      <url>http://packages.confluent.io/maven/</url>
    </mirror>

    <mirror>
      <id>nexus-aliyun</id>
      <mirrorOf>central</mirrorOf>
      <name>Nexus aliyun</name>
      <url>http://maven.aliyun.com/nexus/content/groups/public</url>
    </mirror>
    <mirror>
      <id>maven-default-http-blocker</id>
      <mirrorOf>external:http:*</mirrorOf>
      <name>Pseudo repository to mirror external repositories initially using HTTP.</name>
      <url>http://0.0.0.0/</url>
      <blocked>true</blocked>
    </mirror>
  </mirrors>

5. hudi-0.10.0的下载地址

https://archive.apache.org/dist/hudi/0.10.0/

6. hudi-0.10.0的官网地址

https://hudi.apache.org/

二、编译过程

1. 集成框架

hadoop-3.1-3、Scala-2.12、spark3、hive-3.1.2

2. 编译 （在hudi安装包的根目录下执行该语句）

mvn clean install -DskipTests -DskipITs -Dcheckstyle.skip=true -Drat.skip=true -Dhadoop.version=3.1.3 -Dscala-2.12 -Dspark3 -Pflink-bundle-shade-hive3

3. 编译完成
   

三、小结

我已经编译好了，有想直接用的可以私我给你发。