Hadoop源码编译

环境：CentOS Stream release 8

Hadoop版本：3.3.6

安装步骤（参考源码中的BUILDING.txt文件）：

----------------------------------------------------------------------------------

Building on CentOS 8

----------------------------------------------------------------------------------

* Install development tools such as GCC, autotools, OpenJDK and Maven.
  $ sudo dnf group install --with-optional 'Development Tools'
  $ sudo dnf install java-1.8.0-openjdk-devel maven

* Install Protocol Buffers v3.7.1.
  $ git clone https://github.com/protocolbuffers/protobuf
  $ cd protobuf
  $ git checkout v3.7.1
  $ autoreconf -i
  $ ./configure --prefix=/usr/local
  $ make
  $ sudo make install
  $ cd ..

* Install libraries provided by CentOS 8.
  $ sudo dnf install libtirpc-devel zlib-devel lz4-devel bzip2-devel openssl-devel cyrus-sasl-devel libpmem-devel

* Install optional dependencies (snappy-devel).
  $ sudo dnf --enablerepo=PowerTools snappy-devel

* Install optional dependencies (libzstd-devel).
  $ sudo dnf install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
  $ sudo dnf --enablerepo=epel install libzstd-devel

* Install optional dependencies (isa-l).
  $ sudo dnf --enablerepo=PowerTools install nasm
  $ git clone https://github.com/intel/isa-l
  $ cd isa-l/
  $ ./autogen.sh
  $ ./configure
  $ make
  $ sudo make install

修改hadoop-project下的pom.xml文件，nodejs的版本>=12.0.0

  maven打包：

mvn package -Pdist,native -DskipTests -Dtar

打包成功：

编译好的文件在hadoop-dist/target目录下：

PS：网络不好可以设置代理

vim /etc/profile

#文件末尾追加
# add proxy for network
export http_proxy="http://ip:port"
export https_proxy="http://ip:port"
export ftp_proxy=$http_proxy

source /etc/profile