环境:CentOS Stream release 8
Hadoop版本:3.3.6
安装步骤(参考源码中的BUILDING.txt文件):
----------------------------------------------------------------------------------
Building on CentOS 8
----------------------------------------------------------------------------------
* Install development tools such as GCC, autotools, OpenJDK and Maven.
$ sudo dnf group install --with-optional 'Development Tools'
$ sudo dnf install java-1.8.0-openjdk-devel maven* Install Protocol Buffers v3.7.1.
$ git clone https://github.com/protocolbuffers/protobuf
$ cd protobuf
$ git checkout v3.7.1
$ autoreconf -i
$ ./configure --prefix=/usr/local
$ make
$ sudo make install
$ cd ..* Install libraries provided by CentOS 8.
$ sudo dnf install libtirpc-devel zlib-devel lz4-devel bzip2-devel openssl-devel cyrus-sasl-devel libpmem-devel* Install optional dependencies (snappy-devel).
$ sudo dnf --enablerepo=PowerTools snappy-devel* Install optional dependencies (libzstd-devel).
$ sudo dnf install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
$ sudo dnf --enablerepo=epel install libzstd-devel* Install optional dependencies (isa-l).
$ sudo dnf --enablerepo=PowerTools install nasm
$ git clone https://github.com/intel/isa-l
$ cd isa-l/
$ ./autogen.sh
$ ./configure
$ make
$ sudo make install
修改hadoop-project下的pom.xml文件,nodejs的版本>=12.0.0
maven打包:
mvn package -Pdist,native -DskipTests -Dtar
打包成功:
编译好的文件在hadoop-dist/target目录下:
PS:网络不好可以设置代理
vim /etc/profile
#文件末尾追加
# add proxy for network
export http_proxy="http://ip:port"
export https_proxy="http://ip:port"
export ftp_proxy=$http_proxy
source /etc/profile