CentOS 下编译Hadoop2.2.0 64位安装包总结
官网只提供二进制版本为32位版本,64位环境需要重新编译。网上有很多关于hadoop2.2.0的编译文章,但大部分在编译过程中还是会遇到很多奇葩的问题,在此把我亲身动手编译的过程总结为以下几步,希望能帮有需要的朋友。
http://download.oracle.com/otn-pub/java/jdk/7u45-b18/jdk-7u45-linux-x64.tar.gz
# tar xvzf jdk-7u45-linux-x64.tar.gz -C /usr/local
# cd /usr/local
# ln -s jdk1.7.0_45 jdk
# vim /etc/profile
export JAVA_HOME=/usr/local/jdk
export CLASS_PATH=$JAVA_HOME/lib:$JAVA_HOME/jre/lib
export PATH=$PATH:$JAVA_HOME/bin
# source /etc/profile
------------------------------------------------------------------------------------------------------------------------------------------
2、MAVEN 安装
http://mirror.bit.edu.cn/apache/maven/maven-3/3.1.1/binaries/apache-maven-3.1.1-bin.tar.gz
# tar xvzf apache-maven-3.1.1-bin.tar.gz -C /usr/local
# cd /usr/local
# ln -s apache-maven-3.1.1 maven
# vim /etc/profile
export MAVEN_HOME=/usr/local/maven
export PATH=$PATH:$MAVEN_HOME/bin
# source /etc/profile
------------------------------------------------------------------------------------------------------------------------------------------
3、PROTOBUF 安装
https://protobuf.googlecode.com/files/protobuf-2.5.0.tar.gz
# tar xvzf protobuf-2.5.0.tar.gz
# ./configure --prefix=/usr/local/protobuf
# make && make install
# vim /etc/profile
export PROTO_HOME=/usr/local/protobuf
export PATH=$PATH:$PROTO_HOME/bin
# source /etc/profile
# vim /etc/ld.so.conf
/usr/local/protobuf/lib
# /sbin/ldconfig
------------------------------------------------------------------------------------------------------------------------------------------
4、其他依赖库安装
http://www.cmake.org/files/v2.8/cmake-2.8.12.1.tar.gz
http://ftp.gnu.org/pub/gnu/ncurses/ncurses-5.9.tar.gz
http://www.openssl.org/source/openssl-1.0.1e.tar.gz
# tar xvzf cmake-2.8.12.1.tar.gz
# cd cmake-2.8.12.1
# ./bootstrap --prefix=/usr/local
# gmake && gmake install
# tar xvzf ncurses-5.9.tar.gz
# cd ncurses-5.9
# ./configure --prefix=/usr/local
# make && make install
# tar xvzf openssl-1.0.1e.tar.gz
# cd openssl-1.0.1e
# ./config shared --prefix=/usr/local
# make && make install
# /sbin/ldconfig
------------------------------------------------------------------------------------------------------------------------------------------
5、安装forrest
http://forrest.apache.org/mirrors.cgi
下载:apache-forrest-0.9-sources.tar.gz apache-forrest-0.9-dependencies.tar.gz
解压apache-forrest-0.9-sources.tar.gz
然后将 apache-forrest-0.9-dependencies.tar.gz解压后,tools/下的文件整合进
/usr/local/apache-forrest-0.9/tools/文件夹下
修改forrest环境变量export FORREST_HOME=/usr/local/apache-forrest-0.9
export PATH=$PATH:$FORREST_HOME/bin
forrest -version
Apache Forrest. Run 'forrest -projecthelp' to list options
Apache Ant version 1.7.1 compiled on September 26 2008
------------------------------------------------------------------------------------------------------------------------------------------
6、安装findbugs
在http://findbugs.sourceforge.net/downloads.html下载findbugs-2.0.3.tar.gz
解压缩貌似直接能用,配置下环境变量
export FINDBUGS_HOME=/usr/local/findbugs-2.0.3
export PATH=$PATH:$FINDBUGS_HOME/bin
重启终端
findbugs -version
2.0.3
------------------------------------------------------------------------------------------------------------------------------------------
7、安装ANT
在http://ant.apache.org/bindownload.cgi下载 apache-ant-1.9.2-bin.tar.gz
配置下环境变量
# Setting Path for Ant
export ANT_HOME=/usr/local/apache-ant-1.9.2
export PATH=$PATH:$ANT_HOME/bin
重启终端
ant -version
Apache Ant(TM) version 1.9.2 compiled on July 8 2013
------------------------------------------------------------------------------------------------------------------------------------------
8、安装zlib-devel
yum install zlib-devel
------------------------------------------------------------------------------------------------------------------------------------------
9、vi hadoop-common-project/hadoop-auth/pom.xml
在
org.mortbay.jetty
jetty
test
这段之前加一段:
org.mortbay.jetty
jetty-util
test
------------------------------------------------------------------------------------------------------------------------------------------
10、编译 Hadoop
http://mirrors.hust.edu.cn/apache/hadoop/common/hadoop-2.2.0/hadoop-2.2.0-src.tar.gz
(1)、maven源设置【在<mirrors></mirros>里添加】
# vim /usr/local/maven/conf/settings.xml
<mirror>
<id>nexus-osc</id>
<mirrorOf>*</mirrorOf>
<name>Nexusosc</name>
<url>http://maven.oschina.net/content/groups/public/</url>
</mirror>
(2)、编译Hadoop
# tar xvzf hadoop-2.2.0-src.tar.gz
# cd hadoop-2.2.0-src
# mvn clean install -DskipTests
# mvn package -Pdist,native -DskipTests -Dtar