编译hadoop2.6.0

编译hadoop2.6.0

1.安装jdk
http://blog.csdn.net/u013619834/article/details/38894649

2.安装编译工具
安装maven
wget http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz
tar zxvf apache-maven-3.3.3-bin.tar.gz
mv apache-maven-3.3.3 /usr/local
添加环境变量
echo "export MAVEN_HOME=/usr/local/apache-maven-3.3.3" >> /etc/profile.d/app.sh
echo "export PATH=\$MAVEN_HOME/bin:\$PATH" >> /etc/profile.d/app.sh
source /etc/profile
mvn --version

安装ant
wget http://mirrors.cnnic.cn/apache//ant/binaries/apache-ant-1.9.5-bin.tar.gz
tar zxvf apache-ant-1.9.5-bin.tar.gz
mv apache-ant-1.9.5 /usr/local
echo "export ANT_HOME=/usr/local/apache-ant-1.9.5" >> /etc/profile.d/app.sh
echo "export PATH=\$ANT_HOME/bin:\$PATH" >> /etc/profile.d/app.sh
source /etc/profile
ant -version

安装findbugs
wget http://sourceforge.net/projects/findbugs/files/findbugs/3.0.1/findbugs-3.0.1.tar.gz
tar zxvf findbugs-3.0.1.tar.gz
mv findbugs-3.0.1 /usr/local
echo "export FINDBUGS_HOME=/usr/local/findbugs-3.0.1" >> /etc/profile.d/app.sh
echo "export PATH=\$FINDBUGS_HOME/bin:\$PATH" >> /etc/profile.d/app.sh
source /etc/profile
findbugs -version

3. 安装protobuf-2.5.0
yum -y install gcc gcc-c++ make
https://code.google.com/p/protobuf/downloads/list

tar zxvf protobuf-2.5.0.tar.gz
cd protobuf-2.5.0
./configure
make
make install
ldconfig
protoc --version

4. 安装其他依赖
yum -y install cmake openssl-devel ncurses-devel autoconf automake libtool

5. 编译hadoop
wget http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.6.0/hadoop-2.6.0-src.tar.gz
tar zxvf hadoop-2.6.0-src.tar.gz

国内的源都不能用，这里配置一下编译的服务器连接国外VPN，直接使用官方的maven仓库，不再添加以下的2个仓库了。

由于maven国外服务器可能连不上，先给maven配置一下国内镜像,在<mirrors></mirros>里添加，原本的不要动
vim /usr/local/apache-maven-3.2.5/conf/settings.xml

    <mirror>
      <id>nexus-osc</id>
      <mirrorOf>*</mirrorOf>
      <name>Nexusosc</name>
      <url>http://maven.oschina.net/content/groups/public/</url>
    </mirror>

最近开源中国的源也不能用了，可以使用jboss的这个maven镜像库

<mirror>  
      <id>jboss-public-repository-group</id>  
      <mirrorOf>central</mirrorOf>  
      <name>JBoss Public Repository Group</name>  
     <url>http://repository.jboss.org/nexus/content/groups/public</url>  
</mirror>

cd hadoop-2.6.0-src
mvn package -DskipTests -Pdist,native -Dtar


6. 查看编译后的文件
ls hadoop-dist/target

cp hadoop-dist/target/hadoop-2.6.0.tar.gz  /usr/local/src

下面的步骤参考一下，现在用不到

安装nexus步骤
下载nexus
http://www.sonatype.org/nexus/archived
http://download.sonatype.com/nexus/oss/nexus-2.11.0-bundle.tar.gz

安装
tar zxvf nexus-2.11.0-bundle.tar.gz
mv nexus-2.11.0-02 /usr/local/
cd /usr/local/nexus-2.11.0-02/bin
export RUN_AS_USER=root && ./nexus start


访问
http://10.100.17.111:8081/nexus
默认用户名是admin密码是admin123