mac maven安装编译hadoop的源文件

为什么80%的码农都做不了架构师？>>>   

下载hadoop源码包

 

#wget http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.7.2/hadoop-2.7.2-src.tar.gz

 

下载安装配置maven

export M2_HOME=/你的maven路径/apache-maven-3.3.9
export PATH=$PATH:$M2_HOME/bin

下载 protobuf-2.5.0.tar.gz

#  tar -zxvf  protobuf-2.5.0.tar.gz
#cd protobuf-2.5.0  
#./configure --prefix=/usr/local/protoc/  (这个目录可以随便自己建立，编译后的文件位于/usr/local/protoc/目录下)
#make
# make install

 

只要不出错就可以了。

(其中我出过一次这个错误libtool: install: error: cannot install `libaprutil-1.la' to a directory，然后找到这个帖子解决              http://lxsym.blog.51cto.com/1364623/739509)

执行完毕后，我们设置一下环境变量

执行命令vi  /etc/profile

export PATH=/usr/local/protoc/bin:$PATH

source /etc/profile 

protoc --version

如果出现libprotoc 2.5.0，则代表安装成功。

安装cmake

#brew install cmake

Xcode command line tools contain zlib1g-dev, and openssl (brew install openssl) contains libssl-dev. You'll needto force linking of openssl: brew link openssl --force

#brew link openssl --force

 

开始安装，到hadoop-2.7.2-src下面执行

   $ mvn package -Pdist,native -DskipTests -Dtar

 

     [exec]
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-dist ---
[INFO] Building jar: /Users/gangchaopan/Downloads/hadoop-2.7.2-src/hadoop-dist/target/hadoop-dist-2.7.2-javadoc.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [  1.968 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [  1.239 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [  3.604 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.159 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [  1.890 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [  3.113 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [  2.846 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [  3.655 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [  3.338 s]
[INFO] Apache Hadoop Common ............................... SUCCESS [02:20 min]
[INFO] Apache Hadoop NFS .................................. SUCCESS [  6.832 s]
[INFO] Apache Hadoop KMS .................................. SUCCESS [ 11.686 s]
[INFO] Apache Hadoop Common Project ....................... SUCCESS [  0.036 s]
[INFO] Apache Hadoop HDFS ................................. SUCCESS [02:54 min]
[INFO] Apache Hadoop HttpFS ............................... SUCCESS [ 18.840 s]
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SUCCESS [  5.650 s]
[INFO] Apache Hadoop HDFS-NFS ............................. SUCCESS [  4.413 s]
[INFO] Apache Hadoop HDFS Project ......................... SUCCESS [  0.064 s]
[INFO] hadoop-yarn ........................................ SUCCESS [  0.044 s]
[INFO] hadoop-yarn-api .................................... SUCCESS [ 34.445 s]
[INFO] hadoop-yarn-common ................................. SUCCESS [ 34.827 s]
[INFO] hadoop-yarn-server ................................. SUCCESS [  0.047 s]
[INFO] hadoop-yarn-server-common .......................... SUCCESS [ 10.342 s]
[INFO] hadoop-yarn-server-nodemanager ..................... SUCCESS [ 14.684 s]
[INFO] hadoop-yarn-server-web-proxy ....................... SUCCESS [  2.840 s]
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SUCCESS [  6.824 s]
[INFO] hadoop-yarn-server-resourcemanager ................. SUCCESS [ 19.221 s]
[INFO] hadoop-yarn-server-tests ........................... SUCCESS [  4.791 s]
[INFO] hadoop-yarn-client ................................. SUCCESS [  5.819 s]
[INFO] hadoop-yarn-server-sharedcachemanager .............. SUCCESS [  2.946 s]
[INFO] hadoop-yarn-applications ........................... SUCCESS [  0.034 s]
[INFO] hadoop-yarn-applications-distributedshell .......... SUCCESS [  2.146 s]
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SUCCESS [  1.639 s]
[INFO] hadoop-yarn-site ................................... SUCCESS [  0.034 s]
[INFO] hadoop-yarn-registry ............................... SUCCESS [  4.574 s]
[INFO] hadoop-yarn-project ................................ SUCCESS [  5.005 s]
[INFO] hadoop-mapreduce-client ............................ SUCCESS [  0.071 s]
[INFO] hadoop-mapreduce-client-core ....................... SUCCESS [ 23.389 s]
[INFO] hadoop-mapreduce-client-common ..................... SUCCESS [ 18.636 s]
[INFO] hadoop-mapreduce-client-shuffle .................... SUCCESS [  3.729 s]
[INFO] hadoop-mapreduce-client-app ........................ SUCCESS [  8.418 s]
[INFO] hadoop-mapreduce-client-hs ......................... SUCCESS [  4.993 s]
[INFO] hadoop-mapreduce-client-jobclient .................. SUCCESS [  6.425 s]
[INFO] hadoop-mapreduce-client-hs-plugins ................. SUCCESS [  1.634 s]
[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [  4.947 s]
[INFO] hadoop-mapreduce ................................... SUCCESS [  3.400 s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [  3.701 s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [  8.855 s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [  1.792 s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [  5.094 s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [  3.842 s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [  2.126 s]
[INFO] Apache Hadoop Ant Tasks ............................ SUCCESS [  1.930 s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [  2.679 s]
[INFO] Apache Hadoop Pipes ................................ SUCCESS [  9.577 s]
[INFO] Apache Hadoop OpenStack support .................... SUCCESS [  4.337 s]
[INFO] Apache Hadoop Amazon Web Services support .......... SUCCESS [02:39 min]
[INFO] Apache Hadoop Azure support ........................ SUCCESS [ 36.151 s]
[INFO] Apache Hadoop Client ............................... SUCCESS [  8.852 s]
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [  0.104 s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [  4.235 s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [ 11.051 s]
[INFO] Apache Hadoop Tools ................................ SUCCESS [  0.044 s]
[INFO] Apache Hadoop Distribution ......................... SUCCESS [ 40.369 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:17 min
[INFO] Finished at: 2016-08-03T00:13:20+08:00
[INFO] Final Memory: 147M/528M
[INFO] ------------------------------------------------------------------------

 

 

#/hadoop-2.7.2-src/hadoop-dist/target/hadoop-2.7.2/lib/native

 

转载于:https://my.oschina.net/jywm/blog/726198