编译hadoop源码过程中遇到的问题

最新推荐文章于 2021-06-30 16:47:18 发布

qq_34139020

最新推荐文章于 2021-06-30 16:47:18 发布

阅读量1.6k

点赞数 4

分类专栏： hadoop

本文链接：https://blog.csdn.net/qq_34139020/article/details/90340425

版权

hadoop 专栏收录该内容

2 篇文章 0 订阅

订阅专栏

hadoop源码版本：2.7.7

maven版本：

protobuf版本：

ant版本：

以上环境的搭建网上有很多说明，这里放一篇参考，我就是按这篇博客里的步骤来做的：

https://www.cnblogs.com/duking1991/p/6104304.html

需要注意的是这篇博客中使用的操作系统是centOS，安装软件的工具是yum，而我用的是ubantu，安装工具是apt-get，所以在这一步

需要把它换成：

apt-get install lzo-devel zlib-devel autoconf automake libtool cmake openssl-devel

接下里就说说安装过程中遇到的错误：

Error 1

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (dist) on project hadoop-kms: An Ant BuildException has occured: java.net.ConnectException: Connection timed out (Connection timed out)

[ERROR] around Ant part ...<get skipexisting="true" src="http://archive.apache.org/dist/tomcat/tomcat-6/v6.0.48/bin/apache-tomcat-6.0.48.tar.gz" dest="downloads/apache-tomcat-6.0.48.tar.gz" verbose="true"/>... @ 5:182 in /home/lc/Documents/hadoop-2.7.7-src/hadoop-common-project/hadoop-kms/target/antrun/build-main.xml

出现这个错误的原因是连接不上服务器下载tomcat，他要求的这个tomcat版本是6.0.48，在官网上都下不到了，我尝试过去/home/lc/Documents/hadoop-2.7.7-src/hadoop-common-project/hadoop-kms/target/antrun/build-main.xml修改下载链接，但是发现改完再编译它又恢复回去了，不知道该在哪里改，于是乎只能去网上找apache-tomcat-6.0.48包，然后把它打包成apache-tomcat-6.0.48.tar.gz格式（先tar,再gzip），然后把它放在/home/lc/Documents/hadoop-2.7.7-src/hadoop-common-project/hadoop-kms/downloads下，因为build-main.xml文件就是说下载后放在这里，我们提前放在这里，它就不会再去下载了。

然后再编译，发现错误提示/home/lc/Documents/hadoop-2.7.7-src/hadoop-hdfs-project/hadoop-hdfs-httpfs/downloads下也需要一份apache-tomcat-6.0.48.tar.gz，所以在这里也放一份，不然它自己去下又找不到，然后就OK了。

Error 2

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------------------

[INFO] Total time: 52.838 s

[INFO] Finished at: 2019-05-18T22:16:59-04:00

[INFO] ------------------------------------------------------------------------

[ERROR] Unknown lifecycle phase "–Pdist,native". You must specify a valid lifecycle phase or a goal in the format <plugin-prefix>:<goal> or <plugin-group-id>:<plugin-artifact-id>[:<plugin-version>]:<goal>. Available lifecycle phases are: validate, initialize, generate-sources, process-sources, generate-resources, process-resources, compile, process-classes, generate-test-sources, process-test-sources, generate-test-resources, process-test-resources, test-compile, process-test-classes, test, prepare-package, package, pre-integration-test, integration-test, post-integration-test, verify, install, deploy, pre-clean, clean, post-clean, pre-site, site, post-site, site-deploy. -> [Help 1]

出现这个错误完全是粗心大意，命令行中的“-”用的是中文字符，所以报错，换成英文的就好

Error 3

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------------------

[INFO] Total time: 2.917 s

[INFO] Finished at: 2019-05-18T22:52:33-04:00

[INFO] ------------------------------------------------------------------------

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-clean-plugin:2.5:clean (default-clean) on project hadoop-build-tools: Failed to clean project: Failed to delete /home/lc/Documents/hadoop-2.7.7-src/hadoop-build-tools/target/maven-archiver/pom.properties -> [Help 1]

重新编译时删不掉原来的文件，一看就是权限问题，换成root权限。