本件讲述如何在windows 7(64bit)下将Hadoop导入Eclipse中。
1 首先请参考我写的文章“Hadoop-2.4.1在win7下的编译”,学习如何在windows 7(64bit)下编译Hadoop源代码。
2 假设你已经编译成功了Hadoop,请在源代码的根目录下执行下面的命令,生成.project文件。
hadoop-2.4.1-src>mvn eclipse:eclipse -DskipTest
3 打开Eclipse,我的版本是4.40。
3.1 导入hadoop-common-project下的相关的工程:
3.1.1 File->Import->Choose General->Choose "Existing Projects into Workspace"
3.1.2 选择 hadoop-common-project作为根目录(the root directory )
3.1.3 Eclipse会自动在跟目录下找到工程hadoop-annotations, hadoop-auth, hadoop-auth-examples, hadoop-nfs, hadoop-minikdc and hadoop-common工程
3.1.4 点击Finish,完成导入。
3.2 导入hadoop-assemblies下的相关的工程:
3.2.1 File->Import->Choose General->Choose "Existing Projects into Workspace"
3.2.2 选择hadoop-assemblies作为根目录(the root directory )
3.2.3 Eclipse会自动在跟目录下找到工程hadoop-assemblies工程
3.2.4 点击Finish,完成导入。
3.3 导入hadoop-hdfs-project 下的相关的工程:
3.3.1 File->Import->Choose General->Choose "Existing Projects into Workspace"
3.3.2 选择hadoop-hdfs-project 作为根目录(the root directory )
3.3.3 Eclipse会自动在跟目录下找到工程hadoop-hdfs, hadoop-hdfs-httpfs, hadoop-hdfs-nfs 工程
3.3.4 点击Finish,完成导入。
3.4 导入hadoop-mapreduce-project 下的相关的工程:
3.4.1 File->Import->Choose General->Choose "Existing Projects into Workspace"
3.4.2 选择hadoop-mapreduce-project 作为根目录(the root directory )
3.4.3 Eclipse会自动在跟目录下找到工程hadoop-mapreduce-client-app, hadoop-mapreduce-client-common, hadoop-mapreduce-client-core, hadoop-mapreduce-client-hs, hadoop-mapreduce-client-hs-plugins, hadoop-mapreduce-client-jobclient, hadoop-mapreduce-client-shuffle, hadoop-mapreduce-example 工程
3.4.4 点击Finish,完成导入。
3.5 导入hadoop-yarn-project 下的相关的工程:
3.5.1 File->Import->Choose General->Choose "Existing Projects into Workspace"
3.5.2 选择hadoop-yarn-project 作为根目录(the root directory )
3.5.3 Eclipse会自动在跟目录下找到工程hadoop-yarn-*
3.5.4 点击Finish,完成导入。
将工程导入后,需要设置如下环境变量,以便可以在Eclipse中调试Mapreduce程序:
HADOOP_HOME=D:\hadoop\hadoop-2.4.1-src\hadoop-dist\target\hadoop-2.4.1
PATH=%HADOOP_HOME%\bin;%JAVA_HOME%\bin;%CYGWIN_DIR%\bin;%PATH%;
主要参考: