[Hadoop] 创建Hadoop Eclipse插件

需要下载以下安装文件：

jdk-6u30-windows-i586.exe
apache-ant-1.9.1-bin.zip
eclipse-jee-indigo-SR2-win32.zip
hadoop-1.0.4.tar.gz

1、安装jdk配置JAVA_HOME，并将%JAVA_HOME%\bin添加到Path变量

2、解压apache-ant-1.9.1-bin.zip至某一目录（C:\Hadoop Plugin），配置ANT_HOME，并将%ANT_HOME%\bin添加到Path变量

3、将hadoop-1.0.4.tar.gz解压到同一目录下（C:\Hadoop Plugin）

4、将eclipse-jee-indigo-SR2-win32.zip解压到C:\Hadoop Plugin/目录下，更名为eclipse

5、修改${HADOOP_HOME}/src/contrib/目录下的build-contrib.xml文件添加如下两行，分别添加Eclipse安装路径和Hadoop版本

<project name="hadoopbuildcontrib" xmlns:ivy="antlib:org.apache.ivy.ant">

  <property name="eclipse.home"location="C:\eclipse"/>  --添加部分
  <property name="version" value="1.0.4"/>              --添加部分
  <property name="name" value="${ant.project.name}"/>
  <property name="root" value="${basedir}"/>
  <property name="hadoop.root" location="${root}/../../../"/>

6、修改${HADOOP_HOME}/src/contrib/eclipse-plugin/build.xml文件，添加如下三行用于增加%Hadoop_HOME%/hadoop-*.jar作为ref，并删除build.xml中的deprecation=”${javac.deprecation}”

 <path id="eclipse-sdk-jars">
    <fileset dir="${eclipse.home}/plugins/">
      <include name="org.eclipse.ui*.jar"/>
      <include name="org.eclipse.jdt*.jar"/>
      <include name="org.eclipse.core*.jar"/>
      <include name="org.eclipse.equinox*.jar"/>
      <include name="org.eclipse.debug*.jar"/>
      <include name="org.eclipse.osgi*.jar"/>
      <include name="org.eclipse.swt*.jar"/>
      <include name="org.eclipse.jface*.jar"/>

      <include name="org.eclipse.team.cvs.ssh2*.jar"/>
      <include name="com.jcraft.jsch*.jar"/>
    </fileset> 
    <fileset dir="../../../">               --添加部分
       <include name="hadoop*.jar"/>        --添加部分
    </fileset>                              --添加部分
  </path>

7、新建目录并复制jar包

>copy %Hadoop_HOME%\lib\commons-cli-1.2.jar
%HADOOP_HOME%\build\ivy\lib\Hadoop\common\
>copy %Hadoop_HOME%\hadoop-core-1.0.4.jar
%Hadoop_HOME%\build\

8、打开命令行cmd，切换到 C:\Hadoop Plugin\hadoop-1.0.4\src\contrib\eclipse-plugin目录，运行ant jar

C:\Hadoop Plugin\hadoop-1.0.4\src\contrib\eclipse-plugin>ant jar
Buildfile: C:\Hadoop Plugin\hadoop-1.0.4\src\contrib\eclipse-plugin\build.xml

check-contrib:
     [echo] eclipse.home unset: skipping eclipse plugin

init:

ivy-download:
      [get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.1.0/ivy-2.1.0.jar
      [get] To: C:\Hadoop Plugin\hadoop-1.0.4\ivy\ivy-2.1.0.jar
      [get] Not modified - so not downloaded

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = C:\Hadoop Plugin\hadoop-1.0.4\ivy\ivysettings.xml

ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#eclipse-plugin;working@L-SHC-00436132
[ivy:resolve]   confs: [common]
[ivy:resolve]   found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve]   found log4j#log4j;1.2.15 in maven2
[ivy:resolve] downloading http://repo1.maven.org/maven2/commons-logging/commons-logging/1.0.4/commons-logging-1.0.4.jar ...
[ivy:resolve] ........... (37kB)
[ivy:resolve] .. (0kB)
[ivy:resolve]   [SUCCESSFUL ] commons-logging#commons-logging;1.0.4!commons-logging.jar (1471ms)
[ivy:resolve] downloading http://repo1.maven.org/maven2/log4j/log4j/1.2.15/log4j-1.2.15.jar ...
[ivy:resolve] ........................................................... (382kB)
[ivy:resolve] .. (0kB)
[ivy:resolve]   [SUCCESSFUL ] log4j#log4j;1.2.15!log4j.jar (2432ms)
[ivy:resolve] :: resolution report :: resolve 4369ms :: artifacts dl 3911ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      common      |   2   |   2   |   2   |   0   ||   2   |   2   |
        ---------------------------------------------------------------------

ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#eclipse-plugin [sync]
[ivy:retrieve]  confs: [common]
[ivy:retrieve]  2 artifacts copied, 0 already retrieved (419kB/27ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = C:\Hadoop Plugin\hadoop-1.0.4\ivy\ivysettings.xml

compile:

jar:

BUILD SUCCESSFUL
Total time: 10 seconds

ant jar命令运行成功后，在%HADOOP_HOME%\build\contrib\eclipse-plugins 目录下生成hadoop-eclipse-plugins-1.0.4.jar。

9、将所需jar包拷贝至编译生成的hadoop-eclipse-plugin-1.0.4.jar中

10、修改META-INF目录下的MANIFEST.MF，META-INF目录下的MANIFEST.MF，将classpath修改为：

Bundle-ClassPath:classes/,lib/hadoop-core.jar,lib/commons-cli-1.2.jar,lib/commonshttpclient-
3.0.1.jar,lib/jackson-core-asl-1.8.8.jar,lib/jackson-mapper-asl-1.8.8.jar,lib/commonsconfiguration-
1.6.jar,lib/commons-lang-2.4.jar

将该hadoop-eclipse-plugin-1.0.4.jar拷贝到eclipse plugs-in目录中，重新启动eclipse，至此，搭建完成hadoop eclipse编译环境。