搭建本地运行Hadoop环境

本地环境 win7-64,idea2016,hadoop2.6.5,jdk1.7

1. 新建maven项目，根目录下新建input目录，output目录。Hadoop的jar包里找Wordcount 案例代码。

   下载：https://download.csdn.net/download/qq_32443495/10758392

  pom.xml

<properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
    <maven.compiler.source>1.7</maven.compiler.source>
    <maven.compiler.target>1.7</maven.compiler.target>
  </properties>

  <dependencies>
    <dependency>
      <groupId>junit</groupId>
      <artifactId>junit</artifactId>
      <version>4.12</version>
      <scope>test</scope>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-common</artifactId>
      <version>2.6.5</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-hdfs</artifactId>
      <version>2.6.5</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-mapreduce-client-core</artifactId>
      <version>2.6.5</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-mapreduce-client-jobclient</artifactId>
      <version>2.6.5</version>
    </dependency>
    <dependency>
      <groupId>log4j</groupId>
      <artifactId>log4j</artifactId>
      <version>1.2.17</version>
    </dependency>
  </dependencies>

    最终目录结构

 

2. 新建一个Artifacts

3.Build 这个Artifacts

4.新建一个application  main-class  org.apache.hadoop.util.RunJar
 

 5.

program arguments 三行分别是：

1.你刚才build那个jar 的目录和jar名

2.开始新建的输入路径

3.开始新建的输出路径