本地环境 win7-64,idea2016,hadoop2.6.5,jdk1.7
1. 新建maven项目,根目录下新建input目录,output目录。Hadoop的jar包里找Wordcount 案例代码。
下载:https://download.csdn.net/download/qq_32443495/10758392
pom.xml
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<maven.compiler.source>1.7</maven.compiler.source>
<maven.compiler.target>1.7</maven.compiler.target>
</properties>
<dependencies>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
<version>4.12</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
<version>2.6.5</version>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-hdfs</artifactId>
<version>2.6.5</version>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-core</artifactId>
<version>2.6.5</version>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-jobclient</artifactId>
<version>2.6.5</version>
</dependency>
<dependency>
<groupId>log4j</groupId>
<artifactId>log4j</artifactId>
<version>1.2.17</version>
</dependency>
</dependencies>
最终目录结构
2. 新建一个Artifacts
3.Build 这个Artifacts
4.新建一个application main-class org.apache.hadoop.util.RunJar
5.
program arguments 三行分别是:
1.你刚才build那个jar 的目录和jar名
2.开始新建的输入路径
3.开始新建的输出路径