Hadoop之mapreduce提交到集群测试

先添加依赖文件，可选择是否打包依赖文件

<build>
    <plugins>
        <plugin>
            <artifactId>maven-compiler-plugin</artifactId>
            <version>3.6.1</version>
            <configuration>
                <source>1.8</source>
                <target>1.8</target>
            </configuration>
        </plugin>
        <plugin>
            <artifactId>maven-assembly-plugin</artifactId>
            <configuration>
                <descriptorRefs>
                    <descriptorRef>jar-with-dependencies</descriptorRef>
                </descriptorRefs>
            </configuration>
            <executions>
                <execution>
                    <id>make-assembly</id>
                    <phase>package</phase>
                    <goals>
                        <goal>single</goal>
                    </goals>
                </execution>
            </executions>
        </plugin>
    </plugins>
</build>

 

 成功后

在target目录找到打包好的文件 

 将无依赖的jar包上传到服务器，启动hadoop集群，执行即可

hadoop jar com.mingyu.mapreduce.wordcount2.WordCountDriver /opt/module/hadoop-3.1.3/input /output2

注意要使用Driver的全限定路径名