运行v3.MaxTemperatureDriverMiniTest步骤

最新推荐文章于 2024-10-19 21:02:15 发布

weixin_34304013

最新推荐文章于 2024-10-19 21:02:15 发布

阅读量76

点赞数

文章标签：大数据 java python

原文链接：https://my.oschina.net/chyileon/blog/134767

版权

2019独角兽企业重金招聘Python工程师标准>>>

编译

            MaxTemperatureDriverMiniTest.java路径：
            /root/hadoop-book-2e/ch05/src/main/java/v3/MaxTemperatureDriverMiniTest.java
            MaxTemperatureDriver.java路径：
            /root/hadoop-book-2e/ch05/src/main/java/v3/MaxTemperatureDriver.java
            MaxTemperatureMapper.java路径：
            /root/hadoop-book-2e/ch05/src/main/java/v3/MaxTemperatureMapper.java
            MaxTemperatureReducer.java路径：
             /root/hadoop-book-2e/ch05/src/main/java/v1/MaxTemperatureReducer.java

#cd /root/hadoop-book-2e/ch05/src/main/java
#javac v3/MaxTemperatureMapper.java v3/MaxTemperatureMapper.java v3/MaxTemperatureDriver.java v3/MaxTemperatureDriverTest.java

打包

#cd /root/hadoop-book-2e/ch05/src/main
#jar -cvf MaxTemperatureDriverTest.jar -C java/ .

运行

            将jar文件加入 HADOOP_CLASSPATH ，这一步个人觉得很笨，希望有更好的办法。
           将测试数据拷贝到文件夹/root/hadoop-book-2e/ch05/src/main/input/ncdc/micro下
          #HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/root/hadoop-book-2e/ch05/src/main/MaxTemperatureDriverTest.jar
          # hadoop org.junit.runner.JUnitCore v3.MaxTemperatureDriverTest

结果存放在/root/hadoop-book-2e/ch05/src/main/output文件夹下

转载于:https://my.oschina.net/chyileon/blog/134767