hadoop WordCount 运行

最新推荐文章于 2024-10-17 15:34:15 发布

tobyqiu

最新推荐文章于 2024-10-17 15:34:15 发布

阅读量94

点赞数

分类专栏： hadoop sqoop hive 文章标签：大数据开发工具 java

本文链接：https://blog.csdn.net/tobyqiu/article/details/84414876

版权

hadoop sqoop hive 专栏收录该内容

17 篇文章 0 订阅

订阅专栏

配好Eclipse 就去 http://hadoop.apache.org/docs/r1.0.4/mapred_tutorial.html

抄了段代码.

Example: WordCount v1.0

然后 Eclipse 跑一下.

在参数设置 input 和output

hdfs://10.221.62.68:9000/tmp/hadoop-oracli/input

hdfs://10.221.62.68:9000/tmp/hadoop-oracli/output

跑了下出错了

ecurity.UserGroupInformation: PriviledgedActionException as:Administrator cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop. ....................

查了下在mian 里面加了个mapred.job.tracker.

		JobConf conf = new JobConf(WordCount.class);
		conf.setJobName("wordcount");
                //add
		conf.set("mapred.job.tracker", "10.221.62.68:9001");
		conf.setOutputKeyClass(Text.class);
		conf.setOutputValueClass(IntWritable.class);

之后就跑过了.