在尝试执行Hadoop 3.2.0的WordCount示例时遇到错误，提示找不到主类。问题根源在于mapred-site.xml配置不正确，对比hadoop2.x，3.x版本的配置参数有所变化。解决方法是添加缺失的参数，并确保环境变量设置正确，包括HADOOP_HOME。此外，还需在$HADOOP_HOME/etc/worker文件中添加所有节点名称。
在使用3.2.0版本的hadoop时执行WordCount出现如下错误：
[root@server1 jars]# hadoop jar BigData.jar demo.WordCountMain /data/txt/math.txt /out
2020-03-09 23:14:00,216 INFO client.RMProxy: Connecting to ResourceManager at server1/172.16.115.189:8032
2020-03-09 23:14:00,843 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2020-03-09 23:14:00,861 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/root/.staging/job_1583809329756_0001
2020-03-09 23:14:01,996 INFO input.FileInputFormat: Total input files to process : 1
2020-03-09 23:14:02,529 INFO mapreduce.JobSubmitter: number of splits:1
2020-03-09 23:14:02,672 INFO Configuration.deprecation: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled
2020-03-09 23:14:03,215 INFO mapreduce.
最低0.47元/天 解锁文章
扫一扫
1万+
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
