[hadoop] HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}

在这里插入图片描述

[hadoop@hadoop102 hadoop-3.1.3]$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.3.jar wordcount /wcinput/wcinput /wcoutput
2021-08-13 12:00:31,159 INFO client.RMProxy: Connecting to ResourceManager at hadoop103/192.168.10.103:8032
2021-08-13 12:00:31,379 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1628826953122_0003
2021-08-13 12:00:31,460 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2021-08-13 12:00:32,203 INFO input.FileInputFormat: Total input files to process : 3
2021-08-13 12:00:32,218 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2021-08-13 12:00:32,253 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2021-08-13 12:00:32,271 INFO mapreduce.JobSubmitter: number of splits:3
2021-08-13 12:00:32,347 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2021-08-13 12:00:32,368 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1628826953122_0003
2021-08-13 12:00:32,368 INFO mapreduce.JobSubmitter: Executing with tokens: []
2021-08-13 12:00:32,467 INFO conf.Configuration: resource-types.xml not found
2021-08-13 12:00:32,467 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2021-08-13 12:00:32,502 INFO impl.YarnClientImpl: Submitted application application_1628826953122_0003
2021-08-13 12:00:32,529 INFO mapreduce.Job: The url to track the job: http://hadoop103:8088/proxy/application_1628826953122_0003/
2021-08-13 12:00:32,529 INFO mapreduce.Job: Running job: job_1628826953122_0003
2021-08-13 12:00:34,546 INFO mapreduce.Job: Job job_1628826953122_0003 running in uber mode : false
2021-08-13 12:00:34,547 INFO mapreduce.Job:  map 0% reduce 0%
2021-08-13 12:00:34,555 INFO mapreduce.Job: Job job_1628826953122_0003 failed with state FAILED due to: Application application_1628826953122_0003 failed 2 times due to AM Container for appattempt_1628826953122_0003_000002 exited with  exitCode: 1
Failing this attempt.Diagnostics: [2021-08-13 12:00:33.624]Exception from container-launch.
Container id: container_1628826953122_0003_02_000001
Exit code: 1

[2021-08-13 12:00:33.643]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Please check whether your etc/hadoop/mapred-site.xml contains the below configuration:
<property>
  <name>yarn.app.mapreduce.am.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.map.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>

[2021-08-13 12:00:33.643]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Please check whether your etc/hadoop/mapred-site.xml contains the below configuration:
<property>
  <name>yarn.app.mapreduce.am.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.map.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>

For more detailed output, check the application tracking page: http://hadoop103:8088/cluster/app/application_1628826953122_0003 Then click on links to logs of each attempt.
. Failing the application.
2021-08-13 12:00:34,567 INFO mapreduce.Job: Counters: 0

解决方法:

执行hadoop classpath命令
将输出粘贴到yarn-site.xml、mapred-site.xml

在mapred-site.xml中添加

<property>
<name>yarn.app.mapreduce.am.env</name>
<value>HADOOP_MAPRED_HOME=粘贴hadoop classpath</value>
</property>
<property>
<name>mapreduce.map.env</name>
<value>HADOOP_MAPRED_HOME=粘贴hadoop classpath</value>
</property>

<property>
<name>mapreduce.reduce.env</name>
<value>HADOOP_MAPRED_HOME=粘贴hadoop classpath</value>
</property>

在yarn-site.xml中添加

  <property>
    <name>yarn.application.classpath</name>
    <value>粘贴hadoop classpath</value>
  </property>
  • 3
    点赞
  • 5
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值