hadoop运行mr任务报错Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaste

在hadoop环境部署完成后，利用hadoop自带的mr 示例测试运行任务失败

$ ./bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.0.jar pi 5 5

可以看运行日志中有详细的报错信息

2020-12-14 00:00:30,322 INFO mapreduce.Job: Running job: job_1607873690718_0001
2020-12-14 00:00:36,475 INFO mapreduce.Job: Job job_1607873690718_0001 running in uber mode : false
2020-12-14 00:00:36,477 INFO mapreduce.Job:  map 0% reduce 0%
2020-12-14 00:00:36,503 INFO mapreduce.Job: Job job_1607873690718_0001 failed with state FAILED due to: Application application_1607873690718_0001 failed 2 times due to AM Container for appattempt_1607873690718_0001_000002 exited with  exitCode: 1
Failing this attempt.Diagnostics: [2020-12-14 00:00:35.871]Exception from container-launch.
Container id: container_1607873690718_0001_02_000001
Exit code: 1

[2020-12-14 00:00:35.878]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Please check whether your <HADOOP_HOME>/etc/hadoop/mapred-site.xml contains the below configuration:
<property>
  <name>yarn.app.mapreduce.am.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.map.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>

[2020-12-14 00:00:35.878]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Please check whether your <HADOOP_HOME>/etc/hadoop/mapred-site.xml contains the below configuration:
<property>
  <name>yarn.app.mapreduce.am.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.map.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>

For more detailed output, check the application tracking page: http://hadoop-1:8088/cluster/app/application_1607873690718_0001 Then click on links to logs of each attempt.
. Failing the application.
2020-12-14 00:00:36,538 INFO mapreduce.Job: Counters: 0
Job job_1607873690718_0001 failed!

日志中有段Please check whether your <HADOOP_HOME>/etc/hadoop/mapred-site.xml contains the below configuration很明显说明配置文件有问题，按照提示将mapred-site.xml配置补全

<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
    <property>
        <name>mapreduce.application.classpath</name>
        <value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
    </property>
    <property>
      <name>yarn.app.mapreduce.am.env</name>
      <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
    </property>
    <property>
      <name>mapreduce.map.env</name>
      <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
    </property>
    <property>
      <name>mapreduce.reduce.env</name>
      <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
    </property>
</configuration>

并重启yarn服务

# 先停止
/usr/local/hadoop/sbin/stop-yarn.sh

# 在启动
/usr/local/hadoop/sbin/start-yarn.sh

再次运行任务，就成功了

2020-12-14 00:20:47,600 INFO impl.YarnClientImpl: Submitted application application_1607875855744_0002
2020-12-14 00:20:47,663 INFO mapreduce.Job: The url to track the job: http://hadoop-1:8088/proxy/application_1607875855744_0002/
2020-12-14 00:20:47,664 INFO mapreduce.Job: Running job: job_1607875855744_0002
2020-12-14 00:20:57,019 INFO mapreduce.Job: Job job_1607875855744_0002 running in uber mode : false
2020-12-14 00:20:57,021 INFO mapreduce.Job:  map 0% reduce 0%
2020-12-14 00:21:14,537 INFO mapreduce.Job:  map 67% reduce 0%
2020-12-14 00:21:15,554 INFO mapreduce.Job:  map 100% reduce 0%
2020-12-14 00:21:24,712 INFO mapreduce.Job:  map 100% reduce 100%
2020-12-14 00:21:25,748 INFO mapreduce.Job: Job job_1607875855744_0002 completed successfully