Hadoop 运行jar时,InvalidAuxServiceException: he auxService:mapreduce_shuffle does not exist的解决方案

最新推荐文章于 2024-01-25 14:05:07 发布

原创

最新推荐文章于 2024-01-25 14:05:07 发布 · 1.3k 阅读

3 ·

CC 4.0 BY-SA版权

文章标签：

#HADOOP #mapreduce #hdfs

当运行Hadoop jar时遇到InvalidAuxServiceException，主要是由于配置文件问题导致。解决步骤包括：修改yarn-site.xml，刷新配置，逐个虚机修改配置，重启Hadoop服务。如果仍有错误，可能需要删除已存在的文件夹，参照相关教程操作。

Hadoop 运行jar时,org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist的解决方案

问题描述：

[root@iflytek01 hadoop]# hadoop jar /datas/wordcount02.jar TestReduce.WordCount /test/hdfs02.txt /test/output/
19/10/30 13:18:36 INFO client.RMProxy: Connecting to ResourceManager at iflytek01/192.168.230.125:8032
19/10/30 13:18:36 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
19/10/30 13:18:37 INFO input.FileInputFormat: Total input files to process : 1
19/10/30 13:18:37 INFO mapreduce.JobSubmitter: number of splits:1
19/10/30 13:18:38 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1572337791871_0002
19/10/30 13:18:38 INFO impl.YarnClientImpl: Submitted application application_1572337791871_0002
19/10/30 13:18:38 INFO mapreduce.Job: The url to track the job: http://iflytek01:8088/proxy/application_1572337791871_0002/
19/10/30 13:18:38 INFO mapreduce.Job: Running job: job_1572337791871_0002
19/10/30 13:18:55 INFO mapreduce.Job: Job job_1572337791871_0002 running in uber mode : false
19/10/30 13:18:55 INFO mapreduce.Job:  map 0% reduce 0%
19/10/30 13:18:56 INFO mapreduce.Job: Task Id : attempt_1572337791871_0002_m_000000_0, Status : FAILED
Container launch failed for container_1572337791871_0002_01_000002 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist
	at sun.reflect.NativeConstructor

最低0.47元/天解锁文章