21/02/06 10:06:37 INFO mapreduce.Job: map 0% reduce 0%
21/02/06 10:06:37 INFO mapreduce.Job: Job job_1612576553072_0003 failed with state FAILED due to: Application application_1612576553072_0003 failed 2 times due to AM Container for appattempt_1612576553072_0003_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://test1.com:8088/proxy/application_1612576553072_0003/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1612576553072_0003_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
这种报错是yarn的配置文件有问题,网上也有资料.
但是如果你按着网上的配置了还报这种错误就要往下看了.
我出现的原因很简单:运行yarn依赖的时候,我配置我路径中有两个相同的依赖冲突,系统不知道用哪个依赖,就直接报错
一定要看yarn的日志,查看报错原因.
然后去对应的目录下删除其中一个依赖,重启就好了.
出现这个bug的原因很多,解决问题方法也不同.
希望能帮到你们!