flink on yarn遇到的yarn资源不足问题

最新推荐文章于 2024-09-10 15:38:38 发布

无名子七叶莲

最新推荐文章于 2024-09-10 15:38:38 发布

阅读量3.7k

点赞数

分类专栏： Hadoop Flink

本文链接：https://blog.csdn.net/qq_37820533/article/details/104554111

版权

Hadoop 同时被 2 个专栏收录

2 篇文章 0 订阅

订阅专栏

Flink

1 篇文章 0 订阅

订阅专栏

问题：

org.apache.flink.yarn.AbstractYarnClusterDescriptor$YarnDeploymentException: The YARN application unexpectedly switched to state FAILED during deployment.
Diagnostics from YARN: Application application_1582728153073_0001 failed 2 times due to AM Container for appattempt_1582728153073_0001_000003 exited with  exitCode: 1
For more detailed output, check application tracking page:http://hadoop01:8088/cluster/app/application_1582728153073_0001Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1582728153073_0001_03_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1
......

解决：
在每个hadoop节点上的yarn-site.xml文件里添加下面的配置
在这里插入图片描述

实际业务中，集群上的内存分配是提前做好预估的，在业务处理的过程中需要根据业务的实际需要做出相应的调整，这实际上是技术问题，需要开发人员有一定的经验。