【Flink】JobInitializationException: Could not start the JobMaster

一杯咖啡半杯糖

已于 2022-12-07 17:24:05 修改

阅读量4.7k

点赞数

分类专栏： Flink实战文章标签： flink java

于 2022-01-14 17:15:30 首次发布

本文链接：https://blog.csdn.net/sinat_23225111/article/details/122498104

版权

Flink实战专栏收录该内容

95 篇文章 117 订阅 ¥19.90 ¥99.00

订阅专栏

超级会员免费看

在尝试提交Flink程序到Yarn时遇到JobInitializationException错误。问题根源在于打包过程中将Flink相关依赖纳入了最终的jar包，导致与Flink客户端自带的lib目录中的依赖冲突。解决方法是将Flink的Maven依赖设置为'provided'，确保打包时不包含这些依赖，从而避免依赖冲突。

摘要由CSDN通过智能技术生成

新建了一个flink程序，提交到yarn上报错，yarn任务直接失败，异常如下：

org.apache.flink.util.FlinkException: JobMaster for job 4df20274065bec19be8d933c760ebf44 failed.
    at org.apache.flink.runtime.dispatcher.Dispatcher.jobMasterFailed(Dispatcher.java:871) ~[flink-test1-1.0-SNAPSHOT-jar-with-dependencies.jar:?]
    at org.apache.flink.runtime.dispatcher.Dispatcher.jobManagerRunnerFailed(Dispatcher.java:464) ~[flink-test1-1.0-SNAPSHOT-jar-with-dependencies.jar:?]
    at org.apache.flink.runtime.dispatcher.Dispatcher.handleJobManagerRunnerResult(Dispatcher.java:437) ~[flink-test1-1.0-SNAPSHOT-jar-with-dependencies.jar:?]
    at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$runJob$3(Dispatcher.java:416) ~[flink-test1-1.0-