Flink提交任务到Yarn报错

Flink版本是1.11.1
Hadoop版本是3.1.2
提交方式为Yarn application模式
提交任务后创建container失败

错误信息:

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Data/opt/hadoop-3.1.2/tmp/nm-local-dir/usercache/root/appcache/application_1607396911850_0002/filecache/10/log4j-slf4j-impl-2.12.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Data/opt/hadoop-3.1.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Exception in thread "main" java.lang.ExceptionInInitializerError
 at org.apache.flink.runtime.util.EnvironmentInformation.getVersionsInstance(EnvironmentInformation.java:184)
 at org.apache.flink.runtime.util.EnvironmentInformation.getGitCommitIdAbbrev(EnvironmentInformation.java:89)
 at org.apache.flink.runtime.util.EnvironmentInformation.getRevisionInformation(EnvironmentInformation.java:112)
 at org.apache.flink.runtime.util.EnvironmentInformation.logEnvironmentInfo(EnvironmentInformation.java:376)
 at org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint.main(YarnApplicationClusterEntryPoint.java:67)
Caused by: java.lang.IllegalStateException: The file .flink-runtime.version.properties has not been generated correctly. You MUST run 'mvn generate-sources' in the flink-runtime module.
 at org.apache.flink.runtime.util.EnvironmentInformation$Versions.<init>(EnvironmentInformation.java:170)
 at org.apache.flink.runtime.util.EnvironmentInformation$VersionsHolder.<clinit>(EnvironmentInformation.java:180)
 ... 5 more
2020-12-08 11:17:24,284 ERROR org.apache.flink.runtime.util.EnvironmentInformation         [] - The file .flink-runtime.version.properties has not been generated correctly. You MUST run 'mvn generate-sources' in the flink-runtime module. : java.time.format.DateTimeParseException: Text '2020-07-15T13:02:09+0800' could not be parsed: Unable to obtain Instant from TemporalAccessor: {OffsetSeconds=28800},ISO resolved to 2020-07-15T13:02:09 of type java.time.format.Parsed

问题是由于jdk版本引起的将jdk版本升级到jdk1.8_241后解决

在这里插入图片描述
一定要注意看launch_container.sh的日志输出的jdk,因为你可能在hadoop其他脚本中单独指定了jdk

评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值