flink on yarn 问题记录1

写代码当牛马

已于 2023-12-05 14:45:09 修改

阅读量3.8k

点赞数

文章标签： flink java yarn

于 2022-08-21 21:44:05 首次发布

本文链接：https://blog.csdn.net/m0_58149226/article/details/126455326

版权

在部署Flink on YARN时，可能会遇到资源槽分配超时、REST端口被占用以及Java VerifyError等问题。针对这些问题，可以通过修改flink-conf.yaml配置文件，调整REST端口范围以及检查Flink CDC相关jar包版本来解决。确保资源槽请求不超时，REST服务使用指定端口，并避免使用final类的继承冲突。

摘要由CSDN通过智能技术生成

java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_202]
	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_202]
	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:593) ~[?:1.8.0_202]
	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) ~[?:1.8.0_202]
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) ~[?:1.8.0_202]
	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977) ~[?:1.8.0_202]
	at org.apache.flink.runtime.scheduler.SharedSlot.cancelLogicalSlotRequest(SharedSlot.java:222) ~[rtdw-1.0.jar:?]
	at org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.cancelLogicalSlotRequest(SlotSharingExecutionSlotAllocator.java:164) ~[rtdw-1.0.jar:?]
	at org.apache.flink.runtime.scheduler.SharingPhysicalSlotRequestBulk.cancel(SharingPhysicalSlotRequestBulk.java:86) ~[rtdw-1.0.jar:?]
	at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkWithTimestamp.cancel(PhysicalSlotRequestBulkWithTimestamp.java:66) ~[rtdw-1.0.jar:?]
	at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:91) ~[rtdw-1.0.jar:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_202]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_202]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:440) ~[rtdw-1.0.jar:?]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:208) ~[rtdw-1.0.jar:?]
	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77) ~[rtdw-1.0.jar:?]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:158) ~[rtdw-1.0.jar:?]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) [rtdw-1.0.jar:?]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) [rtdw-1