关于flink状态中使用TreeSet，当执行checkpoint时出现空指针错误。

最新推荐文章于 2024-08-08 19:56:37 发布

Keep_Running丶

最新推荐文章于 2024-08-08 19:56:37 发布

阅读量783

点赞数 1

文章标签： flink java 大数据

本文链接：https://blog.csdn.net/qq_39902301/article/details/128959008

版权

本文记录了在Flink作业运行过程中，由于在状态中使用TreeSet导致执行checkpoint时遇到空指针错误的详细情况。通过数据排查、代码检查、源码debug和推断验证，最终定位并解决了问题。

摘要由CSDN通过智能技术生成

关于flink状态中使用TreeSet，当执行checkpoint时出现空指针错误。

一、问题现象
二、定位过程
三、结论

一、问题现象

在flink状态中使用到TreeSet，当执行checkpoint出现空指针错误。

2023-02-08 20:13:08 | [34mINFO [0;39m | [1;33mjobmanager-io-thread-46[0;39m | [1;32morg.apache.flink.runtime.checkpoint.CheckpointCoordinator[0;39m | Decline checkpoint 1 by task 19d31611143ee02050ed4531a222734b_1968ee2257a900655a2aeaaec0388ad4_5_0 of job 350e6cbd4f88e1349141f7d694b31bb7 at container_1658625161369_6927_01_000005 @ dmp-cs04 (dataPort=46631).
org.apache.flink.util.SerializedThrowable: org.apache.flink.runtime.checkpoint.CheckpointException: Asynchronous task checkpoint failed.
	at org.apache.flink.streaming.runtime.tasks.AsyncCheckpointRunnable.handleExecutionException(AsyncCheckpointRunnable.java:320)
	at org.apache.flink.streaming.runtime.tasks.AsyncCheckpointRunnable.run(AsyncCheckpointRunnable.java:155)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.Exception: Could not materialize checkpoint 1 for operator name-qy-total-top-house (6/10)#0.
	at org.apache.flink.streaming.runtime.tasks.AsyncCheckpointRunnable.handleExecutionException(AsyncCheckpointRunnable.java:298)
	... 4 common frames omitted
Caused by: org.apache.flink.util.SerializedThrowable: java.util.concurrent.ExecutionException: java.lang.NullPointerException
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.flink.util.concurrent.FutureUtils.runIfNotDoneAndGet(FutureUtils.java:543)
	at org.apache.flink.streaming.api.operators.OperatorSnapshotFinalizer.<init>(OperatorSnapshotFinalizer.java:54)
	at org.apache.flink.streaming.runtime.tasks.AsyncCheckpointRunnable.finalizeNonFinishedSnapsho