Flink
minchowang
这个作者很懒,什么都没留下…
展开
-
flink sql upsert kafka对于changelogNormalize state解读
flink sql upsert kafka对于changelogNormalize state解读原文:https://www.jianshu.com/p/5ffe5aa0dc59这里说一点:flink sql - upsert kafka 去重并非在kafka-connector中实现,而是在这个DeduplicateFunctionBase父类中的ValueState进行keyby状态去重的,因此为何upsert-kafka需要在kafka的message中带有key;/** * B原创 2021-07-20 23:47:37 · 1792 阅读 · 2 评论 -
Flink 异步IO时 java.util.concurrent.TimeoutException: Async function call has timed out.
Flink 异步IO时 timeout报错java.lang.Exception: An async function call terminated with an exception. Failing the AsyncWaitOperator. at org.apache.flink.streaming.api.operators.async.Emitter.output(Emitter.java:137) at org.apache.flink.streaming.api.operators.原创 2020-09-29 18:59:19 · 3834 阅读 · 3 评论 -
Flink使用托管算子状态ListCheckpointed
要使用托管算子状态,有状态函数可以实现更通用的CheckpointedFunction接口或ListCheckpointed<T extends Serializable>接口。官方参考链接:https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/stream/state/state.html#listcheckpointed此文使用ListCheckpointed,如下是官网的案例class CounterSou原创 2020-06-18 14:27:04 · 576 阅读 · 0 评论
分享