Flink
Flink
Wang Zhuoqun
我还能学!!!
展开
-
Flink笔记-迭代计算
public class IterateStream { public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.setParallelism(3); DataStreamSource<String>.原创 2022-05-09 19:52:39 · 634 阅读 · 0 评论 -
Flink笔记-异步IO
1、异步IOAsyncDataStreamAsync I/O提供了两种模式:ORDERED和UNORDERED.UNORDERED:异步请求一结束就马上输出结果,因为异步请求完成时间的不确定性,结果输出的顺序可能和输入不同.此模式调用:AsyncDataStream.unorderedWait(...)ORDERED:在这个模式下结果输出的顺序和输入的顺序是一样的,为了实现这一...原创 2022-05-09 19:51:51 · 1093 阅读 · 0 评论 -
Flink笔记-双流join
一、intervalJoin流A intervalJoin 流B,只要满足以下条件即为join成功。流B的时间戳大于等于流A的时间戳减下界且流B的时间戳小于等于流A的时间戳加上界且流A的key等于流B的key。ProcessJoinFunctionpublic class TwoStreamJoinStream { public static vo...原创 2022-05-06 21:19:17 · 495 阅读 · 0 评论 -
Flink笔记-window窗口
一、不分组窗口函数public class WindowStream { public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.setParallelism(3); env.setStreamTimeCha原创 2022-05-06 21:17:14 · 369 阅读 · 0 评论 -
Flink笔记-广播流
一、keyBy的广播流使用KeyedBroadcastProcessFunctionpublic class TwoStreamJoinWithBroadcastStream { public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment...原创 2022-05-06 21:13:13 · 2845 阅读 · 0 评论 -
Flink笔记-Watermark
一、两种watermark类型1、Periodic(常用)周期性(一定时间间隔或者到达一定记录数)生成watermark。对应接口:AssignerWithPeriodicWatermarks必须结合时间或者累计条数两个维度,否则在极端情况下会有很大的延时。两个个抽象类:AscendingTimestampExtractorBoundedOutOfOrd...原创 2022-05-06 21:11:47 · 215 阅读 · 0 评论 -
Flink笔记-侧输出流
public class OutPutTagStream { public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.setParallelism(3); FlinkKafkaConsumer010<St.原创 2022-05-06 21:10:33 · 553 阅读 · 0 评论 -
Flink-读取kafka的数据及Checkpoint配置
public class KafkaSourceStream { public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.setParallelism(3); env.enableCheckpointing(5.原创 2022-05-06 21:09:40 · 1546 阅读 · 1 评论 -
Flink笔记-sink写入kafka
public class KafkaSinkStream { public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.setParallelism(3); DataStreamSource<String&.原创 2022-05-06 21:08:55 · 1036 阅读 · 0 评论 -
Flink笔记-idea中启动webUI
1、maven依赖<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-runtime-web_2.12</artifactId> <version>1.10.1</version> <scope>compile</scope></dependency>2、代码原创 2022-05-06 21:07:56 · 736 阅读 · 0 评论