flink
想念是会呼吸的鱼
码代码,持续学习,项目输出
展开
-
flink-cep
flink-CEP模式package com.ct.loginfail_detect;import com.ct.loginfail_detect.beans.LoginEvent;import com.ct.loginfail_detect.beans.LoginFailWarning;import org.apache.flink.api.common.functions.MapFunction;import org.apache.flink.cep.CEP;import org.apac原创 2021-06-21 15:41:05 · 89 阅读 · 0 评论 -
flink状态管理
flink状态管理1.算子状态2.键控状态3.状态后端原创 2021-06-01 15:52:35 · 58 阅读 · 0 评论 -
flink--waterMark
flink–waterMark1.Flink的时间语义2.设置Event Time没有设置的的话 默认是 processing time3.水位线(WaterMark)4.waterMark的传递、引入和设定原创 2021-05-30 17:48:52 · 69 阅读 · 1 评论 -
flink--自定义sink
自定义sinkpublic class SinkToJDBC { public static void main(String[] args) throws Exception { StreamExecutionEnvironment env =StreamExecutionEnvironment.getExecutionEnvironment(); DataStreamSource<String> inputStream =原创 2021-05-28 15:08:25 · 401 阅读 · 0 评论 -
flink之sink
flink —sink来自 https://ashiamd.github.io/docsify-notes/#/study/BigData/Flink1.to kafkapublic static void main(String[] args) throws Exception{ // 创建环境 StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment()原创 2021-05-28 11:13:07 · 205 阅读 · 0 评论 -
flink之richFunction
richFunction记录自定义富函数-recordingpublic class TransformRichFunction { public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); DataSt原创 2021-05-27 18:00:58 · 225 阅读 · 0 评论 -
flink算子(2)
flink 算子 keyBy min max minBy maxBy reduce spilt selectkeyByDatastream -->KeyedStream:逻辑的将一个流拆分成不相交的分区,每个分区包含具有相同key的元素,在内部以hash的形式实现的1、KeyBy会重新分区; 2、不同的key有可能分到一起,因为是通过hash原理实现的;!!但并不是同一个分区就只有一个相同的Key滚动聚合算子sum min max minBy maxBy,针对KeyedStrxea原创 2021-05-27 11:58:46 · 227 阅读 · 0 评论 -
flink算子(1)
flink 算子(1)map flatMap filterpublic class CalculationAPI { public static void main(String[] args) throws Exception{ StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); DataStream<S原创 2021-05-26 10:45:43 · 68 阅读 · 0 评论 -
flink
flink流计算代码有待完善public class CountStream { public static void main(String[] args) { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); //设置并行度,可以根据自己的CPU核数 env.setParallelism(8);// St原创 2021-05-24 10:38:23 · 69 阅读 · 0 评论 -
flink
flink之wordConutpublic class Count { public static void main(String[] args) { //create environment ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment(); env.setParallelism(4); //add t原创 2021-05-24 10:18:59 · 174 阅读 · 0 评论