flink
要什么简介,没有!
啃骨头的代码狗
我写的都是骗人的
展开
-
flink自定义指标发送到pushgateway写入prometheus
flink官方提供了写metrics的方式,但是相对来说有些不灵活,不符合我当前的要求,也没法自定义动态的label值,于是自定义了sink写入到pushgateway里。代码如下: class MyPushGateWaySink(pushgatewayipport:String) extends RichSinkFunction[(String,String,String)] { var pushgateway:PushGateway = _ var gauge:Gauge = G原创 2021-12-22 17:02:03 · 2305 阅读 · 0 评论 -
Flink异常:java.lang.AbstractMethodError: Method XXX Ljava/lang/Object; is abstract
java.lang.AbstractMethodError: Method flink/connect/kafka/stringTest$1.deserialize(Lorg/apache/flink/kafka/shaded/org/apache/kafka/clients/consumer/ConsumerRecord;)Ljava/lang/Object; is abstract at flink.connect.kafka.stringTest$1.deserialize(stringTest.j原创 2020-12-30 20:42:46 · 2528 阅读 · 2 评论 -
Flink自定义format,实现解析kafka自定义格式的cdc数据
flink自定义format,解析cdc数据原创 2020-11-06 14:38:10 · 3526 阅读 · 0 评论 -
flink DataStream[Row]注册为table报错:An input of GenericTypeInfo<Row> cannot be converted to Table.
读取test.csv的内容,map将内容转换为Row类型,然后注册为tableval stream = env.readFile(inputFormat,"D://test.csv",FileProcessingMode.val stream = val stream = env.readFile(inputFormat,"D://fsimage.csv",FileProcessingMode.PROCESS_CONTINUOUSLY,1000L).setParallelism(1)val strea原创 2020-07-31 17:12:17 · 1619 阅读 · 0 评论