flink split分流算子不能使用 flink split算子被官方删除

最新推荐文章于 2024-04-16 19:33:41 发布

北凉-徐凤年

最新推荐文章于 2024-04-16 19:33:41 发布

阅读量420

点赞数

分类专栏： flink实时数仓文章标签： flink 大数据 Powered by 金山文档

本文链接：https://blog.csdn.net/Liu__sir__/article/details/129581685

版权

flink实时数仓专栏收录该内容

1 篇文章 0 订阅

订阅专栏

文章介绍了在Flink1.13.1版本中split函数不再可用，推荐使用ProcessFunction作为替代。示例代码展示了如何使用ProcessFunction处理数据流，根据WaterSensor对象的vc值将其分为三个不同的输出流。

摘要由CSDN通过智能技术生成

最近发现flink 1.13.1split函数没！！！！！

下面是官方给的替换用的算子链接

https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/side_output.html

package hero.com.flink_a.demo1;

import hero.com.flink_a.bean.WaterSensor;
import org.apache.flink.api.common.functions.MapFunction;
import org.apache.flink.streaming.api.datastream.DataStreamSource;
import org.apache.flink.streaming.api.datastream.SingleOutputStreamOperator;
import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;
import org.apache.flink.streaming.api.functions.ProcessFunction;
import org.apache.flink.util.Collector;

public class flink_transtorm_split {
    public static void main(String[] args) throws Exception{
        StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
        env.setParallelism(2);
        DataStreamSource<String> datas = env.readTextFile("flinkdemo1/input/sensor-data.log");

        SingleOutputStreamOperator<WaterSensor> mapDS = datas.map(
                new MapFunction<String, WaterSensor>() {
                    @Override
                    public WaterSensor map(String inputs) throws Exception {
                        String[] splits = inputs.split(",");
                        return new WaterSensor(splits[0], Long.valueOf(splits[1]), Integer.valueOf(splits[2]));
                    }
                }
        );
        //mapDS.print("map");
        SingleOutputStreamOperator<String> processDB = mapDS.process(
                new ProcessFunction<WaterSensor, String>() {
                    @Override
                    public void processElement(WaterSensor waterSensor, Context context, Collector<String> output) throws Exception {
                        if (waterSensor.getVc() < 50) {
                            output.collect("a:" + waterSensor.toString());
                        } else if (waterSensor.getVc() < 80) {
                            output.collect("B:" + waterSensor.toString());
                        }else {
                            output.collect("C:"  + waterSensor.toString());
                        }
                    }
                }
        );
        processDB.print("process");
        env.execute();
    }
}

process function的功能当然还有很多，是flink中非常强大的函数。

想想测输出流怎么做。