flink的(Sliding)滑动窗口
未分组全局执行的滑动窗口(Sliding)
滑动窗口一般用于股票的可视化实现,他不会忽然高了忽然低了,他会有一个过渡缓冲区.
public class Sliding1 {
public static void main(String[] args)throws Exception {
StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
DataStreamSource<String> lines = env.socketTextStream("localhost", 8888);
SingleOutputStreamOperator<Integer> inte = lines.map(Integer::parseInt);
AllWindowedStream<Integer, TimeWindow> sliding = inte.windowAll(SlidingProcessingTimeWindows.of(Time.seconds(20), Time.seconds(10)));
SingleOutputStreamOperator<Integer> summed = sliding.sum(0);
summed.print();
env.execute();
}
}
在8888端口一次输入:
123
123
123
123
123
在打印台打印出:
log4j:WARN No appenders could be found for logger (org.apache.flink.api.java.ClosureCleaner).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
4> 123
1> 246
2> 246
3> 246
4> 246
分组全局执行的滑动窗口(Sliding)
public class Sliding2 {
public static void main(String[] args) throws Exception{
StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
DataStreamSource<String> line = env.socketTextStream("localhost", 8888);
SingleOutputStreamOperator<Tuple2<String, Integer>> wordandone = line.map(new MapFunction<String, Tuple2<String, Integer>>() {
@Override
public Tuple2<String, Integer> map(String word) throws Exception {
return Tuple2.of(word, 1);
}
});
KeyedStream<Tuple2<String, Integer>, Tuple> keyedStream = wordandone.keyBy(0);
WindowedStream<Tuple2<String, Integer>, Tuple, TimeWindow> time = keyedStream.window(SlidingProcessingTimeWindows.of(Time.seconds(10), Time.seconds(5)));
SingleOutputStreamOperator<Tuple2<String, Integer>> summed = time.sum(1);
summed.print();
env.execute();
}
}
888端口输入:
shuju
shuju
shuju
shuju
打印台:
2> (shuju,1)
2> (shuju,2)
2> (shuju,2)
2> (shuju,2)