java读取kafka_flink读取kafka数据（java）

目前读取kafka的需求较多，在此做记录。

pom依赖

org.apache.flink

flink-connector-kafka_2.12

1.10.1

org.apache.flink

flink-java

1.10.0

org.apache.flink

flink-streaming-java_2.12

1.10.0

provided

org.apache.flink

flink-clients_2.12

1.10.0

org.slf4j

slf4j-api

1.7.25

org.slf4j

slf4j-simple

1.7.25

处理代码

public class FullPull {

public static void main(String[] args) throws Exception {

//获取flink的运行环境

StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();

//checkpoint配置

env.enableCheckpointing(5000);

env.getCheckpointConfig().setCheckpointingMode(CheckpointingMode.EXACTLY_ONCE);

env.getCheckpointConfig().setCheckpointTimeout(60000);

env.getCheckpointConfig()