准备工作:搭建Hadoop、kafka、zk集群等(略)。
脚本启动集群后,开启kafka主题消费:
bin/kafka-console-consumer.sh --bootstrap-server hadoop002:9092 --from-beginning --topic GoodmeODS_orderMaster
kafka_sink_kafka_ods代码如下:
import java.time.Duration
import org.apache.flink.streaming.api.{
CheckpointingMode, TimeCharacteristic}
import org.apache.flink.streaming.api.environment.{
ExecutionCheckpointingOptions, StreamExecutionEnvironment}
import org.apache.flink.table.api.{
EnvironmentSettings, SqlDialect}
import org.apache.flink.table.api.bridge.java.StreamTableEnvironment
import org.apache.flink.table.catalog.hive.HiveCatalog