Flink的SqlClient工具

SqlClient

启动换一个yarn-session,

bin/yarn-session -d

然后启动一个sql客户端.

bin/sql-client.sh embedded

建立到Kafka的连接

下面创建一个流表从Kafka读取数据

copy 依赖到 flink的lib 目录下 flink-sql-connector-kafka_2.11-1.12.0.jar 下载地址: https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-kafka_2.11/1.12.0/flink-sql-connector-kafka_2.11-1.12.0.jar

create table sensor(id string, ts bigint, vc int)
with(
    'connector'='kafka',
    'topic'='flink_sensor',
    'properties.bootstrap.servers'='hadoop162:9092',
    'properties.group.id'='atguigu',
    'format'='json',
    'scan.startup.mode'='latest-offset'
)

从流表查询数据

select * from sensor;

向Kafka写入数据: {"id": "sensor1", "ts": 1000, "vc": 10}

建立到mysql的连接

依赖: flink-sql-connector-kafka_2.11-1.12.0.jar

copy mysql驱动到lib目录

create table sensor(id string, ts bigint, vc int)
with(
    'connector' = 'jdbc',
    'url' = 'jdbc:mysql://hadoop162:3306/gmall',
    'username'='root',
    'password'='aaaaaa',
    'table-name' = 'sensor'
)