使用Flink-SQL client通过JDBC操作mysql表

qq_37969476

已于 2022-05-21 13:34:51 修改

阅读量2.2k

点赞数 12

文章标签： mysql flink sql

于 2022-05-21 13:31:02 首次发布

本文链接：https://blog.csdn.net/qq_37969476/article/details/124897012

版权

该博客详细介绍了如何下载并安装Flink1.14.4，将MySQL驱动和连接器添加到lib目录，启动Flink集群和SQL客户端。接着，在MySQL中创建表并插入数据，然后使用Flink SQL创建两个表的DDL，并将数据从一个表迁移到另一个表。最后，验证了Flink SQL操作成功，数据库中数据已更新。

摘要由CSDN通过智能技术生成

1 官网下载Flink 1.14.4版本

2 移动到 /opt/module/

cd /opt/module/
tar -zxvf flink-1.14.4-bin-scala_2.11.tgz

3 下载mysql驱动包和 flink连接mysql的jar包

cd /opt/module/flink-1.14.4/lib 

wget https://repo.maven.apache.org/maven2/org/apache/flink/flink-connector-jdbc_2.11/1.14.4/flink-connector-jdbc_2.11-1.14.4.jar

wget https://repo.maven.apache.org/maven2/mysql/mysql-connector-java/5.1.37/mysql-connector-java-5.1.37.jar

4、启动Flink-cluster

/opt/module/flink-1.14.4/bin/start-cluster.sh

5、启动sql-client

/opt/module/flink-1.14.4/bin/sql-client.sh embedded

6、在mysql创建2张表并插入数据

create database demo character set utf8mb4;
use demo;

create table student1(`id` int primary key, `name` varchar(128), `age` int);

create table student2(`id` int primary key, `name` varchar(128), `age` int);

insert into student1 values(10001,'paul',20);
insert into student1 values(10002,'lihong',21);
insert into student1 values(10003,'wangdong',22);

insert into student2 values(10004,'lihong',15);
insert into student2 values(10005,'wangwu',21);
insert into student2 values(10006,'zhangsan',27);

7、在Flink 客户端输入映射mysql的Flink DDL语句

在这里插入图片描述

FLINK SQL >
create table MyUserTable1(
 `id` int , 
 `name` varchar(128), 
 `age` int,
  PRIMARY KEY (id) NOT ENFORCED
) WITH (
   'connector' = 'jdbc',
	 'driver'='com.mysql.cj.jdbc.Driver',
   'url' = 'jdbc:mysql://localhost:3306/demo',
   'table-name' = 'student1',
   'username' = 'test',
   'password' = '123456',
   'sink.buffer-flush.max-rows' = '10'
);

FLINK SQL >
create table MyUserTable1(
 `id` int , 
 `name` varchar(128), 
 `age` int,
  PRIMARY KEY (id) NOT ENFORCED
) WITH (
   'connector' = 'jdbc',
   'driver'='com.mysql.cj.jdbc.Driver',
   'url' = 'jdbc:mysql://localhost:3306/demo',
   'table-name' = 'student2',
   'username' = 'test',
   'password' = '123456',
   'sink.buffer-flush.max-rows' = '10'
);

FLINK SQL > 
INSERT INTO MyUserTable1
SELECT id, name, age FROM MyUserTable2;


FLINK SQL > 
SELECT id, name, age  FROM MyUserTable1;