FlinkCDC 2.1.1记录

已于 2023-07-12 15:47:40 修改
阅读量1.5k 收藏 4
点赞数
分类专栏： Flink 文章标签： flink
于 2022-03-18 15:55:27 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_15138049/article/details/123574976
版权
Flink CDC 2.0 数据处理流程全面解析

https://cloud.tencent.com/developer/article/1899520

Mysql
MySqlSource<String> mySqlSource = MySqlSource.<String>builder()
                .hostname("localhost")
                .port(3306)
                .databaseList("test") // monitor all tables under inventory database
                .tableList("test.nt_eau_switch, test.test")
                .username("root")
                .password("123456")
                .deserializer(new MysqlStringDeserializationSchema()) // 自定义：converts SourceRecord to JSON String
                .build();

DataStream<String> cdcstream = env.fromSource(mySqlSource, WatermarkStrategy.noWatermarks(), "Mysql业务数据源");

 //注释tableList报以下错误...
.tableList("test.nt_eau_switch, test.test")

15:49:32.130 [flink-akka.actor.default-dispatcher-2] ERROR org.apache.flink.runtime.util.FatalExitExceptionHandler - FATAL: Thread 'flink-akka.actor.default-dispatcher-2' produced an uncaught exception. Stopping the process...
java.util.concurrent.CompletionException: org.apache.flink.runtime.rpc.akka.exceptions.AkkaRpcException: Could not start RpcEndpoint jobmanager_3.
	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture.uniRun(CompletableFuture.java:700) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture$UniRun.tryFire(CompletableFuture.java:687) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture.uniRunStage(CompletableFuture.java:720) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture.thenRunAsync(CompletableFuture.java:2019) ~[?:1.8.0_152]
	at org.apache.flink.runtime.dispatcher.Dispatcher.removeJob(Dispatcher.java:737) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$runJob$4(Dispatcher.java:425) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:561) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:800) ~[?:1.8.0_152]
	at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:442) ~[?:1.8.0_152]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:440) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:208) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:158) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) [scala-library-2.11.12.jar:?]
	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) [scala-library-2.11.12.jar:?]
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [scala-library-2.11.12.jar:?]
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [scala-library-2.11.12.jar:?]
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.actor.ActorCell.invoke(ActorCell.scala:561) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.dispatch.Mailbox.run(Mailbox.scala:225) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.dispatch.Mailbox.exec(Mailbox.scala:235) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [akka-actor_2.11-2.5.21.jar:2.5.21]
Caused by: org.apache.flink.runtime.rpc.akka.exceptions.AkkaRpcException: Could not start RpcEndpoint jobmanager_3.
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.start(AkkaRpcActor.java:610) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:180) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) ~[scala-library-2.11.12.jar:?]
	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) ~[scala-library-2.11.12.jar:?]
	... 12 more
Caused by: org.apache.flink.runtime.jobmaster.JobMasterException: Could not start the JobMaster.
	at org.apache.flink.runtime.jobmaster.JobMaster.onStart(JobMaster.java:385) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStart(RpcEndpoint.java:181) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.start(AkkaRpcActor.java:605) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:180) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) ~[scala-library-2.11.12.jar:?]
	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) ~[scala-library-2.11.12.jar:?]
	... 12 more
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to start the operator coordinators
	at org.apache.flink.runtime.scheduler.DefaultOperatorCoordinatorHandler.startAllOperatorCoordinators(DefaultOperatorCoordinatorHandler.java:90) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.scheduler.SchedulerBase.startScheduling(SchedulerBase.java:592) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.jobmaster.JobMaster.startScheduling(JobMaster.java:955) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.jobmaster.JobMaster.startJobExecution(JobMaster.java:873) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.jobmaster.JobMaster.onStart(JobMaster.java:383) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStart(RpcEndpoint.java:181) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.start(AkkaRpcActor.java:605) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:180) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) ~[scala-library-2.11.12.jar:?]
	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) ~[scala-library-2.11.12.jar:?]
	... 12 more
Caused by: java.lang.NullPointerException
	at org.apache.flink.util.Preconditions.checkNotNull(Preconditions.java:59) ~[flink-core-1.13.2.jar:1.13.2]
	at com.ververica.cdc.connectors.mysql.source.config.MySqlSourceConfig.<init>(MySqlSourceConfig.java:91) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1]
	at com.ververica.cdc.connectors.mysql.source.config.MySqlSourceConfigFactory.createConfig(MySqlSourceConfigFactory.java:287) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1]
	at com.ververica.cdc.connectors.mysql.source.MySqlSource.createEnumerator(MySqlSource.java:153) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1]
	at org.apache.flink.runtime.source.coordinator.SourceCoordinator.start(SourceCoordinator.java:124) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$DeferrableCoordinator.applyCall(RecreateOnResetOperatorCoordinator.java:291) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator.start(RecreateOnResetOperatorCoordinator.java:70) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder.start(OperatorCoordinatorHolder.java:194) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.scheduler.DefaultOperatorCoordinatorHandler.startAllOperatorCoordinators(DefaultOperatorCoordinatorHandler.java:85) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.scheduler.SchedulerBase.startScheduling(SchedulerBase.java:592) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.jobmaster.JobMaster.startScheduling(JobMaster.java:955) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.jobmaster.JobMaster.startJobExecution(JobMaster.java:873) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.jobmaster.JobMaster.onStart(JobMaster.java:383) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStart(RpcEndpoint.java:181) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.start(AkkaRpcActor.java:605) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:180) ~[flink-runtime_2.11-1.13.2.jar:1.13.2]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) ~[scala-library-2.11.12.jar:?]
	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) ~[akka-actor_2.11-2.5.21.jar:2.5.21]
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) ~[scala-library-2.11.12.jar:?]
	... 12 more


// 监控全数据库表
.tableList()
Mongodb
SourceFunction<String> sourceFunction = MongoDBSource.<String>builder()
                .hosts("hadoop03:30011")
                .username("root")
                .password("123456")
                .database("school")
                .collection("student")
                .deserializer(new MongodbStringDeserializationSchema())
                .build();

        DataStreamSource<String> mongodbCDCstream = env.addSource(sourceFunction);


String mongodb_ddl = "CREATE TABLE mongodb_sources_test ( " +
                " _id STRING, " +
                " name STRING, " +
                " age int, " +
                " PRIMARY KEY (_id) NOT ENFORCED" +
                ") WITH ( " +
                " 'connector' = 'mongodb-cdc', " +
                " 'hosts' = 'hadoop03:30010', " +
                " 'username' = 'root', " +
                " 'password' = '123456', " +
                " 'database' = 'school', " +
                " 'collection' = 'student'" +
                ")";

        tableEnv.executeSql(mysql_cdc);

        // kafka
        String kafka_sink_sql = "CREATE TABLE sink (" +
                " _id STRING, " +
                " name STRING, " +
                " age int " +
                ") WITH (" +
                "  'connector' = 'kafka'," +
                "  'topic' = 'cdc-test-1'," +
                "  'properties.bootstrap.servers' = 'hadoop01:9092'," +
                "  'format' = 'changelog-json' )";

        tableEnv.executeSql(kafka_sink_sql);

        tableEnv.executeSql("insert into sink select * from mongodb_sources_test");
FlinkCDC 记录
Flink SQL CDC 上线！我们总结了 13 条生产实践经验

https://blog.csdn.net/qq_31975963/article/details/108585043?utm_medium=distribute.pc_relevant.none-task-blog-2defaultbaidujs_baidulandingword~default-0.pc_relevant_paycolumn_v3&spm=1001.2101.3001.4242.1&utm_relevant_index=3

FlinkCDC Mongodb2Elasticsearch

https://ververica.github.io/flink-cdc-connectors/master/content/%E5%BF%AB%E9%80%9F%E4%B8%8A%E6%89%8B/mongodb-tutorial-zh.html?highlight=mongodb

flink-cdc写入hive,每日合并增量

https://www.csdn.net/tags/Ntzacg5sNjYzMjctYmxvZwO0O0OO0O0O.html

FlinkCDC 博客

https://ververica.github.io/flink-cdc-connectors/master/index.html

FlinkCDC 数据顺序性

在这里插入图片描述

Flink CDC 2.0 正式发布，详解核心改进

https://mp.weixin.qq.com/s?__biz=MzU3Mzg4OTMyNQ==&mid=2247493214&idx=1&sn=5c1add3c2ea15f300d8afca522bd77a0&chksm=fd38681cca4fe10a28540bbb22e11459a0332a0f6b3fc6a471811ecfc50919601ff88871816c&scene=21#wechat_redirect

问题记录

FlinkCDC在生产环境测试时一直报错没有MySQL的RELOAD权限

https://www.cnblogs.com/30go/p/15808632.html

CREATE USER 'bigdata'@'%' IDENTIFIED BY 'password';
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'bigdata' IDENTIFIED BY 'password';
FLUSH PRIVILEGES;
胖胖胖胖胖虎
关注
  • 0
    点赞
  • 踩
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
flink flinkcdc format json和changelog-json的区别
yy的博客
08-12 2310
json和changelog-json的区别 前者(json)只是 insert-only 的数据，后者(changelog-json)是 changelog 数据.
如何使用flink cdc同步mongo数据到oceanbase
最新发布
猿脑2.0的博客
06-19 431
Apache Flink 目前并没有内置的 MongoDB CDC 连接器，但是你可以使用 Debezium 或其他 CDC 工具来捕获 MongoDB 的变更数据，并将其转换为 Flink 可以处理的格式。然后，你可以使用 Flink 的 DataStream API 或 SQL API 来处理这些数据，并最终将它们写入到 OceanBase 中。特别是，OceanBase 的 Flink 连接器可能需要自定义实现，或者你可能需要使用 JDBC Sink 来实现数据写入。
一文弄懂Flink CDC
a805814077的博客
07-25 7811
Flink CDC的详解，一文就能理解透彻
flink
weixin_45118947的博客
08-22 334
flink 1、概述 flink是一个计算框架和分布式处理引擎，用于对有界流和无界流进行有状态计算 dataset API 对静态数据进行批处理操作，将静态数据抽象成分布式的数据集，用户可以方便地使用Flink提供的各种操作符对分布式数据集进行处理，支持Java、Scala和Python1 datastream api 对数据流进行流处理操作，将流式的数据抽象成分布式的数据流，用户可以方便地对分布式数据流进行各种操作，支持Java和Scala table api 对结构化数据进行查询操
Flink SQL JSON Format 源码解析
JasonLee实时计算
10-29 4770
用 Flink SQL 解析 JSON 格式的数据是非常简单的,只需要在 DDL 语句中设置 Format 为 json 即可,像下面这样:CREATETABLEkafka_sourc...
nacos2.1.1-达梦数据库-windows版本
10-08
在这个"nacos2.1.1-达梦数据库-windows版本"的压缩包中，我们可以推测这是 Nacos 的一个定制版本，专门针对达梦数据库在 Windows 操作系统上的运行。 达梦数据库是国产的一款关系型数据库管理系统，它具有高可用性...
windows 下 nacos2.1.1压缩包
08-23
在Windows环境下安装和使用Nacos2.1.1版本，你需要了解以下几个关键知识点： 1. **下载与解压**：首先，你需要从官方或可靠的源下载Nacos2.1.1的Windows版本压缩包。下载完成后，将其解压到本地文件夹，通常包含`...
nacos-2.1.1安装包.zip
03-14
在本文中，我们将深入探讨Nacos 2.1.1版本的安装、配置以及它在软件开发中的重要性。 首先，Nacos的核心功能包括服务发现和服务配置。服务发现允许微服务架构中的各个组件找到彼此，而服务配置则提供了动态管理和...
微服务nacos2.1.1-gateway-Sentinel1.8.3代码实现
08-18
微服务nacos2.1.1 实现了与 Sentinel1.8.3整合的gateway,详见nacos-gateway 建了两个测试工程consumer和provider 实现了以下几种方式访问： 直接访问consumer：http://localhost:8085/user/get 通过gateway访问...
hive-jdbc-2.1.1-cdh6.2.0-standalone.jar
09-24
hive-jdbc-2.1.1-cdh6.2.0（ieda等jdbc链接hive2.1.1）；cdh6.2.0安装的hive2.1.1
flinkCdc的mysql配置及java测试代码
shy_snow的专栏
02-21 6226
测试使用的是flinkCdc2.1.1版本(无锁同步,1.x版本有同步锁)目前支持mysql5.7及以上版本; 要在mysql.cnf中配置开启开启mysql的bin-log日志, log_bin=mysql-bin binlog_format=ROW 并且只支持ROW格式，其他mixed和statement会报错如果想配置控制binlog日志的范围,在数据库范围可以使用mysql的binlog-do-db和binlog-ignore-db,表级别可以使用replicate_wild_do_t.
Flink CDC2.4 整库实时同步MySql 到Doris
希夷的博客
06-29 6220
mysql 到doris的数据、表结构实时同步
FlinkCDC 运行报错（求解决）
CJunZero的博客
02-09 703
FlinkCDC报错
使用flink将mysql数据入湖delta
czladamling的博客
11-17 1087
Delta数据湖原来是强绑定于Spark引擎，而近期社区实现了使用Flink引擎将数据入湖，简单写个demo使用下。
flink 发生SerializationFailedException错误
JavaBigData的博客
08-14 413
flink 发生SerializationFailedException错误，原因是case class 普通class在transform过程中反复序列化和反序列化所致，可以使用string类型进行传递，配合元组，这种不容易发生错误，自定义的class引用全局变量时，若class放在object外面为出现序列化错误，放在object中可以解决 ...
【FlinkCdc】Flink MysqlCdc连接数据库失败，SSLHandshakeException怎么破？
m0_66705151的博客
05-22 2532
Flink MysqlCdc连接数据库失败，报SSLHandshakeException，应该怎么破？
Flinkcdc监测mysql数据库，自定义反序列化，利用flinkApi和flinkSql两种方式
2301_79197199的博客
04-05 1599
CDC (Flink Change Data Capture)（Flink中改变数据捕获） 是基于数据库的日志 CDC 技术，实现了全增量一体化读取的数据集成框架。搭配Flink计算框架，Flink CDC 可以高效实现海量数据的实时集成。改变你们的一个误区，cdc只有检测功能，不能对数据库中的数据进行修改删除添加。
flink mysql cdc调试问题记录
kakaweb的博客
03-10 4768
最近需要用到flink cdc作为数据流处理框架，在demo运行中发现一些问题，特此记录问题和解决过程。
OVM 2.1.1 Kit验证方法详解
OVM 2.1.1 Kit 提供了一套完整的验证方法学，它在 March 2010 的版本中被更新和发布，由 Cadence Design Systems 和 Mentor Graphics 共同维护和支持。这个工具集遵循 Apache Software Foundation 的 Apache License...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值