FlinkCDC 运行报错（求解决）

最新推荐文章于 2024-08-22 19:51:17 发布

CJunZero

最新推荐文章于 2024-08-22 19:51:17 发布

阅读量735

点赞数 1

文章标签：数据库 java flink Powered by 金山文档

本文链接：https://blog.csdn.net/CJunZero/article/details/128960883

版权

在尝试使用FlinkCDC从MySQL数据库读取数据时，程序遇到了JobExecutionException，错误信息指出由于性能_schema.processlist表不存在导致ConnectException。这可能是由于MySQL的配置或版本不兼容问题。解决方案可能包括检查数据库表存在性，更新或调整Debezium和MySQL的配置。

摘要由CSDN通过智能技术生成

代码

// 获取执行环境
        StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
        env.setParallelism(1);

        DebeziumSourceFunction<String> sourceFunction = MySQLSource.<String>builder()
                .hostname("hadoop102")
                .port(3306)
                .username("root")
                .password("xxxx")
                .databaseList("gmall-210325-flink")
                .tableList("gmall-210325-flink.base_trademark")
                .startupOptions(StartupOptions.initial())
                .deserializer(new CustomerDeserialization())
                .build();

        //4.使用 CDC Source 从 MySQL 读取数据
        DataStreamSource<String> streamSource = env.addSource(sourceFunction);

        //打印数据
        streamSource.print();

        //6.执行任务
        env.execute("FlinkCDCWithCustomerDeSerialization");

报错

Exception in thread "main" org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
    at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:147)
    at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$2(MiniClusterJobClient.java:119)
    at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
    at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
    at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
    at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
    at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$0(AkkaInvocationHandler.java:229)
    at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
    at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
    at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
    at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
    at org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:996)
    at akka.dispatch.OnComplete.internal(Future.s