Flink CDC:io.debezium.connector.mysql.SnapshotReader] - Can‘t call rollback when autocommit=true

zxp0001

于 2024-06-14 10:47:21 发布

阅读量336

点赞数 7

文章标签： flink mysql 大数据 hbase

本文链接：https://blog.csdn.net/weixin_45082972/article/details/139675096

版权

关于报错 Failed due to error: Aborting snapshot due to error when

Can’t call rollback when autocommit=true

1. 在运行 Flink CDC程序的时候出现如下报错:

D:\develop\JAVA\Java\jdk1.8.0_271\bin\java.exe -agentlib:jdwp=transport=dt_socket,address=127.0.0.1:63129,suspend=y,server=n -javaagent:C:\Users\Administrator\AppData\Local\JetBrains\IntelliJIdea2023.3\captureAgent\debugger-agent.jar=file:/C:/Users/Administrator/AppData/Local/Temp/capture.props -Dfile.encoding=UTF-8 -classpath "D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\charsets.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\deploy.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\access-bridge-64.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\cldrdata.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\dnsns.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\jaccess.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\jfxrt.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\localedata.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\nashorn.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\sunec.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\sunjce_provider.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\sunmscapi.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\sunpkcs11.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\ext\zipfs.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\javaws.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\jce.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\jfr.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\jfxswt.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\jsse.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\management-agent.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\plugin.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\resources.jar;D:\develop\JAVA\Java\jdk1.8.0_271\jre\lib\rt.jar;D:\develop\IDEA\newWorkSpace\gmall2024_parent\gmall2024_parent\flink_realtime\target\classes;D:\develop\repository\org\apache\flink\flink-java\1.12.0\flink-java-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-core\1.12.0\flink-core-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-annotations\1.12.0\flink-annotations-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-metrics-core\1.12.0\flink-metrics-core-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-shaded-asm-7\7.1-12.0\flink-shaded-asm-7-7.1-12.0.jar;D:\develop\repository\com\esotericsoftware\kryo\kryo\2.24.0\kryo-2.24.0.jar;D:\develop\repository\com\esotericsoftware\minlog\minlog\1.2\minlog-1.2.jar;D:\develop\repository\org\objenesis\objenesis\2.1\objenesis-2.1.jar;D:\develop\repository\commons-collections\commons-collections\3.2.2\commons-collections-3.2.2.jar;D:\develop\repository\org\apache\commons\commons-compress\1.20\commons-compress-1.20.jar;D:\develop\repository\org\apache\commons\commons-lang3\3.3.2\commons-lang3-3.3.2.jar;D:\develop\repository\org\apache\commons\commons-math3\3.5\commons-math3-3.5.jar;D:\develop\repository\com\google\code\findbugs\jsr305\1.3.9\jsr305-1.3.9.jar;D:\develop\repository\org\apache\flink\force-shading\1.12.0\force-shading-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-streaming-java_2.12\1.12.0\flink-streaming-java_2.12-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-file-sink-common\1.12.0\flink-file-sink-common-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-runtime_2.12\1.12.0\flink-runtime_2.12-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-queryable-state-client-java\1.12.0\flink-queryable-state-client-java-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-hadoop-fs\1.12.0\flink-hadoop-fs-1.12.0.jar;D:\develop\repository\commons-io\commons-io\2.7\commons-io-2.7.jar;D:\develop\repository\org\apache\flink\flink-shaded-netty\4.1.49.Final-12.0\flink-shaded-netty-4.1.49.Final-12.0.jar;D:\develop\repository\org\apache\flink\flink-shaded-jackson\2.10.1-12.0\flink-shaded-jackson-2.10.1-12.0.jar;D:\develop\repository\org\apache\flink\flink-shaded-zookeeper-3\3.4.14-12.0\flink-shaded-zookeeper-3-3.4.14-12.0.jar;D:\develop\repository\org\javassist\javassist\3.24.0-GA\javassist-3.24.0-GA.jar;D:\develop\repository\org\scala-lang\scala-library\2.12.7\scala-library-2.12.7.jar;D:\develop\repository\com\typesafe\akka\akka-actor_2.12\2.5.21\akka-actor_2.12-2.5.21.jar;D:\develop\repository\com\typesafe\config\1.3.3\config-1.3.3.jar;D:\develop\repository\org\scala-lang\modules\scala-java8-compat_2.12\0.8.0\scala-java8-compat_2.12-0.8.0.jar;D:\develop\repository\com\typesafe\akka\akka-stream_2.12\2.5.21\akka-stream_2.12-2.5.21.jar;D:\develop\repository\org\reactivestreams\reactive-streams\1.0.2\reactive-streams-1.0.2.jar;D:\develop\repository\com\typesafe\ssl-config-core_2.12\0.3.7\ssl-config-core_2.12-0.3.7.jar;D:\develop\repository\org\scala-lang\modules\scala-parser-combinators_2.12\1.1.1\scala-parser-combinators_2.12-1.1.1.jar;D:\develop\repository\com\typesafe\akka\akka-protobuf_2.12\2.5.21\akka-protobuf_2.12-2.5.21.jar;D:\develop\repository\com\typesafe\akka\akka-slf4j_2.12\2.5.21\akka-slf4j_2.12-2.5.21.jar;D:\develop\repository\org\clapper\grizzled-slf4j_2.12\1.3.2\grizzled-slf4j_2.12-1.3.2.jar;D:\develop\repository\com\github\scopt\scopt_2.12\3.5.0\scopt_2.12-3.5.0.jar;D:\develop\repository\org\xerial\snappy\snappy-java\1.1.4\snappy-java-1.1.4.jar;D:\develop\repository\com\twitter\chill_2.12\0.7.6\chill_2.12-0.7.6.jar;D:\develop\repository\com\twitter\chill-java\0.7.6\chill-java-0.7.6.jar;D:\develop\repository\org\lz4\lz4-java\1.6.0\lz4-java-1.6.0.jar;D:\develop\repository\org\apache\flink\flink-shaded-guava\18.0-12.0\flink-shaded-guava-18.0-12.0.jar;D:\develop\repository\org\apache\flink\flink-connector-kafka_2.12\1.12.0\flink-connector-kafka_2.12-1.12.0.jar;D:\develop\repository\org\apache\kafka\kafka-clients\2.4.1\kafka-clients-2.4.1.jar;D:\develop\repository\com\github\luben\zstd-jni\1.4.3-1\zstd-jni-1.4.3-1.jar;D:\develop\repository\org\apache\flink\flink-clients_2.12\1.12.0\flink-clients_2.12-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-optimizer_2.12\1.12.0\flink-optimizer_2.12-1.12.0.jar;D:\develop\repository\commons-cli\commons-cli\1.3.1\commons-cli-1.3.1.jar;D:\develop\repository\org\apache\flink\flink-cep_2.12\1.12.0\flink-cep_2.12-1.12.0.jar;D:\develop\repository\org\apache\flink\flink-json\1.12.0\flink-json-1.12.0.jar;D:\develop\repository\com\alibaba\fastjson\1.2.68\fastjson-1.2.68.jar;D:\develop\repository\org\apache\hadoop\hadoop-client\3.1.3\hadoop-client-3.1.3.jar;D:\develop\repository\org\apache\hadoop\hadoop-common\3.1.3\hadoop-common-3.1.3.jar;D:\develop\repository\com\google\guava\guava\27.0-jre\guava-27.0-jre.jar;D:\develop\repository\com\google\guava\failureaccess\1.0\failureaccess-1.0.jar;D:\develop\repository\com\google\guava\listenablefuture\9999.0-empty-to-avoid-conflict-with-guava\listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar;D:\develop\repository\org\checkerframework\checker-qual\2.5.2\checker-qual-2.5.2.jar;D:\develop\repository\com\google\errorprone\error_prone_annotations\2.2.0\error_prone_annotations-2.2.0.jar;D:\develop\repository\com\google\j2objc\j2objc-annotations\1.1\j2objc-annotations-1.1.jar;D:\develop\repository\org\codehaus\mojo\animal-sniffer-annotations\1.17\animal-sniffer-annotations-1.17.jar;D:\develop\repository\org\apache\httpcomponents\httpclient\4.5.2\httpclient-4.5.2.jar;D:\develop\repository\org\apache\httpcomponents\httpcore\4.4.4\httpcore-4.4.4.jar;D:\develop\repository\commons-codec\commons-codec\1.11\commons-codec-1.11.jar;D:\develop\repository\commons-net\commons-net\3.6\commons-net-3.6.jar;D:\develop\repository\org\eclipse\jetty\jetty-servlet\9.3.24.v20180605\jetty-servlet-9.3.24.v20180605.jar;D:\develop\repository\org\eclipse\jetty\jetty-webapp\9.3.24.v20180605\jetty-webapp-9.3.24.v20180605.jar;D:\develop\repository\org\eclipse\jetty\jetty-xml\9.3.24.v20180605\jetty-xml-9.3.24.v20180605.jar;D:\develop\repository\javax\servlet\jsp\jsp-api\2.1\jsp-api-2.1.jar;D:\develop\repository\com\sun\jersey\jersey-servlet\1.19\jersey-servlet-1.19.jar;D:\develop\repository\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;D:\develop\repository\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;D:\develop\repository\commons-beanutils\commons-beanutils\1.9.3\commons-beanutils-1.9.3.jar;D:\develop\repository\org\apache\commons\commons-configuration2\2.1.1\commons-configuration2-2.1.1.jar;D:\develop\repository\org\apache\avro\avro\1.7.7\avro-1.7.7.jar;D:\develop\repository\com\thoughtworks\paranamer\paranamer\2.3\paranamer-2.3.jar;D:\develop\repository\com\google\re2j\re2j\1.1\re2j-1.1.jar;D:\develop\repository\com\google\protobuf\protobuf-java\2.5.0\protobuf-java-2.5.0.jar;D:\develop\repository\com\google\code\gson\gson\2.2.4\gson-2.2.4.jar;D:\develop\repository\org\apache\hadoop\hadoop-auth\3.1.3\hadoop-auth-3.1.3.jar;D:\develop\repository\com\nimbusds\nimbus-jose-jwt\4.41.1\nimbus-jose-jwt-4.41.1.jar;D:\develop\repository\net\minidev\json-smart\2.3\json-smart-2.3.jar;D:\develop\repository\net\minidev\accessors-smart\1.2\accessors-smart-1.2.jar;D:\develop\repository\org\ow2\asm\asm\5.0.4\asm-5.0.4.jar;D:\develop\repository\org\apache\curator\curator-framework\2.13.0\curator-framework-2.13.0.jar;D:\develop\repository\org\apache\curator\curator-client\2.13.0\curator-client-2.13.0.jar;D:\develop\repository\org\apache\curator\curator-recipes\2.13.0\curator-recipes-2.13.0.jar;D:\develop\repository\org\apache\htrace\htrace-core4\4.1.0-incubating\htrace-core4-4.1.0-incubating.jar;D:\develop\repository\org\apache\kerby\kerb-simplekdc\1.0.1\kerb-simplekdc-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerb-client\1.0.1\kerb-client-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerby-config\1.0.1\kerby-config-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerb-core\1.0.1\kerb-core-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerby-pkix\1.0.1\kerby-pkix-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerby-asn1\1.0.1\kerby-asn1-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerby-util\1.0.1\kerby-util-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerb-common\1.0.1\kerb-common-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerb-crypto\1.0.1\kerb-crypto-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerb-util\1.0.1\kerb-util-1.0.1.jar;D:\develop\repository\org\apache\kerby\token-provider\1.0.1\token-provider-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerb-admin\1.0.1\kerb-admin-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerb-server\1.0.1\kerb-server-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerb-identity\1.0.1\kerb-identity-1.0.1.jar;D:\develop\repository\org\apache\kerby\kerby-xdr\1.0.1\kerby-xdr-1.0.1.jar;D:\develop\repository\com\fasterxml\jackson\core\jackson-databind\2.7.8\jackson-databind-2.7.8.jar;D:\develop\repository\com\fasterxml\jackson\core\jackson-core\2.7.8\jackson-core-2.7.8.jar;D:\develop\repository\org\codehaus\woodstox\stax2-api\3.1.4\stax2-api-3.1.4.jar;D:\develop\repository\com\fasterxml\woodstox\woodstox-core\5.0.3\woodstox-core-5.0.3.jar;D:\develop\repository\org\apache\hadoop\hadoop-hdfs-client\3.1.3\hadoop-hdfs-client-3.1.3.jar;D:\develop\repository\com\squareup\okhttp\okhttp\2.7.5\okhttp-2.7.5.jar;D:\develop\repository\com\squareup\okio\okio\1.6.0\okio-1.6.0.jar;D:\develop\repository\com\fasterxml\jackson\core\jackson-annotations\2.7.8\jackson-annotations-2.7.8.jar;D:\develop\repository\org\apache\hadoop\hadoop-yarn-api\3.1.3\hadoop-yarn-api-3.1.3.jar;D:\develop\repository\javax\xml\bind\jaxb-api\2.2.11\jaxb-api-2.2.11.jar;D:\develop\repository\org\apache\hadoop\hadoop-yarn-client\3.1.3\hadoop-yarn-client-3.1.3.jar;D:\develop\repository\org\apache\hadoop\hadoop-mapreduce-client-core\3.1.3\hadoop-mapreduce-client-core-3.1.3.jar;D:\develop\repository\org\apache\hadoop\hadoop-yarn-common\3.1.3\hadoop-yarn-common-3.1.3.jar;D:\develop\repository\javax\servlet\javax.servlet-api\3.1.0\javax.servlet-api-3.1.0.jar;D:\develop\repository\org\eclipse\jetty\jetty-util\9.3.24.v20180605\jetty-util-9.3.24.v20180605.jar;D:\develop\repository\com\sun\jersey\jersey-core\1.19\jersey-core-1.19.jar;D:\develop\repository\javax\ws\rs\jsr311-api\1.1.1\jsr311-api-1.1.1.jar;D:\develop\repository\com\sun\jersey\jersey-client\1.19\jersey-client-1.19.jar;D:\develop\repository\com\fasterxml\jackson\module\jackson-module-jaxb-annotations\2.7.8\jackson-module-jaxb-annotations-2.7.8.jar;D:\develop\repository\com\fasterxml\jackson\jaxrs\jackson-jaxrs-json-provider\2.7.8\jackson-jaxrs-json-provider-2.7.8.jar;D:\develop\repository\com\fasterxml\jackson\jaxrs\jackson-jaxrs-base\2.7.8\jackson-jaxrs-base-2.7.8.jar;D:\develop\repository\org\apache\hadoop\hadoop-mapreduce-client-jobclient\3.1.3\hadoop-mapreduce-client-jobclient-3.1.3.jar;D:\develop\repository\org\apache\hadoop\hadoop-mapreduce-client-common\3.1.3\hadoop-mapreduce-client-common-3.1.3.jar;D:\develop\repository\org\apache\hadoop\hadoop-annotations\3.1.3\hadoop-annotations-3.1.3.jar;D:\develop\repository\mysql\mysql-connector-java\5.1.49\mysql-connector-java-5.1.49.jar;D:\develop\repository\com\alibaba\ververica\flink-connector-mysql-cdc\1.2.0\flink-connector-mysql-cdc-1.2.0.jar;D:\develop\repository\org\projectlombok\lombok\1.18.20\lombok-1.18.20.jar;D:\develop\repository\org\slf4j\slf4j-api\1.7.25\slf4j-api-1.7.25.jar;D:\develop\repository\org\slf4j\slf4j-log4j12\1.7.25\slf4j-log4j12-1.7.25.jar;D:\develop\repository\log4j\log4j\1.2.17\log4j-1.2.17.jar;D:\develop\repository\org\apache\logging\log4j\log4j-to-slf4j\2.14.0\log4j-to-slf4j-2.14.0.jar;D:\develop\repository\org\apache\logging\log4j\log4j-api\2.14.0\log4j-api-2.14.0.jar;D:\develop\repository\org\apache\flink\flink-connector-jdbc_2.12\1.12.0\flink-connector-jdbc_2.12-1.12.0.jar;D:\develop\repository\org\apache\phoenix\phoenix-spark\5.0.0-HBase-2.0\phoenix-spark-5.0.0-HBase-2.0.jar;D:\develop\repository\org\apache\phoenix\phoenix-core\5.0.0-HBase-2.0\phoenix-core-5.0.0-HBase-2.0.jar;D:\develop\repository\org\apache\tephra\tephra-api\0.14.0-incubating\tephra-api-0.14.0-incubating.jar;D:\develop\repository\org\apache\tephra\tephra-core\0.14.0-incubating\tephra-core-0.14.0-incubating.jar;D:\develop\repository\com\google\inject\guice\3.0\guice-3.0.jar;D:\develop\repository\javax\inject\javax.inject\1\javax.inject-1.jar;D:\develop\repository\aopalliance\aopalliance\1.0\aopalliance-1.0.jar;D:\develop\repository\com\google\inject\extensions\guice-assistedinject\3.0\guice-assistedinject-3.0.jar;D:\develop\repository\org\apache\thrift\libthrift\0.9.0\libthrift-0.9.0.jar;D:\develop\repository\it\unimi\dsi\fastutil\6.5.6\fastutil-6.5.6.jar;D:\develop\repository\org\apache\twill\twill-common\0.8.0\twill-common-0.8.0.jar;D:\develop\repository\org\apache\twill\twill-core\0.8.0\twill-core-0.8.0.jar;D:\develop\repository\org\apache\twill\twill-api\0.8.0\twill-api-0.8.0.jar;D:\develop\repository\org\ow2\asm\asm-all\5.0.2\asm-all-5.0.2.jar;D:\develop\repository\org\apache\twill\twill-discovery-api\0.8.0\twill-discovery-api-0.8.0.jar;D:\develop\repository\org\apache\twill\twill-discovery-core\0.8.0\twill-discovery-core-0.8.0.jar;D:\develop\repository\org\apache\twill\twill-zookeeper\0.8.0\twill-zookeeper-0.8.0.jar;D:\develop\repository\org\apache\tephra\tephra-hbase-compat-2.0\0.14.0-incubating\tephra-hbase-compat-2.0-0.14.0-incubating.jar;D:\develop\repository\org\antlr\antlr-runtime\3.5.2\antlr-runtime-3.5.2.jar;D:\develop\repository\jline\jline\2.11\jline-2.11.jar;D:\develop\repository\sqlline\sqlline\1.2.0\sqlline-1.2.0.jar;D:\develop\repository\joda-time\joda-time\1.6\joda-time-1.6.jar;D:\develop\repository\com\github\stephenc\findbugs\findbugs-annotations\1.3.9-1\findbugs-annotations-1.3.9-1.jar;D:\develop\repository\com\github\stephenc\jcip\jcip-annotations\1.0-1\jcip-annotations-1.0-1.jar;D:\develop\repository\org\codehaus\jackson\jackson-core-asl\1.9.2\jackson-core-asl-1.9.2.jar;D:\develop\repository\org\codehaus\jackson\jackson-mapper-asl\1.9.2\jackson-mapper-asl-1.9.2.jar;D:\develop\repository\junit\junit\4.12\junit-4.12.jar;D:\develop\repository\org\hamcrest\hamcrest-core\1.3\hamcrest-core-1.3.jar;D:\develop\repository\org\iq80\snappy\snappy\0.3\snappy-0.3.jar;D:\develop\repository\org\apache\htrace\htrace-core\3.1.0-incubating\htrace-core-3.1.0-incubating.jar;D:\develop\repository\org\apache\commons\commons-csv\1.0\commons-csv-1.0.jar;D:\develop\repository\org\apache\hbase\hbase-annotations\2.0.0\hbase-annotations-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-mapreduce\2.0.0\hbase-mapreduce-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-zookeeper\2.0.0\hbase-zookeeper-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-metrics\2.0.0\hbase-metrics-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-metrics-api\2.0.0\hbase-metrics-api-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-replication\2.0.0\hbase-replication-2.0.0.jar;D:\develop\repository\org\apache\hadoop\hadoop-hdfs\2.7.4\hadoop-hdfs-2.7.4.jar;D:\develop\repository\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;D:\develop\repository\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;D:\develop\repository\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;D:\develop\repository\asm\asm\3.1\asm-3.1.jar;D:\develop\repository\commons-daemon\commons-daemon\1.0.13\commons-daemon-1.0.13.jar;D:\develop\repository\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;D:\develop\repository\io\netty\netty-all\4.0.23.Final\netty-all-4.0.23.Final.jar;D:\develop\repository\org\fusesource\leveldbjni\leveldbjni-all\1.8\leveldbjni-all-1.8.jar;D:\develop\repository\org\apache\hbase\hbase-common\2.0.0\hbase-common-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-protocol\2.0.0\hbase-protocol-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-server\2.0.0\hbase-server-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-http\2.0.0\hbase-http-2.0.0.jar;D:\develop\repository\org\eclipse\jetty\jetty-util-ajax\9.3.19.v20170502\jetty-util-ajax-9.3.19.v20170502.jar;D:\develop\repository\org\glassfish\jersey\core\jersey-server\2.25.1\jersey-server-2.25.1.jar;D:\develop\repository\org\glassfish\jersey\core\jersey-common\2.25.1\jersey-common-2.25.1.jar;D:\develop\repository\org\glassfish\jersey\bundles\repackaged\jersey-guava\2.25.1\jersey-guava-2.25.1.jar;D:\develop\repository\org\glassfish\hk2\osgi-resource-locator\1.0.1\osgi-resource-locator-1.0.1.jar;D:\develop\repository\org\glassfish\jersey\core\jersey-client\2.25.1\jersey-client-2.25.1.jar;D:\develop\repository\org\glassfish\jersey\media\jersey-media-jaxb\2.25.1\jersey-media-jaxb-2.25.1.jar;D:\develop\repository\javax\annotation\javax.annotation-api\1.2\javax.annotation-api-1.2.jar;D:\develop\repository\org\glassfish\hk2\hk2-api\2.5.0-b32\hk2-api-2.5.0-b32.jar;D:\develop\repository\org\glassfish\hk2\hk2-utils\2.5.0-b32\hk2-utils-2.5.0-b32.jar;D:\develop\repository\org\glassfish\hk2\external\aopalliance-repackaged\2.5.0-b32\aopalliance-repackaged-2.5.0-b32.jar;D:\develop\repository\org\glassfish\hk2\external\javax.inject\2.5.0-b32\javax.inject-2.5.0-b32.jar;D:\develop\repository\org\glassfish\hk2\hk2-locator\2.5.0-b32\hk2-locator-2.5.0-b32.jar;D:\develop\repository\javax\validation\validation-api\1.1.0.Final\validation-api-1.1.0.Final.jar;D:\develop\repository\org\glassfish\jersey\containers\jersey-container-servlet-core\2.25.1\jersey-container-servlet-core-2.25.1.jar;D:\develop\repository\org\apache\hbase\hbase-procedure\2.0.0\hbase-procedure-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-common\2.0.0\hbase-common-2.0.0-tests.jar;D:\develop\repository\org\glassfish\web\javax.servlet.jsp\2.3.2\javax.servlet.jsp-2.3.2.jar;D:\develop\repository\javax\servlet\jsp\javax.servlet.jsp-api\2.3.1\javax.servlet.jsp-api-2.3.1.jar;D:\develop\repository\org\codehaus\jettison\jettison\1.3.8\jettison-1.3.8.jar;D:\develop\repository\org\jamon\jamon-runtime\2.4.1\jamon-runtime-2.4.1.jar;D:\develop\repository\javax\ws\rs\javax.ws.rs-api\2.0.1\javax.ws.rs-api-2.0.1.jar;D:\develop\repository\org\apache\hadoop\hadoop-distcp\2.7.4\hadoop-distcp-2.7.4.jar;D:\develop\repository\org\eclipse\jetty\jetty-http\9.3.19.v20170502\jetty-http-9.3.19.v20170502.jar;D:\develop\repository\org\eclipse\jetty\jetty-security\9.3.19.v20170502\jetty-security-9.3.19.v20170502.jar;D:\develop\repository\org\eclipse\jetty\jetty-server\9.3.19.v20170502\jetty-server-9.3.19.v20170502.jar;D:\develop\repository\org\eclipse\jetty\jetty-io\9.3.19.v20170502\jetty-io-9.3.19.v20170502.jar;D:\develop\repository\org\apache\hbase\hbase-hadoop-compat\2.0.0\hbase-hadoop-compat-2.0.0.jar;D:\develop\repository\org\apache\hbase\hbase-hadoop2-compat\2.0.0\hbase-hadoop2-compat-2.0.0.jar;D:\develop\repository\org\jruby\joni\joni\2.1.2\joni-2.1.2.jar;D:\develop\repository\com\clearspring\analytics\stream\2.9.5\stream-2.9.5.jar;D:\develop\repository\com\salesforce\i18n\i18n-util\1.0.4\i18n-util-1.0.4.jar;D:\develop\repository\com\ibm\icu\icu4j\60.2\icu4j-60.2.jar;D:\develop\repository\com\ibm\icu\icu4j-localespi\60.2\icu4j-localespi-60.2.jar;D:\develop\repository\com\ibm\icu\icu4j-charset\60.2\icu4j-charset-60.2.jar;D:\develop\repository\com\lmax\disruptor\3.3.6\disruptor-3.3.6.jar;D:\develop\repository\org\apache\hbase\hbase-client\2.0.0\hbase-client-2.0.0.jar;D:\develop\repository\org\apache\hbase\thirdparty\hbase-shaded-protobuf\2.1.0\hbase-shaded-protobuf-2.1.0.jar;D:\develop\repository\org\apache\hbase\hbase-protocol-shaded\2.0.0\hbase-protocol-shaded-2.0.0.jar;D:\develop\repository\org\apache\hbase\thirdparty\hbase-shaded-miscellaneous\2.1.0\hbase-shaded-miscellaneous-2.1.0.jar;D:\develop\repository\org\apache\hbase\thirdparty\hbase-shaded-netty\2.1.0\hbase-shaded-netty-2.1.0.jar;D:\develop\repository\org\apache\zookeeper\zookeeper\3.4.10\zookeeper-3.4.10.jar;D:\develop\repository\org\jruby\jcodings\jcodings\1.0.18\jcodings-1.0.18.jar;D:\develop\repository\io\dropwizard\metrics\metrics-core\3.2.1\metrics-core-3.2.1.jar;D:\develop\repository\org\apache\commons\commons-crypto\1.0.0\commons-crypto-1.0.0.jar;D:\develop\repository\org\apache\yetus\audience-annotations\0.5.0\audience-annotations-0.5.0.jar;D:\develop\IDEA\JetBrains\IntelliJ IDEA 2023.3.4\lib\idea_rt.jar" com.wh.app.BaseDBApp
已连接到地址为 ''127.0.0.1:63129'，传输: '套接字'' 的目标虚拟机
打印数据...
打印数据...
六月 13, 2024 11:35:20 上午 com.github.shyiko.mysql.binlog.BinaryLogClient connect
信息: Connected to 192.168.10.133:3306 at mysql-bin.000018/3608112 (sid:6212, cid:332)
2024-06-13 11:35:29,387 ERROR [io.debezium.connector.mysql.SnapshotReader] - Failed due to error: Aborting snapshot due to error when last running 'SHOW CREATE TABLE `metestore`.`MASTER_KEYS`': Can't call rollback when autocommit=true
org.apache.kafka.connect.errors.ConnectException: Can't call rollback when autocommit=true Error code: 0; SQLSTATE: 08003.
	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:241)
	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:218)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:857)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLNonTransientConnectionException: Can't call rollback when autocommit=true
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
	at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1833)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:766)
	... 3 more
2024-06-13 11:35:29,389 ERROR [io.debezium.connector.mysql.SnapshotReader] - Execption while rollback is executed
java.sql.SQLNonTransientConnectionException: Can't call rollback when autocommit=true
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
	at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1833)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:867)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2024-06-13 11:35:30,485 ERROR [io.debezium.connector.mysql.SnapshotReader] - Failed due to error: Aborting snapshot due to error when last running 'UNLOCK TABLES': Can't call rollback when autocommit=true
org.apache.kafka.connect.errors.ConnectException: Can't call rollback when autocommit=true Error code: 0; SQLSTATE: 08003.
	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:241)
	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:218)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:857)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLNonTransientConnectionException: Can't call rollback when autocommit=true
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
	at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1833)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:766)
	... 3 more
2024-06-13 11:35:31,585 ERROR [io.debezium.connector.mysql.SnapshotReader] - Failed due to error: Aborting snapshot due to error when last running 'UNLOCK TABLES': Can't call rollback when autocommit=true
org.apache.kafka.connect.errors.ConnectException: Can't call rollback when autocommit=true Error code: 0; SQLSTATE: 08003.
	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:241)
	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:218)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:857)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLNonTransientConnectionException: Can't call rollback when autocommit=true
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
	at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1833)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:766)
	... 3 more
2024-06-13 11:35:32,668 ERROR [io.debezium.connector.mysql.SnapshotReader] - Failed due to error: Aborting snapshot due to error when last running 'UNLOCK TABLES': Can't call rollback when autocommit=true
org.apache.kafka.connect.errors.ConnectException: Can't call rollback when autocommit=true Error code: 0; SQLSTATE: 08003.
	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:241)
	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:218)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:857)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLNonTransientConnectionException: Can't call rollback when autocommit=true
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
	at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1833)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:766)
	... 3 more
2024-06-13 11:35:33,723 ERROR [io.debezium.connector.mysql.SnapshotReader] - Failed due to error: Aborting snapshot due to error when last running 'UNLOCK TABLES': Can't call rollback when autocommit=true
org.apache.kafka.connect.errors.ConnectException: Can't call rollback when autocommit=true Error code: 0; SQLSTATE: 08003.
	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:241)
	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:218)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:857)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLNonTransientConnectionException: Can't call rollback when autocommit=true
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
	at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1833)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:766)
	... 3 more
2024-06-13 11:35:34,846 ERROR [io.debezium.connector.mysql.SnapshotReader] - Failed due to error: Aborting snapshot due to error when last running 'UNLOCK TABLES': Can't call rollback when autocommit=true
org.apache.kafka.connect.errors.ConnectException: Can't call rollback when autocommit=true Error code: 0; SQLSTATE: 08003.
	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:241)
	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:218)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:857)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLNonTransientConnectionException: Can't call rollback when autocommit=true
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
	at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1833)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:766)
	... 3 more
已与地址为 ''127.0.0.1:63129'，传输: '套接字'' 的目标虚拟机断开连接

进程已结束，退出代码为 130

2. 上面的报错属于不影响程序的正常运行,但是很影响观感,我查询了一下,(我链接的是mysql库),因为mysql的事务是属于自动提交的,和 Flink CDC 内部的代码流程冲突

3. 解决如下

3.1 把mysql 库的事务提交方式需要修改,改成手动提交,或者当操作表的时候,操作另一种事务类型的表

3.2 在代码中添加事务提交的判断

# 当事务不冲突的时候,就正常运行
conn = DriverManager.getConnection(URL, USER, PASSWORD);
conn.setAutoCommit(false);

3.3 我的因为情况不同,找到了一种在资源文件(resource)中添加文件, hbase-site.xml

文件如下: 主要和Phoenix的空间交互配置(为了开启 hbase 的 namespace 和 phoenix 的 schema 的映射)

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
        <configuration>
             <property>
                 <name>hbase.rootdir</name>
                 <value>hdfs://192.168.10.133:8020/HBase</value>
             </property>
             <property>
                 <name>hbase.cluster.distributed</name>
                 <value>true</value>
             </property>
             <property>
                 <name>hbase.zookeeper.quorum</name>
                 <value>192.168.10.133,192.168.10.134,192.168.10.135</value>
             </property>
             <property>
                 <name>phoenix.schema.isNamespaceMappingEnabled</name>
                 <value>true</value>
             </property>
             <property>
                 <name>phoenix.schema.mapSystemTablesToNamespace</name>
                 <value>true</value>
             </property>
        </configuration>

zxp0001

关注

7
点赞
踩
3

收藏

觉得还不错? 一键收藏
1
评论
Flink CDC:io.debezium.connector.mysql.SnapshotReader] - Can‘t call rollback when autocommit=true

【代码】Flink CDC:io.debezium.connector.mysql.SnapshotReader] - Can‘t call rollback when autocommit=true。
复制链接

扫一扫