Flink SQL1.11.0提交到集群测试遇到的问题，记录

最新推荐文章于 2024-08-20 08:51:20 发布

黄瓜炖啤酒鸭

最新推荐文章于 2024-08-20 08:51:20 发布

阅读量2.9k

点赞数 3

分类专栏： Flink 文章标签： Fink kafka报错 KafkaTable

本文链接：https://blog.csdn.net/qq_31866793/article/details/107487858

版权

在使用Flink SQL 1.11.0进行开发时，遇到了NoClassDefFoundError，涉及KafkaTableSourceSinkFactoryBase和InvalidTxnStateException等相关类。问题源于类加载器无法找到指定类。通过检查依赖和官方文档，发现只需导入特定的Kafka相关包，避免在集群中引入其他不必要的Kafka依赖。

摘要由CSDN通过智能技术生成

Flink开发中社区也有人提问：

http://apache-flink.147419.n8.nabble.com/flink-sql-Could-not-find-any-factory-for-identifier-kafka-td4751.html#a4778

开始遇到这个问题，Flink lib下的包：

java.lang.NoClassDefFoundError: org/apache/flink/streaming/connectors/kafka/KafkaTableSourceSinkFactoryBase
   at java.lang.ClassLoader.defineClass1(Native Method)
   at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
   at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
   at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
   at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
   at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
   at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
   at java.security.AccessController.doPrivileged(Native Method)
   at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:411)
   at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:61)
   at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
   at java.lang.Class.forName0(Native Method)
   at java.lang.Class.forName(Class.java:348)
   at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:370)
   at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
   at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
   at java.util.Iterator.forEachRemaining(Iterator.java:116)
   at org.apache.flink.table.factories.TableFactoryService.discoverFactories(TableFactoryService.java:214)
   at org.apache.flink.table.factories.TableFactoryService.findAllInternal(TableFactoryService.java:170)
   at org.apache.flink.table.factories.TableFactoryService.findAll(TableFactoryService.java:125)
   at org.apache.flink.table.factories.ComponentFactoryService.find(ComponentFactoryService.java:48)
   at org.apache.flink.table.api.bridge.java.internal.StreamTableEnvironmentImpl.lookupExecutor(StreamTableEnvironmentImpl.java:148)
   at org.apache.flink.table.api.bridge.java.internal.StreamTableEnvironmentImpl.create(StreamTableEnvironmentImpl.java:126)
   at org.apache.flink.table.api.bridge.java.StreamTableEnvironment.create(StreamTableEnvironmen