storm和kafka集成报java.lang.ClassNotFoundException: kafka.api.OffsetRequest解决方法

最新推荐文章于 2024-08-29 18:42:50 发布

yulio1234

最新推荐文章于 2024-08-29 18:42:50 发布

阅读量1.3w

点赞数 1

分类专栏： storm 文章标签： storm exception

本文链接：https://blog.csdn.net/yulio1234/article/details/77141192

版权

storm 专栏收录该内容

3 篇文章 0 订阅

订阅专栏

添加依赖

    <dependency>
            <groupId>org.apache.storm</groupId>
            <artifactId>storm-kafka</artifactId>
            <version>1.1.0</version>
        </dependency>

然后报错

Exception in thread "main" java.lang.NoClassDefFoundError: kafka/api/OffsetRequest
    at org.apache.storm.kafka.KafkaConfig.<init>(KafkaConfig.java:48)
    at org.apache.storm.kafka.SpoutConfig.<init>(SpoutConfig.java:46)
    at cn.yuli.storm.wordCount.KafkaTopo.main(KafkaTopo.java:20)
Caused by: java.lang.ClassNotFoundException: kafka.api.OffsetRequest
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    ... 3 more

跟着代码检查了一下
在KafkaConfig下执行下面这个方法时找不到kafka.api.OffsetRequest类

 public KafkaConfig(BrokerHosts hosts, String topic) {
        this(hosts, topic, kafka.api.OffsetRequest.DefaultClientId());
    }

然后发觉maven默认依赖的是kafka-clients-0.8.2.1.jar，把kafka客户端换成高版本并去除冲突依赖后解决异常

<dependency>
            <groupId>org.apache.kafka</groupId>
            <artifactId>kafka_2.11</artifactId>
            <version>0.11.0.0</version>
            <exclusions>
                <exclusion>
                    <groupId>org.apache.zookeeper</groupId>
                    <artifactId>zookeeper</artifactId>
                </exclusion>
                <exclusion>
                    <groupId>org.slf4j</groupId>
                    <artifactId>slf4j-log4j12</artifactId>
                </exclusion>
                <exclusion>
                    <groupId>log4j</groupId>
                    <artifactId>log4j</artifactId>
                </exclusion>
            </exclusions>
        </dependency>