Error while getting events from Kafka

最新推荐文章于 2021-07-02 15:55:51 发布

醉酒小卫

最新推荐文章于 2021-07-02 15:55:51 发布

阅读量259

点赞数 1

文章标签： flume

本文链接：https://blog.csdn.net/weixin_52539529/article/details/111936786

版权

报错详情

 Error while getting events from Kafka
        at org.apache.flume.channel.kafka.KafkaChannel$KafkaTransaction.doTake(KafkaChannel.java:523)
        at org.apache.flume.channel.BasicTransactionSemantics.take(BasicTransactionSemantics.java:113)
        at org.apache.flume.channel.BasicChannelSemantics.take(BasicChannelSemantics.java:95)
        at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:362)
        at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
        at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
        at java.lang.Thread.run(Thread.java:748)

解决办法

a1.channels.c1.type = org.apache.flume.channel.kafka.KafkaChannel
a1.channels.c1.kafka.bootstrap.servers = node-1:9092,node-2:9092,node-3:9092
a1.channels.c1.kafka.topic = train-0224
a1.channels.c1.kafka.consumer.group.id = flume-consumer
a1.channels.c1.parseAsFlumeEvent=false

最后加一行 a1.channels.c1.parseAsFlumeEvent=false