flume-sink报错 : close() called when transaction is OPEN - you must either commit or rollback first

最新推荐文章于 2023-10-15 14:29:27 发布

怒上王者

最新推荐文章于 2023-10-15 14:29:27 发布

阅读量1k

点赞数

分类专栏： Flume 文章标签： flume

本文链接：https://blog.csdn.net/weixin_36815898/article/details/116750105

版权

Flume 专栏收录该内容

2 篇文章 0 订阅

订阅专栏

启动flume agent时报错

(SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
java.lang.IllegalStateException: close() called when transaction is OPEN - you must either commit or rollback first
	at com.google.common.base.Preconditions.checkState(Preconditions.java:172)
	at org.apache.flume.channel.BasicTransactionSemantics.close(BasicTransactionSemantics.java:179)
	at org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:255)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:748)
2021-05-13 14:41:07,452 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:240)] Failed to publish events
java.lang.IllegalStateException: begin() called when transaction is OPEN!
	at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
	at org.apache.flume.channel.BasicTransactionSemantics.begin(BasicTransactionSemantics.java:131)
	at org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:153)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:748)
2021-05-13 14:41:07,453 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to publish events
	at org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:252)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: begin() called when transaction is OPEN!
	at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
	at org.apache.flume.channel.BasicTransactionSemantics.begin(BasicTransactionSemantics.java:131)
	at org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:153)
	... 3 more

flume-sink报错 : close() called when transaction is OPEN - you must either commit or rollback first
在确认代码无误的情况下，引起该错误的主要原因是flume启动给的内存不足引起的，
flume-ng 启动文件默认的启动内存为20M
可以修改flume-ng文件：
JAVA_OPTS="-Xmx1024m" #设置大一点，默认是20M