flume报错 java.lang.OutOfMemoryError: Java heap space已解决

最新推荐文章于 2024-01-03 04:00:00 发布

zyj_369

最新推荐文章于 2024-01-03 04:00:00 发布

阅读量1.9k

点赞数 2

分类专栏： flume 文章标签： flume

本文链接：https://blog.csdn.net/weixin_46122692/article/details/110200293

版权

在使用Flume从Kafka收集数据到HDFS时遇到了Java heap space内存溢出错误。通过编辑flume-env.sh文件，增加-Xms和-Xmx参数来调整JVM堆内存大小，从而解决了这个问题。

摘要由CSDN通过智能技术生成

1、详细报错信息

在用flume收集kafka中数据到hdfs中内存溢出了

2020-11-26 17:41:25,679 (kafka-coordinator-heartbeat-thread | flume) [ERROR - org.apache.kafka.clients.consumer.internals.AbstractCoordinator$HeartbeatThread.run(AbstractCoordinator.java:1083)] [Consumer clientId=consumer-2, groupId=flume] Heartbeat thread failed due to unexpected error
java.lang.OutOfMemoryError: Java heap space
	at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
	at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
	at org.apache.kafka.common.memory.MemoryPool$1.tryAllocate(MemoryPool.java:30)
	at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:112)
	at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:335)
	at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:296)
	at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:562)
	at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:498)