logstash读取kafka错误Ierator is in failed state

logstash从kafka读取数据，写入es，运行了一段时间后，频繁出现

Kafka::Consumer caught exception: Java::JavaLang::IllegalStateExceptionKafka::Consumer caught exception: Java::JavaLang::IllegalStateException

错误，而且kafka的offset一直在增加，不消费。

清除所有日志，重启logstash的进程，发现出现以下错误：

Kafka::Consumer caught exception: Java::JavaLang::OutOfMemoryError
Kafka::Consumer caught exception: Java::JavaLang::OutOfMemoryError
Java heap space
Java heap space
Kafka::Consumer caught exception: Java::JavaLang::IllegalStateExceptionKafka::Consumer caught exception: Java::JavaLang::IllegalStateException

Iterator is in failed stateIterator is in failed state

Kafka::Consumer caught exception: Java::JavaLang::IllegalStateExceptionKafka::Consumer caught exception: Java::JavaLang::IllegalStateException

Iterator is in failed state
Iterator is in failed state

所以Iterator is in failed state不是真正的错误，真正的错误是出现了OOM，但这个错误只打印一次，增加logstash的heapsize就解决了问题，设置LS_HEAP_SIZE即可