Caused by java.lang.Exception Failed to send data to Kafka Expiring

最新推荐文章于 2022-12-16 18:02:52 发布

weixin_30237719

最新推荐文章于 2022-12-16 18:02:52 发布

阅读量2.5k

点赞数

文章标签：大数据 java

原文链接：http://www.cnblogs.com/suanec/p/11116807.html

版权

在使用Flink将数据写入Kafka时遇到异常，错误信息为'Caused by: java.lang.Exception: Failed to send data to Kafka: Expiring 89 record(s)...'. 通过调整request.timeout.ms参数从30s增加到120s，虽然异常未再出现，但写入速度减慢。问题源于博客作者转载的文章。

摘要由CSDN通过智能技术生成

flink 写kafka，报错，作业挂掉

Caused by: java.lang.Exception: Failed to send data to Kafka: Expiring 89 record(s) for system_online_learning_test-1: 30001 ms has passed since last append

Kafka Version : 0.10.2.1,

Kafka Producer error Expiring 10 record(s) for TOPIC:XXXXXX: 6686 ms has passed since batch creation plus linger time org.apache.kafka.common.errors.TimeoutException: Expiring 10 record(s) for TOPIC:XXXXXX: 6686 ms has passed since batch creation plus linger time

Any clue will be appreciated ..

You get this error when the producer can't send data to the broker that it thinks is responsible for the messages according to the metadata that it has. Did the kafka broker die or your producer have connection issues at that time? – Sönke Liebau Oct 15 '17 at 8:13
1
I am also getting this error intermittently