org.apache.kudu.client.NonRecoverableException: Caused by: java.lang.NullPointerException

最新推荐文章于 2024-03-18 10:28:13 发布

原创

最新推荐文章于 2024-03-18 10:28:13 发布 · 1.6k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#大数据

本文分析了Flink作业运行时遇到的Kudu连接问题，报错源自服务器连接谈判超时和Tablet Server服务队列满。通过日志发现，高峰期Tablet的RPC请求队列已满，解决方法包括增大RPC服务队列长度并建议重启受影响的Tablet Server。

Flink运行时完整的报错如下：

org.apache.kudu.client.NonRecoverableException: 
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:132) ~[kudu-client-1.9.0.jar:1.9.0]
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:402) ~[kudu-client-1.9.0.jar:1.9.0]
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:245) ~[kudu-client-1.9.0.jar:1.9.0]
	at com.ctg.bigdata.etl.sink.KuduClientWindowOrderedSink.invoke(KuduClientWindowOrderedSink.java:82) ~[classes/:?]
	at com.ctg.bigdata.etl.sink.KuduClientWindowOrderedSink.invoke(KuduClientWindowOrderedSink.java:19) ~[classes/:?]
	at org.apache.flink.streaming.api.operators.StreamSink.processElement(StreamSink.java:54) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:71) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:46) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:26) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.runtime.tasks.BroadcastingOutputCollector.collect(BroadcastingOutputCollector.java:75) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.runtime.tasks.BroadcastingOutputCollector.collect(BroadcastingOutputCollector.java:32) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:50) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:28) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.api.operators.TimestampedCollector.collect(TimestampedCollector.java:50) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at com.ctg.bigdata.etl.run.FlinkRunner$9.process(FlinkRunner.java:225) ~[classes/:?]
	at com.ctg.bigdata.etl.run.FlinkRunner$9.process(FlinkRunner.java:216) ~[classes/:?]
	at org.apache.flink.streaming.runtime.operators.windowing.functions.InternalSingleValueProcessWindowFunction.process(InternalSingleValueProcessWindowFunction.java:60) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.emitWindowContents(WindowOperator.java:577) ~[flink-streaming-java_2.12-1.12.1.jar:1.12.1]
	at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.onEventTime(WindowOperator.java:486) ~[flink-st

最低0.47元/天解锁文章