flume系列之:java.lang.OutOfMemoryError: unable to create new native thread
一、完整报错
- java.io.IOException: java.lang.OutOfMemoryError: unable to create new native thread
at org.apache.hadoop.hdfs.ExceptionLastSeen.set(ExceptionLastSeen.java:45)
at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:823) - Caused by: java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:719)
at org.apache.hadoop.hdfs.DataStreamer.initDataStreaming(DataStreamer.java:634)
at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:714)
二、报错产生的场景
-
上游产生大量数据,多个flume agent组出现oom
-
在Java中,每个线程都会占用一定的操作系统资源,包括栈内存和线程控制块等。当应