spark 报错 [Stage 45:(482 + 46) / 528][Stage 46:(64 + 148) / 528][Stage 55:>(27 + 0) / 528]18/06/07 16:07:11 WARN YarnSchedulerBackend$YarnSchedulerEndpoint: Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead. 18/06/07 16:07:11 ERROR YarnScheduler: Lost executor 38 on pc-zjqbba250: Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead. 18/06/07 16:07:11 WARN TaskSetManager: Lost task 45.0 in stage 46.0 (TID 17532, pc-zjqbba250, executor 38): ExecutorLostFailure (executor 38 exited caused by one of the running tasks) Reason: Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead. 18/06/07 16:07:11 WARN TaskSetManager: Lost task 50.0 in stage 46.0 (TID 17537, pc-zjqbba250, executor 38): ExecutorLostFailure (executor 38 exited caused by one of the running tasks) Reason: Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead. [Stage 45:(490 + 36) / 528][Stage 46:(64 + 147) / 528][Stage 55:>(27 + 0) / 528]18/06/07 16:07:11 WARN TransportChannelHandler: Exception in connection from /10.78.142.100:40806 java.io.IOException: Connection reset by peer at sun.nio.ch.FileDispatcherImpl.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes(PooledUnsafeDirectByteBuf.java:221) at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:899) at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:275) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:119) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:652) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:575) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:489) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:451) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:140) at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144) at java.lang.Thread.run(Thread.java:745) 解决方法 conf.set("spark.yarn.executor.memoryOverhead","2048") //excutor-momery + memoryOverhead不能大于集群内存
Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consi
最新推荐文章于 2024-07-11 15:23:01 发布