Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consi

spark 报错
    [Stage 45:(482 + 46) / 528][Stage 46:(64 + 148) / 528][Stage 55:>(27 + 0) / 528]18/06/07 16:07:11 WARN YarnSchedulerBackend$YarnSchedulerEndpoint: Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead.
18/06/07 16:07:11 ERROR YarnScheduler: Lost executor 38 on pc-zjqbba250: Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead.
18/06/07 16:07:11 WARN TaskSetManager: Lost task 45.0 in stage 46.0 (TID 17532, pc-zjqbba250, executor 38): ExecutorLostFailure (executor 38 exited caused by one of the running tasks) Reason: Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead.
18/06/07 16:07:11 WARN TaskSetManager: Lost task 50.0 in stage 46.0 (TID 17537, pc-zjqbba250, executor 38): ExecutorLostFailure (executor 38 exited caused by one of the running tasks) Reason: Container killed by YARN for exceeding memory limits. 15.6 GB of 15.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead.
[Stage 45:(490 + 36) / 528][Stage 46:(64 + 147) / 528][Stage 55:>(27 + 0) / 528]18/06/07 16:07:11 WARN TransportChannelHandler: Exception in connection from /10.78.142.100:40806
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
        at sun.nio.ch.IOUtil.read(IOUtil.java:192)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
        at io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes(PooledUnsafeDirectByteBuf.java:221)
        at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:899)
        at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:275)
        at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:119)
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:652)
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:575)
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:489)
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:451)
        at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:140)
        at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144)
        at java.lang.Thread.run(Thread.java:745)
  解决方法
    conf.set("spark.yarn.executor.memoryOverhead","2048")  //excutor-momery + memoryOverhead不能大于集群内存