JVM 系列一：Native memory allocation 导致JVM Crash

JVM Crash抛出如下信息：

#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (malloc) failed to allocate 813056 bytes for Chunk::new
# An error report file with more information is saved as:
# /home/kylin/work/brms/brms-standalone-5.3.1/jboss-as/bin/hs_err_pid26819.log

hs_err_pid26819.log文件内容如下：

#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (malloc) failed to allocate 813056 bytes for Chunk::new
# Possible reasons:
#   The system is out of physical RAM or swap space
#   In 32 bit mode, the process size limit was hit
# Possible solutions:
#   Reduce memory load on the system
#   Increase physical memory or swap space
#   Check if swap backing store is full
#   Use 64 bit Java on a 64 bit OS
#   Decrease Java heap size (-Xmx/-Xms)
#   Decrease number of Java threads
#   Decrease Java thread stack sizes (-Xss)
#   Set larger code cache with -XX:ReservedCodeCacheSize=
# This output file may be truncated or incomplete.
#
#  Out of Memory Error (allocation.cpp:328), pid=26819, tid=1286601584
#
# JRE version: 7.0_21-b11
# Java VM: Java HotSpot(TM) Server VM (23.21-b01 mixed mode linux-x86 )
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#

---------------  T H R E A D  ---------------

Current thread (0x4cff4c00):  JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=26829, stack(0x4ca7f000,0x4cb00000)]

Stack: [0x4ca7f000,0x4cb00000],  sp=0x4cafd9a0,  free space=506k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V  [libjvm.so+0x722359]  VMError::report_and_die()+0x199
V  [libjvm.so+0x2e8ef2]  report_vm_out_of_memory(char const*, int, unsigned int, char const*)+0x72
V  [libjvm.so+0x14ddad]  Chunk::operator new(unsigned int, unsigned int)+0x10d
V  [libjvm.so+0x14dde9]  Arena::grow(unsigned int)+0x29
V  [libjvm.so+0x3d5fe2]  PhaseIFG::init(unsigned int)+0x1c2
V  [libjvm.so+0x23835c]  PhaseChaitin::Register_Allocate()+0x75c
V  [libjvm.so+0x2a2991]  Compile::Code_Gen()+0x3b1
V  [libjvm.so+0x2a5250]  Compile::Compile(ciEnv*, C2Compiler*, ciMethod*, int, bool, bool)+0xbd0
V  [libjvm.so+0x220f16]  C2Compiler::compile_method(ciEnv*, ciMethod*, int)+0x176
V  [libjvm.so+0x2a9f6a]  CompileBroker::invoke_compiler_on_method(CompileTask*)+0x33a
V  [libjvm.so+0x2ab037]  CompileBroker::compiler_thread_loop()+0x417
V  [libjvm.so+0x6ddd98]  compiler_thread_entry(JavaThread*, Thread*)+0x18
V  [libjvm.so+0x6e4944]  JavaThread::thread_main_inner()+0xf4
V  [libjvm.so+0x6e4ad1]  JavaThread::run()+0x161
V  [libjvm.so+0x5e1091]  java_start(Thread*)+0x111
C  [libpthread.so.0+0x6a2e]  abort@@GLIBC_2.0+0x6a2e


Current CompileTask:
C2: 162322 3044             org.jboss.seam.Component::getInstance (244 bytes)


---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x4b685c00 JavaThread "Thread-7 (HornetQ-server-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-32219151)" [_thread_blocked, id=28360, stack(0x09eff000,0x09f50000)]
  0x37ff9c00 JavaThread "Thread-6 (HornetQ-server-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-32219151)" [_thread_blocked, id=28359, stack(0x09f50000,0x09fa1000)]
  0xb9edc400 JavaThread "Thread-3 (HornetQ-client-global-scheduled-threads-17405289)" daemon [_thread_blocked, id=28224, stack(0x0a51a000,0x0a56b000)]
  0x238c6c00 JavaThread "Thread-4 (HornetQ-server-HornetQServerImpl::serverUUID=79b53316-531a-11e3-bb27-0021cc713b09-27773322)" [_thread_blocked, id=28223, stack(0x0a56b000,0x0a5bc000)]
  0x513a8400 JavaThread "Timer-4" daemon [_thread_blocked, id=28165, stack(0x0a5bc000,0x0a60d000)]
  0x464ffc00 JavaThread "Thread-5 (HornetQ-server-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-32219151)" [_thread_blocked, id=28083, stack(0x0a60d000,0x0a65e000)]
  0x331fec00 JavaThread "Thread-4 (HornetQ-server-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-32219151)" [_thread_blocked, id=28082, stack(0x0a65e000,0x0a6af000)]
  0xbe06b800 JavaThread "Thread-2 (HornetQ-client-global-scheduled-threads-17405289)" daemon [_thread_blocked, id=27956, stack(0x0a6af000,0x0a700000)]
  0x4b043800 JavaThread "Thread-3 (HornetQ-server-HornetQServerImpl::serverUUID=79b53316-531a-11e3-bb27-0021cc713b09-27773322)" [_thread_blocked, id=27955, stack(0x3c15e000,0x3c1af000)]
  0x4b5a1400 JavaThread "Thread-3 (HornetQ-server-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-32219151)" [_thread_blocked, id=27831, stack(0x0a845000,0x0a896000)]
  0x2acffc00 JavaThread "Thread-2 (HornetQ-server-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-32219151)" [_thread_blocked, id=27830, stack(0x0a896000,0x0a8e7000)]
  0x08263000 JavaThread "http-127.0.0.1-8080-6" daemon [_thread_in_native, id=27824, stack(0xbfaa2000,0xbfaf3000)]
  0x08262000 JavaThread "http-127.0.0.1-8080-5" daemon [_thread_in_native, id=27823, stack(0xbf95f000,0xbf9b0000)]
  0x0823b800 JavaThread "http-127.0.0.1-8080-4" daemon [_thread_in_native, id=27763, stack(0xbfa51000,0xbfaa2000)]
  0x0823a800 JavaThread "http-127.0.0.1-8080-3" daemon [_thread_in_native, id=27762, stack(0xbfa00000,0xbfa51000)]
  0x08238800 JavaThread "http-127.0.0.1-8080-2" daemon [_thread_in_native, id=27761, stack(0xbef88000,0xbefd9000)]
  0x08239400 JavaThread "http-127.0.0.1-8080-1" daemon [_thread_in_native, id=27749, stack(0xbef37000,0xbef88000)]
  0x5174a800 JavaThread "jackrabbit-pool-8" daemon [_thread_blocked, id=27679, stack(0xbeee6000,0xbef37000)]
  0x4ce26000 JavaThread "jackrabbit-pool-7" daemon [_thread_blocked, id=27673, stack(0xbee95000,0xbeee6000)]
  0x4a46d800 JavaThread "jackrabbit-pool-6" daemon [_thread_blocked, id=27661, stack(0xbee44000,0xbee95000)]
  0x4c8c7000 JavaThread "Thread-4 (HornetQ-scheduled-threads-23695346)" [_thread_blocked, id=27655, stack(0xbedf3000,0xbee44000)]
  0x44bcc800 JavaThread "Thread-3 (HornetQ-scheduled-threads-23695346)" [_thread_blocked, id=27654, stack(0xbeda2000,0xbedf3000)]
  0x4c892800 JavaThread "Thread-2 (HornetQ-scheduled-threads-23695346)" [_thread_blocked, id=27653, stack(0xbed51000,0xbeda2000)]
  0xbec47800 JavaThread "Thread-2 (HornetQ-server-HornetQServerImpl::serverUUID=79b53316-531a-11e3-bb27-0021cc713b09-27773322)" [_thread_blocked, id=27652, stack(0xbed00000,0xbed51000)]
  0xbeafe800 JavaThread "Thread-1 (HornetQ-server-HornetQServerImpl::serverUUID=79b53316-531a-11e3-bb27-0021cc713b09-27773322)" [_thread_blocked, id=27651, stack(0xbeba2000,0xbebf3000)]
  0xbea17800 JavaThread "Thread-0 (HornetQ-server-HornetQServerImpl::serverUUID=79b53316-531a-11e3-bb27-0021cc713b09-27773322)" [_thread_blocked, id=27650, stack(0xbeb51000,0xbeba2000)]
  0x51747000 JavaThread "Thread-1 (HornetQ-scheduled-threads-23695346)" [_thread_blocked, id=27649, stack(0x4c925000,0x4c976000)]
  0x4c8ca400 JavaThread "DestroyJavaVM" [_thread_blocked, id=26820, stack(0xb6a63000,0xb6ab4000)]
  0x49cfbc00 JavaThread "ajp-127.0.0.1-8009-Acceptor-0" daemon [_thread_in_native, id=27648, stack(0xbeb00000,0xbeb51000)]
  0x4ae59400 JavaThread "http-127.0.0.1-8080-Acceptor-0" daemon [_thread_in_native, id=27647, stack(0xbe9a2000,0xbe9f3000)]
  0x288a2400 JavaThread "JBossLifeThread" [_thread_blocked, id=27646, stack(0xbe951000,0xbe9a2000)]
  0xbe66c400 JavaThread "Thread-1 (HornetQ-client-global-scheduled-threads-17405289)" daemon [_thread_blocked, id=27645, stack(0xbe900000,0xbe951000)]
  0x082a5400 JavaThread "Old I/O server worker (parentId: 29280236, [id: 0x01bec7ec, localhost/127.0.0.1:5153])" [_thread_in_native, id=27644, stack(0xbe7a2000,0xbe7f3000)]
  0xbe66e800 JavaThread "Thread-0 (HornetQ-client-global-scheduled-threads-17405289)" daemon [_thread_blocked, id=27643, stack(0xbe751000,0xbe7a2000)]
  0x08270800 JavaThread "jackrabbit-pool-5" daemon [_thread_blocked, id=27642, stack(0xbe700000,0xbe751000)]
  0xbe5f3800 JavaThread "Old I/O client worker ([id: 0x00519259, /127.0.0.1:33357 => localhost/127.0.0.1:5153])" daemon [_thread_in_native, id=27641, stack(0xbe4a2000,0xbe4f3000)]
  0x515c9800 JavaThread "hornetq-failure-check-thread" [_thread_blocked, id=27640, stack(0xbe451000,0xbe4a2000)]
  0xbe08fc00 JavaThread "Old I/O server boss ([id: 0x01bec7ec, localhost/127.0.0.1:5153])" [_thread_in_native, id=27639, stack(0xbe400000,0xbe451000)]
  0xbe1ca400 JavaThread "Thread-0 (HornetQ-scheduled-threads-23695346)" [_thread_blocked, id=27638, stack(0xbd6a2000,0xbd6f3000)]
  0xbe274400 JavaThread "hornetq-expiry-reaper-thread" [_thread_blocked, id=27637, stack(0xbc66a000,0xbc6bb000)]
  0x4ce26c00 JavaThread "jackrabbit-pool-4" daemon [_thread_blocked, id=27626, stack(0xbc619000,0xbc66a000)]
  0x2d1df400 JavaThread "Thread-20" [_thread_blocked, id=27625, stack(0xbc5c8000,0xbc619000)]
  0x0825b400 JavaThread "jackrabbit-pool-3" daemon [_thread_blocked, id=27609, stack(0xbc3a2000,0xbc3f3000)]
  0xbb515400 JavaThread "pool-18-thread-1" [_thread_blocked, id=27578, stack(0xbc351000,0xbc3a2000)]
  0x01b7e800 JavaThread "jackrabbit-pool-2" daemon [_thread_blocked, id=27577, stack(0xbc300000,0xbc351000)]
  0xbbaac000 JavaThread "jackrabbit-pool-1" daemon [_thread_blocked, id=27564, stack(0xbbfa2000,0xbbff3000)]
  0xb9efd800 JavaThread "ObservationManager" daemon [_thread_blocked, id=27563, stack(0xbbf51000,0xbbfa2000)]
  0xbc9ba800 JavaThread "Thread-4 (HornetQ-client-global-scheduled-threads-27570520)" daemon [_thread_blocked, id=27534, stack(0xbbf00000,0xbbf51000)]
  0xbc2c6800 JavaThread "derby.rawStoreDaemon" daemon [_thread_blocked, id=27512, stack(0xb7710000,0xb7761000)]
  0xbaa50800 JavaThread "Timer-3" [_thread_blocked, id=27511, stack(0x48e5e000,0x48eaf000)]
  0xbaa5c800 JavaThread "DynamicPooledExecutor" daemon [_thread_blocked, id=27504, stack(0x48eaf000,0x48f00000)]
  0xbc4c5800 JavaThread "ObservationManager" daemon [_thread_blocked, id=27498, stack(0x49a3e000,0x49a8f000)]
  0xbb7e0000 JavaThread "derby.rawStoreDaemon" daemon [_thread_blocked, id=27447, stack(0xbb4a2000,0xbb4f3000)]
  0xbd5f8400 JavaThread "derby.rawStoreDaemon" daemon [_thread_blocked, id=27381, stack(0xbd651000,0xbd6a2000)]
  0xbd2ea400 JavaThread "Timer-2" daemon [_thread_blocked, id=27380, stack(0xbd600000,0xbd651000)]
  0xbd2f8c00 JavaThread "Timer-1" daemon [_thread_blocked, id=27379, stack(0xbc577000,0xbc5c8000)]
  0x01ee5000 JavaThread "derby.antiGC" daemon [_thread_blocked, id=27372, stack(0xbc526000,0xbc577000)]
  0xbbd30c00 JavaThread "jboss EL reference queue cleanup thread" daemon [_thread_blocked, id=27360, stack(0xbb451000,0xbb4a2000)]
  0x51717c00 JavaThread "Thread-1 (HornetQ-server-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-32219151)" [_thread_blocked, id=27354, stack(0xbb400000,0xbb451000)]
  0x51512000 JavaThread "Thread-3 (HornetQ-client-global-scheduled-threads-27570520)" daemon [_thread_blocked, id=27353, stack(0xb776f000,0xb77c0000)]
  0x4c8a2c00 JavaThread "Thread-2 (HornetQ-client-global-scheduled-threads-27570520)" daemon [_thread_blocked, id=27352, stack(0x0000d000,0x0005e000)]
  0xb79bf800 JavaThread "ExecutorPoolWorker" daemon [_thread_blocked, id=27329, stack(0x0005e000,0x000af000)]
  0xb79c5400 JavaThread "Thread-14" [_thread_blocked, id=27328, stack(0x000af000,0x00100000)]
  0xb78f2800 JavaThread "Dispatch Worker Thread" daemon [_thread_blocked, id=27327, stack(0x06c0d000,0x06c5e000)]
  0xb78f0400 JavaThread "Dispatch Worker Thread" daemon [_thread_blocked, id=27326, stack(0x06c5e000,0x06caf000)]
  0xb78f0000 JavaThread "Dispatch Worker Thread" daemon [_thread_blocked, id=27325, stack(0x09e5d000,0x09eae000)]
  0xb78f1800 JavaThread "Dispatch Worker Thread" daemon [_thread_blocked, id=27324, stack(0x083af000,0x08400000)]
  0xb7850c00 JavaThread "Dispatch Worker Thread" daemon [_thread_blocked, id=27323, stack(0x06caf000,0x06d00000)]
  0x008c1800 JavaThread "Thread-13" daemon [_thread_blocked, id=27321, stack(0x09e0c000,0x09e5d000)]
  0x00cfe400 JavaThread "com.google.inject.internal.Finalizer" daemon [_thread_blocked, id=27320, stack(0x0835e000,0x083af000)]
  0x06f55800 JavaThread "JCA PoolFiller" [_thread_blocked, id=27273, stack(0x09eae000,0x09eff000)]
  0x07475800 JavaThread "HSQLDB Timer @1ce1f3a" daemon [_thread_blocked, id=27272, stack(0x2370d000,0x2375e000)]
  0x077be000 JavaThread "DefaultQuartzScheduler_QuartzSchedulerThread" [_thread_blocked, id=27266, stack(0x2375e000,0x237af000)]
  0x077ac000 JavaThread "DefaultQuartzScheduler_Worker-9" [_thread_blocked, id=27265, stack(0x237af000,0x23800000)]
  0x077aa800 JavaThread "DefaultQuartzScheduler_Worker-8" [_thread_blocked, id=27264, stack(0x3b00d000,0x3b05e000)]
  0x077a8c00 JavaThread "DefaultQuartzScheduler_Worker-7" [_thread_blocked, id=27263, stack(0x3b05e000,0x3b0af000)]
  0x077a7400 JavaThread "DefaultQuartzScheduler_Worker-6" [_thread_blocked, id=27262, stack(0x3b0af000,0x3b100000)]
  0x077a5c00 JavaThread "DefaultQuartzScheduler_Worker-5" [_thread_blocked, id=27261, stack(0x3b30d000,0x3b35e000)]
  0x077a4400 JavaThread "DefaultQuartzScheduler_Worker-4" [_thread_blocked, id=27260, stack(0x3b35e000,0x3b3af000)]
  0x077a2800 JavaThread "DefaultQuartzScheduler_Worker-3" [_thread_blocked, id=27259, stack(0x3b3af000,0x3b400000)]
  0x07761400 JavaThread "DefaultQuartzScheduler_Worker-2" [_thread_blocked, id=27258, stack(0x3bb0d000,0x3bb5e000)]
  0x07760400 JavaThread "DefaultQuartzScheduler_Worker-1" [_thread_blocked, id=27257, stack(0x3bb5e000,0x3bbaf000)]
  0x07782800 JavaThread "DefaultQuartzScheduler_Worker-0" [_thread_blocked, id=27256, stack(0x3bbaf000,0x3bc00000)]
  0x07bb5000 JavaThread "WorkManager(2)-1" daemon [_thread_blocked, id=27255, stack(0x3c10d000,0x3c15e000)]
  0x51715400 JavaThread "Thread-0 (HornetQ-server-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-32219151)" [_thread_blocked, id=27253, stack(0x3c1af000,0x3c200000)]
  0x5170b800 JavaThread "Thread-0 (HornetQ-client-global-threads-19289399)" daemon [_thread_blocked, id=27252, stack(0x3c60d000,0x3c65e000)]
  0x51505c00 JavaThread "Thread-1 (HornetQ-client-global-scheduled-threads-27570520)" daemon [_thread_blocked, id=27251, stack(0x3c65e000,0x3c6af000)]
  0x0799a400 JavaThread "Thread-2 (HornetQ-remoting-threads-HornetQServerImpl::serverUUID=5f48abe1-531a-11e3-b45b-0021cc713b09-1585340-2590384)" [_thread_blocked, id=27250, stack(0x3c6af000,0x3c700000)]
  0x07999c00 JavaThread "Thread-0 (HornetQ-client-global-scheduled-threads-27570520)" daemon [_thread_blocked, id=27249, stack(0x3e00d000,0x3e05e000)]
  0x07efe400 JavaThread "AOPListner" daemon [_thread_blocked, id=27248, stack(0x3e05e000,0x3e0af000)]
  0x08cfe800 JavaThread "ContainerBackgroundProcessor[StandardEngine[jboss.web]]" daemon [_thread_blocked, id=27242, stack(0x3e0af000,0x3e100000)]
  0x09219c00 JavaThread "PooledInvokerAcceptor#0-4445" [_thread_in_native, id=27241, stack(0x3ee0d000,0x3ee5e000)]
  0x09219800 JavaThread "RMI TCP Accept-4444" daemon [_thread_in_native, id=27240, stack(0x3ee5e000,0x3eeaf000)]
  0x094e8400 JavaThread "Thread-10" [_thread_blocked, id=27239, stack(0x3eeaf000,0x3ef00000)]
  0x094e4400 JavaThread "Listener:4712" daemon [_thread_in_native, id=27238, stack(0x4000d000,0x4005e000)]
  0x097cdc00 JavaThread "Thread-9" daemon [_thread_blocked, id=27236, stack(0x4005e000,0x400af000)]
  0x09771800 JavaThread "Thread-8" daemon [_thread_blocked, id=27234, stack(0x400af000,0x40100000)]
  0x09771000 JavaThread "Thread-7" daemon [_thread_blocked, id=27233, stack(0x4210d000,0x4215e000)]
  0x096d9400 JavaThread "Listener:4713" daemon [_thread_in_native, id=27228, stack(0x4215e000,0x421af000)]
  0x0deb1400 JavaThread "hornetq-failure-check-thread" [_thread_blocked, id=27227, stack(0x421af000,0x42200000)]
  0x18ee5c00 JavaThread "Old I/O server boss ([id: 0x0034ac72, /127.0.0.1:5445])" [_thread_in_native, id=27226, stack(0x4240d000,0x4245e000)]
  0x13bfdc00 JavaThread "Thread-4 (HornetQ-scheduled-threads-10705007)" [_thread_blocked, id=27225, stack(0x4245e000,0x424af000)]
  0x104d7c00 JavaThread "Old I/O server boss ([id: 0x01395665, /127.0.0.1:5455])" [_thread_in_native, id=27224, stack(0x424af000,0x42500000)]
  0x21a4d000 JavaThread "pool-6-thread-1" [_thread_blocked, id=27222, stack(0x4341d000,0x4346e000)]
  0x0c856400 JavaThread "pool-5-thread-1" [_thread_blocked, id=27221, stack(0x4b489000,0x4b4da000)]
  0x08201400 JavaThread "Thread-3 (HornetQ-scheduled-threads-10705007)" [_thread_blocked, id=27216, stack(0x4a1af000,0x4a200000)]
  0x4c8bb800 JavaThread "Thread-2 (HornetQ-scheduled-threads-10705007)" [_thread_blocked, id=27205, stack(0x4346e000,0x434bf000)]
  0x181bac00 JavaThread "Thread-0 (HornetQ-Asynchronous-Persistent-Writes10642067-29788155)" daemon [_thread_blocked, id=27204, stack(0x4510d000,0x4515e000)]
  0x4c8ba800 JavaThread "Thread-1 (HornetQ-scheduled-threads-10705007)" [_thread_blocked, id=27197, stack(0x4b738000,0x4b789000)]
  0x0a9b1400 JavaThread "Thread-0 (HornetQ-scheduled-threads-10705007)" [_thread_blocked, id=27186, stack(0x4515e000,0x451af000)]
  0x0a99a800 JavaThread "hornetq-expiry-reaper-thread" [_thread_blocked, id=27185, stack(0x451af000,0x45200000)]
  0x0a98ec00 JavaThread "hornetq-buffer-timeout" [_thread_blocked, id=27184, stack(0x4530d000,0x4535e000)]
  0x2f248800 JavaThread "AcceptorThread[ServerSocket[addr=/127.0.0.1,port=0,localport=4446]]" [_thread_in_native, id=27178, stack(0x4535e000,0x453af000)]
  0x1bc8bc00 JavaThread "ServerSocketRefresh" daemon [_thread_blocked, id=27177, stack(0x453af000,0x45400000)]
  0x0b583400 JavaThread "HDScanner" [_thread_blocked, id=27176, stack(0x4632c000,0x4637d000)]
  0x0b54bc00 JavaThread "AcceptorThread[ServerSocket[addr=/127.0.0.1,port=0,localport=3873]]" [_thread_in_native, id=27175, stack(0x4637d000,0x463ce000)]
  0x0b536000 JavaThread "ServerSocketRefresh" daemon [_thread_blocked, id=27174, stack(0x48e0d000,0x48e5e000)]
  0x4918a000 JavaThread "JBoss System Threads(1)-2" daemon [_thread_in_native, id=26889, stack(0x49aaf000,0x49b00000)]
  0x4916b400 JavaThread "GC Daemon" daemon [_thread_blocked, id=26888, stack(0x49f0d000,0x49f5e000)]
  0x49169c00 JavaThread "RMI Reaper" [_thread_blocked, id=26887, stack(0x49f5e000,0x49faf000)]
  0x49164000 JavaThread "RMI TCP Accept-1098" daemon [_thread_in_native, id=26886, stack(0x49faf000,0x4a000000)]
  0x49459c00 JavaThread "JBoss System Threads(1)-1" daemon [_thread_in_native, id=26885, stack(0x4a104000,0x4a155000)]
  0x493fb800 JavaThread "Timer-Log4jService" daemon [_thread_blocked, id=26884, stack(0x4a155000,0x4a1a6000)]
  0x4abe9000 JavaThread "AuthenticationCacheFlushThread" [_thread_blocked, id=26867, stack(0x4b798000,0x4b7e9000)]
  0x4bf86c00 JavaThread "ZipFile Lock Reaper" daemon [_thread_blocked, id=26856, stack(0x4c05e000,0x4c0af000)]
  0x4bf22c00 JavaThread "Timer-0" daemon [_thread_blocked, id=26850, stack(0x4c0af000,0x4c100000)]
  0x4cff8800 JavaThread "Service Thread" daemon [_thread_blocked, id=26831, stack(0x5142e000,0x5147f000)]
  0x4cff6c00 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=26830, stack(0x4c9fe000,0x4ca7f000)]
=>0x4cff4c00 JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=26829, stack(0x4ca7f000,0x4cb00000)]
  0x4cff3000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=26828, stack(0x5162e000,0x5167f000)]
  0x4cfb8400 JavaThread "Finalizer" daemon [_thread_blocked, id=26827, stack(0x5182e000,0x5187f000)]
  0x4cfb6800 JavaThread "Reference Handler" daemon [_thread_blocked, id=26826, stack(0x51a03000,0x51a54000)]

Other Threads:
  0x4cfb1000 VMThread [stack: 0x4d07b000,0x4d0fc000] [id=26825]
  0x4cffa800 WatcherThread [stack: 0x4c97d000,0x4c9fe000] [id=26832]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
 PSYoungGen      total 380224K, used 61016K [0x985a0000, 0xb37f0000, 0xb3840000)
  eden space 313088K, 12% used [0x985a0000,0x9aa5b008,0xab760000)
  from space 67136K, 34% used [0xaf660000,0xb0d3b110,0xb37f0000)
  to   space 64512K, 0% used [0xab760000,0xab760000,0xaf660000)
 ParOldGen       total 890240K, used 547157K [0x62040000, 0x985a0000, 0x985a0000)
  object space 890240K, 61% used [0x62040000,0x83695578,0x985a0000)
 PSPermGen       total 150400K, used 74734K [0x52040000, 0x5b320000, 0x62040000)
  object space 150400K, 49% used [0x52040000,0x5693ba10,0x5b320000)

Card table byte_map: [0x51d33000,0x52040000] byte_map_base: 0x51aa2e00

Polling page: 0xb7701000

Code Cache  [0xb3900000, 0xb4058000, 0xb6900000)
 total_blobs=2916 nmethods=2646 adapters=221 free_code_cache=41716Kb largest_free_block=42634752

Compilation events (10 events):
Event: 161.923 Thread 0x4cff6c00 3046             org.apache.jackrabbit.core.session.SessionContext::getSessionState (5 bytes)
Event: 161.923 Thread 0x4cff6c00 nmethod 3046 0xb3f93d48 code [0xb3f93e20, 0xb3f93e70]
Event: 161.948 Thread 0x4cff6c00 3047             org.apache.jackrabbit.spi.commons.name.PathBuilder::addLast (39 bytes)
Event: 161.953 Thread 0x4cff6c00 nmethod 3047 0xb3f96148 code [0xb3f96280, 0xb3f9653c]
Event: 162.092 Thread 0x4cff6c00 3048             org.jboss.seam.Component::hasUnwrapMethod (13 bytes)
Event: 162.093 Thread 0x4cff6c00 nmethod 3048 0xb3f93b08 code [0xb3f93be0, 0xb3f93c30]
Event: 162.093 Thread 0x4cff6c00 3049             org.jboss.seam.Component::unwrap (23 bytes)
Event: 162.095 Thread 0x4cff6c00 nmethod 3049 0xb3f95e08 code [0xb3f95f00, 0xb3f95fdc]
Event: 162.095 Thread 0x4cff6c00 3050             org.jboss.seam.Component::isInstance (96 bytes)
Event: 162.099 Thread 0x4cff6c00 nmethod 3050 0xb3f95308 code [0xb3f95440, 0xb3f95670]

GC Heap History (10 events):
Event: 80.570 GC heap before
{Heap before GC invocations=40 (full 0):
 PSYoungGen      total 357952K, used 357933K [0x985a0000, 0xb3840000, 0xb3840000)
  eden space 313152K, 100% used [0x985a0000,0xab770000,0xab770000)
  from space 44800K, 99% used [0xab770000,0xae32b538,0xae330000)
  to   space 67776K, 0% used [0xaf610000,0xaf610000,0xb3840000)
 ParOldGen       total 889536K, used 830280K [0x62040000, 0x984f0000, 0x985a0000)
  object space 889536K, 93% used [0x62040000,0x94b12300,0x984f0000)
 PSPermGen       total 64128K, used 64104K [0x52040000, 0x55ee0000, 0x62040000)
  object space 64128K, 99% used [0x52040000,0x55eda0e0,0x55ee0000)
Event: 80.643 GC heap after
Heap after GC invocations=40 (full 0):
 PSYoungGen      total 378112K, used 38862K [0x985a0000, 0xb3840000, 0xb3840000)
  eden space 310336K, 0% used [0x985a0000,0x985a0000,0xab4b0000)
  from space 67776K, 57% used [0xaf610000,0xb1c03920,0xb3840000)
  to   space 66944K, 0% used [0xab4b0000,0xab4b0000,0xaf610000)
 ParOldGen       total 889536K, used 859629K [0x62040000, 0x984f0000, 0x985a0000)
  object space 889536K, 96% used [0x62040000,0x967bb730,0x984f0000)
 PSPermGen       total 64128K, used 64104K [0x52040000, 0x55ee0000, 0x62040000)
  object space 64128K, 99% used [0x52040000,0x55eda0e0,0x55ee0000)
}
Event: 80.643 GC heap before
{Heap before GC invocations=41 (full 1):
 PSYoungGen      total 378112K, used 38862K [0x985a0000, 0xb3840000, 0xb3840000)
  eden space 310336K, 0% used [0x985a0000,0x985a0000,0xab4b0000)
  from space 67776K, 57% used [0xaf610000,0xb1c03920,0xb3840000)
  to   space 66944K, 0% used [0xab4b0000,0xab4b0000,0xaf610000)
 ParOldGen       total 889536K, used 859629K [0x62040000, 0x984f0000, 0x985a0000)
  object space 889536K, 96% used [0x62040000,0x967bb730,0x984f0000)
 PSPermGen       total 64128K, used 64104K [0x52040000, 0x55ee0000, 0x62040000)
  object space 64128K, 99% used [0x52040000,0x55eda0e0,0x55ee0000)
Event: 82.640 GC heap after
Heap after GC invocations=41 (full 1):
 PSYoungGen      total 378112K, used 0K [0x985a0000, 0xb3840000, 0xb3840000)
  eden space 310336K, 0% used [0x985a0000,0x985a0000,0xab4b0000)
  from space 67776K, 0% used [0xaf610000,0xaf610000,0xb3840000)
  to   space 66944K, 0% used [0xab4b0000,0xab4b0000,0xaf610000)
 ParOldGen       total 890240K, used 845969K [0x62040000, 0x985a0000, 0x985a0000)
  object space 890240K, 95% used [0x62040000,0x95a64610,0x985a0000)
 PSPermGen       total 128384K, used 64022K [0x52040000, 0x59da0000, 0x62040000)
  object space 128384K, 49% used [0x52040000,0x55ec5ac8,0x59da0000)
}
Event: 98.371 GC heap before
{Heap before GC invocations=42 (full 2):
 PSYoungGen      total 378112K, used 310336K [0x985a0000, 0xb3840000, 0xb3840000)
  eden space 310336K, 100% used [0x985a0000,0xab4b0000,0xab4b0000)
  from space 67776K, 0% used [0xaf610000,0xaf610000,0xb3840000)
  to   space 66944K, 0% used [0xab4b0000,0xab4b0000,0xaf610000)
 ParOldGen       total 890240K, used 845969K [0x62040000, 0x985a0000, 0x985a0000)
  object space 890240K, 95% used [0x62040000,0x95a64610,0x985a0000)
 PSPermGen       total 128384K, used 71845K [0x52040000, 0x59da0000, 0x62040000)
  object space 128384K, 55% used [0x52040000,0x566694f8,0x59da0000)
Event: 99.451 GC heap after
Heap after GC invocations=42 (full 2):
 PSYoungGen      total 378112K, used 0K [0x985a0000, 0xb3840000, 0xb3840000)
  eden space 310336K, 0% used [0x985a0000,0x985a0000,0xab4b0000)
  from space 67776K, 0% used [0xaf610000,0xaf610000,0xb3840000)
  to   space 66944K, 0% used [0xab4b0000,0xab4b0000,0xaf610000)
 ParOldGen       total 890240K, used 547025K [0x62040000, 0x985a0000, 0x985a0000)
  object space 890240K, 61% used [0x62040000,0x83674570,0x985a0000)
 PSPermGen       total 150400K, used 71843K [0x52040000, 0x5b320000, 0x62040000)
  object space 150400K, 47% used [0x52040000,0x56668fa8,0x5b320000)
}
Event: 134.997 GC heap before
{Heap before GC invocations=43 (full 2):
 PSYoungGen      total 378112K, used 310336K [0x985a0000, 0xb3840000, 0xb3840000)
  eden space 310336K, 100% used [0x985a0000,0xab4b0000,0xab4b0000)
  from space 67776K, 0% used [0xaf610000,0xaf610000,0xb3840000)
  to   space 66944K, 0% used [0xab4b0000,0xab4b0000,0xaf610000)
 ParOldGen       total 890240K, used 547025K [0x62040000, 0x985a0000, 0x985a0000)
  object space 890240K, 61% used [0x62040000,0x83674570,0x985a0000)
 PSPermGen       total 150400K, used 73006K [0x52040000, 0x5b320000, 0x62040000)
  object space 150400K, 48% used [0x52040000,0x5678b8d0,0x5b320000)
Event: 135.022 GC heap after
Heap after GC invocations=43 (full 2):
 PSYoungGen      total 377280K, used 10079K [0x985a0000, 0xb37f0000, 0xb3840000)
  eden space 310336K, 0% used [0x985a0000,0x985a0000,0xab4b0000)
  from space 66944K, 15% used [0xab4b0000,0xabe87d30,0xaf610000)
  to   space 67136K, 0% used [0xaf660000,0xaf660000,0xb37f0000)
 ParOldGen       total 890240K, used 547025K [0x62040000, 0x985a0000, 0x985a0000)
  object space 890240K, 61% used [0x62040000,0x83674570,0x985a0000)
 PSPermGen       total 150400K, used 73006K [0x52040000, 0x5b320000, 0x62040000)
  object space 150400K, 48% used [0x52040000,0x5678b8d0,0x5b320000)
}
Event: 160.388 GC heap before
{Heap before GC invocations=44 (full 2):
 PSYoungGen      total 377280K, used 320415K [0x985a0000, 0xb37f0000, 0xb3840000)
  eden space 310336K, 100% used [0x985a0000,0xab4b0000,0xab4b0000)
  from space 66944K, 15% used [0xab4b0000,0xabe87d30,0xaf610000)
  to   space 67136K, 0% used [0xaf660000,0xaf660000,0xb37f0000)
 ParOldGen       total 890240K, used 547025K [0x62040000, 0x985a0000, 0x985a0000)
  object space 890240K, 61% used [0x62040000,0x83674570,0x985a0000)
 PSPermGen       total 150400K, used 74715K [0x52040000, 0x5b320000, 0x62040000)
  object space 150400K, 49% used [0x52040000,0x56936f70,0x5b320000)
Event: 160.417 GC heap after
Heap after GC invocations=44 (full 2):
 PSYoungGen      total 380224K, used 23404K [0x985a0000, 0xb37f0000, 0xb3840000)
  eden space 313088K, 0% used [0x985a0000,0x985a0000,0xab760000)
  from space 67136K, 34% used