In this Document
Symptoms |
Cause |
Solution |
References |
This document is being delivered to you via Oracle Support's Rapid Visibility (RaV) process and therefore has not been subject to an independent technical review. |
APPLIES TO:
Oracle Server - Enterprise Edition - Version 11.1.0.7 and laterInformation in this document applies to any platform.
SYMPTOMS
11.1.0.7 to 11.2.0.3 ASM dia0 background process high memory consumption, over time it can exhaust physical memory and swap space resulting in node eviction or other stability issue.
- With OS "top" or other memory monitoring tool, we can see huge virtual memory is allocated and increasing over time:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7242 grid 18 0 28g 153m 19m S 83.2 0.7 6:21.22 oracle
ps -ef| grep 7242
grid 7242 1 0 Nov1 ? 00:00:06 asm_ dia0_+ASM1
- The following SQL query confirms it's due to PGA growth:
column name format a25
column pname format a12
column "MegaBytes" format a10
set numwidth 6
select ss.sid, p.pid, p.pname, sn.name, round(ss.value/(1024 *1024))||'Mb' "MegaBytes"
from v$sesstat ss, v$statname sn, v$session s, v$process p
where s.paddr = p.addr
and sn.statistic# = ss.statistic#
and s.sid = ss.sid
and sn.name in ('session pga memory' , 'session pga memory max')
and p.pname='DIA0'
order by ss.value
/
60 8 DIA0 session pga memory 58Mb
60 8 DIA0 session pga memory max 58Mb
After one day:
60 8 DIA0 session pga memory max 898Mb
60 8 DIA0 session pga memory 898Mb ====>> growth is about 840MB per day in this example
CAUSE
The issue is due to unpublished bug 13377816
SOLUTION
At the time of this writing, fix for bug 13377816 will be included in 11.2.0.4. The solution is to apply interim patch 13377816, and the short term workaround is to kill dia0 process periodically during non-peak hour.
Database - RAC/Scalability Community
To discuss this topic further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle SupportDatabase - RAC/Scalability Community
REFERENCES
BUG:10204780 - 2 NODE RAC CLUSTER CRASHED DUE TO COMPLETE CONSUMPTION OF RAM AND PAGE MEMORYBUG:10315560 - PGA OF DIA0 PROCESS LEAKS ON ASM INSTANCE.
BUG:10386561 - DIA0 CONSTANTLY GENERATING "KJZNHA: GOT EXCEPTION FROM KJZHINIT ERROR 32741"
BUG:11653156 - DIA0 PROCESS TAKING HIGH PGA PAGING
BUG:12751161 - RCA : SWAP UTILIZATION INCREASE
BUG:13036204 - PRODUCTION INSTANCE HANGS AS ALL PAGING SPACE HAS CONSUMED BY +ASM1_DIA0
BUG:13042629 - DIA0 PROCESS USING HIGH CPU/MEMORY ON ONE NODE