gawk -f ass1038.awk o20002_ora_310.trc.txt
Starting Systemstate 1
..............................................................................
...............................................................................
........................................
Ass.Awk Version 1.0.38
~~~~~~~~~~~~~~~~~~~~~~
Source file : o20002_ora_310.trc.txt
System State 1 (2017-08-03 03:20:53.558)
~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~
1: [DEAD]
2: waiting for 'pmon timer'
3: waiting for 'DIAG idle wait'
4: waiting for 'rdbms ipc message'
5: waiting for 'rdbms ipc message'
6: waiting for 'ges remote message'
7: waiting for 'gcs remote message'
8: waiting for 'gcs remote message'
9: last wait for 'rdbms ipc message'
10: waiting for 'rdbms ipc message'
11: waiting for 'rdbms ipc message'
12: waiting for 'rdbms ipc message'
13: waiting for 'SGA: allocation forcing component growth'
14: waiting for 'latch free'
15: waiting for 'SGA: allocation forcing component growth'[Latch c000000040615490]
16: waiting for 'cursor: pin S wait on X'[Mutex 337fc737]
17: waiting for 'SGA: allocation forcing component growth'
18:
19:
20: waiting for 'rdbms ipc message'
21: waiting for 'latch free'
Cmd: Select
22: waiting for 'SGA: allocation forcing component growth'[Latch c000000040615490]
23: waiting for 'cursor: pin S wait on X'[Mutex e53b6fe3]
Cmd: Select
24: waiting for 'cursor: pin S wait on X'[Mutex e673c640]
Cmd: Update
25: waiting for 'Streams AQ: qmn coordinator idle wait'
26: waiting for 'SQL*Net message from client'
27: waiting for 'cursor: pin S wait on X'[Mutex 432d082b]
Cmd: Update
28: waiting for 'cursor: pin S wait on X'[Mutex 95c2a581]
Cmd: Select
29: last wait for 'SGA: allocation forcing component growth'[Latch c000000040615490]
Cmd: Select
30: waiting for 'SGA: allocation forcing component growth'[Latch c000000040615490]
Cmd: Delete
31: waiting for 'SGA: allocation forcing component growth'[Latch c000000040615490]
Cmd: Update
32: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
33: waiting for 'SGA: allocation forcing component growth'
Cmd: Update
34: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
35: waiting for 'cursor: pin S wait on X'[Mutex 432d082b]
Cmd: Update
36: waiting for 'cursor: pin S wait on X'[Mutex 432d082b]
Cmd: Update
37: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
38: waiting for 'latch free' [Latch c000000040615490]
Cmd: Update
39: waiting for 'SGA: allocation forcing component growth'[Latch c000000040615490]
40: waiting for 'cursor: pin S wait on X'[Mutex 4fbb339d]
Cmd: Update
41: waiting for 'cursor: pin S wait on X'[Mutex ef53eca9]
Cmd: Update
42: waiting for 'SGA: allocation forcing component growth'
Cmd: Update
43: waiting for 'cursor: pin S wait on X'[Mutex d86c90a3]
Cmd: Update
44: waiting for 'SGA: allocation forcing component growth'
Cmd: Update
45: waiting for 'cursor: pin S wait on X'[Mutex 432d082b]
Cmd: Update
46: waiting for 'SGA: allocation forcing component growth'
Cmd: Select
47: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
48: waiting for 'cursor: pin S wait on X'[Mutex 432d082b]
Cmd: Update
49: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
50: waiting for 'SGA: allocation forcing component growth'
Cmd: Update
51: waiting for 'SGA: allocation forcing component growth'
Cmd: Select
52: waiting for 'cursor: pin S wait on X'[Mutex 5da26f79]
Cmd: Update
53: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
54: waiting for 'SGA: allocation forcing component growth'
Cmd: Update
55: waiting for 'cursor: pin S wait on X'[Mutex f4a1d65b]
Cmd: Update
56: waiting for 'cursor: pin S wait on X'[Mutex 9a05b67a]
Cmd: PL/SQL Execute
57: waiting for 'SGA: allocation forcing component growth'
Cmd: PL/SQL Execute
58: waiting for 'SGA: allocation forcing component growth'
Cmd: Update
59: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
60: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
61: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
62: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
63: waiting for 'Streams AQ: waiting for time management or cleanup tasks'
64: waiting for 'Streams AQ: qmn slave idle wait'
65: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
66: waiting for 'SGA: allocation forcing component growth'
Cmd: Select
67: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
68: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
69: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
70: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
71: waiting for 'cursor: pin S wait on X'[Mutex f5e84a90]
72: last wait for 'ksdxexeotherwait' [Rcache object=c00000006c3bf880,]
73: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
74: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
75: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
76: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
77: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
78: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
79: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
80: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
81: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
82: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
83: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
84: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
85: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
86: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
87: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
88: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
89: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
90: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
91: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
92: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
93: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
94: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
95: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
96: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
97: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
98: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
99: waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
100:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
101:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
102:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
103:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
104:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
105:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
106:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
107:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
108:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
109:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
110:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
111:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
112:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
113:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
114:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
115:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
116:waiting for 'cursor: pin S wait on X'[Mutex b08a6d87]
117:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
118:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
119:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
120:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
121:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
122:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
123:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
124:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
125:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
126:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
127:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
128:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
129:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
130:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
131:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
132:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
133:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
134:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
135:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
136:waiting for 'cursor: pin S wait on X'[Mutex b08a6d87]
137:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
138:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
139:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
140:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
141:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
142:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
143:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
144:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
145:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
146:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
147:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
148:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
149:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
150:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
151:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
152:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
153:waiting for 'row cache lock' [Rcache object=c00000006c83da40,]
154:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
155:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
156:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
157:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
158:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
159:waiting for 'cursor: pin S wait on X'[Mutex b08a6d87]
160:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
161:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
162:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
163:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
164:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
165:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
166:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
167:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
168:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
169:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
170:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
171:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
172:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
173:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
174:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
175:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
176:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
177:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
178:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
179:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
180:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
181:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
182:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
183:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
184:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
185:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
186:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
187:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
188:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
189:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
190:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
191:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
192:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
193:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
194:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
195:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
196:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
197:waiting for 'row cache lock' [Rcache object=c00000006c3bf880,]
Blockers
~~~~~~~~
Above is a list of all the processes. If they are waiting for a resource
then it will be given in square brackets. Below is a summary of the
waited upon resources, together with the holder of that resource.
Notes:
~~~~~
o A process id of '???' implies that the holder was not found in the
systemstate. (The holder may have released the resource before we
dumped the state object tree of the blocking process).
o Lines with 'Enqueue conversion' below can be ignored *unless*
other sessions are waiting on that resource too. For more, see
http://dlsunuk11.uk.oracle.com/Public/TOOLS/Ass.html#enqcnv)
Resource Holder State
Latch c000000040615490 ??? Blocker
Mutex 337fc737 29: 29: is waiting for Latch c000000040615490
Mutex e53b6fe3 29: 29: is waiting for Latch c000000040615490
Mutex e673c640 31: 31: is waiting for Latch c000000040615490
Mutex 432d082b 58: waiting for 'SGA: allocation forcing component growth'
Mutex 95c2a581 30: 30: is waiting for Latch c000000040615490
Rcache object=c00000006c3bf880, 71: 71: is waiting for 46:
Mutex 4fbb339d 50: waiting for 'SGA: allocation forcing component growth'
Mutex ef53eca9 54: waiting for 'SGA: allocation forcing component growth'
Mutex d86c90a3 44: waiting for 'SGA: allocation forcing component growth'
Mutex 5da26f79 38: 38: is waiting for Latch c000000040615490
Mutex f4a1d65b 42: waiting for 'SGA: allocation forcing component growth'
Mutex 9a05b67a 51: waiting for 'SGA: allocation forcing component growth'
Mutex f5e84a90 46: waiting for 'SGA: allocation forcing component growth'
Mutex b08a6d87 39: 39: is waiting for Latch c000000040615490
Rcache object=c00000006c83da40, 14: waiting for 'latch free'
Some of the above latches may be child latches. Please check the section
named 'Child Latch Report' below for further notes.
Blockers According to Tracefile Wait Info:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1. This may not work for 64bit platforms. See bug 2902997 for details.
2. If the blocking process is shown as 0 then that session may no longer be
present.
3. If resources are held across code layers then sometimes the tracefile wait
info will not recognise the problem.
No blockers seen.
Object Names
~~~~~~~~~~~~
Latch c000000040615490 Parent Memory Management Latch
Mutex 337fc737
Mutex e53b6fe3
Mutex e673c640
Mutex 432d082b
Mutex 95c2a581
Rcache object=c00000006c3bf880, cid=8(dc_objects)
Mutex 4fbb339d
Mutex ef53eca9
Mutex d86c90a3
Mutex 5da26f79
Mutex f4a1d65b
Mutex 9a05b67a
Mutex f5e84a90
Mutex b08a6d87
Rcache object=c00000006c83da40, cid=15(dc_database_links)
Child Latch Report
~~~~~~~~~~~~~~~~~~
No child latches seen.
Latch Wait List Information
~~~~~~~~~~~~~~~~~~~~~~~~~~~
Pid 15 is blocked waiting for latch 'Parent Memory Management Latch' with 18 waiters.
Possible holder is Pid 5317.
Pid 22 is blocked waiting for latch Parent Memory Management Latch with 18 waiters.
Possible holder is Pid 5317.
Pid 29 is blocked waiting for latch Parent Memory Management Latch with 19 waiters.
Pid 30 is blocked waiting for latch Parent Memory Management Latch with 17 waiters.
Possible holder is Pid 10973.
Pid 31 is blocked waiting for latch Parent Memory Management Latch with 19 waiters.
Pid 38 is blocked waiting for latch Parent Memory Management Latch with 17 waiters.
Pid 39 is blocked waiting for latch Parent Memory Management Latch with 18 waiters.
7 entries seen
Summary of Wait Events Seen (count>10)
~~~~~~~~~~~~~~~~~~~~~~~~~~~
No wait events seen more than 10 times
------------------ooOoo------------------
For the LATEST version of this utility see
http://dlsunuk11.uk.oracle.com/Public/Utils.html#ass
For additional documentation see
http://dlsunuk11.uk.oracle.com/Public/TOOLS/Ass.html
Suggested improvements, bugs etc. should be sent to kevin.p.quinn@oracle.com
End of report. 105992 Lines Processed.