[
oracle
@
node1 trace
]
$
cat
/
u01
/
app
/
oracle
/
diag
/
rdbms
/
prod
/
prod1
/
trace
/
prod1_ora_7133
.
trc
Trace
file
/
u01
/
app
/
oracle
/
diag
/
rdbms
/
prod
/
prod1
/
trace
/
prod1_ora_7133
.
trc
Oracle
Database
11g Enterprise Edition
Release
11
.
2
.
.
1
.
0
-
Production
With
the Partitioning
,
Real
Application Clusters
,
Automatic
Storage Management
,
OLAP
,
Data
Mining
and
Real
Application Testing options
ORACLE_HOME
=
/
u01
/
app
/
oracle
/
product
/
11
.
2
.
/
db_1
System name
:
Linux
Node name
:
node1
Release
:
2
.
6
.
18
-
194
.
el5
Version
:
#1 SMP Tue Mar 16 21
:
52
:
43 EDT 2010
Machine
:
i686
Instance name
:
prod1
Redo thread mounted
by
this instance
:
1
Oracle process
number
:
31
Unix process pid
:
7133
,
image
:
oracle
@
node1
(
TNS V1
-
V3
)
*
*
*
2015
-
01
-
05 13
:
08
:
23
.
360
*
*
*
SESSION
ID
:
(
1
.
5
)
2015
-
01
-
05 13
:
08
:
23
.
360
*
*
*
CLIENT ID
:
(
)
2015
-
01
-
05 13
:
08
:
23
.
360
*
*
*
SERVICE NAME
:
(
)
2015
-
01
-
05 13
:
08
:
23
.
360
*
*
*
MODULE NAME
:
(
sqlplus
@
node1
(
TNS V1
-
V3
)
)
2015
-
01
-
05 13
:
08
:
23
.
360
*
*
*
ACTION NAME
:
(
)
2015
-
01
-
05 13
:
08
:
23
.
360
DDE rules
only
execution
for
:
ORA 15041
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
----- START DDE Actions Dump -----
Executing SYNC actions
Executing ASYNC actions
----- END DDE Actions Dump (total 0 csec) -----
Failed
to
create
file
\
'+RECOVERY\'
(
file
not
accessible
?
)
ORA
-
19504
:
failed
to
create
file
\
"+RECOVERY\"
ORA
-
17502
:
ksfdcre
:
4 Failed
to
create
file
+
RECOVERY
ORA
-
15041
:
diskgroup
\
"RECOVERY\"
space exhausted
*
*
*
2015
-
01
-
05 13
:
08
:
23
.
362 4132 krsh
.
c
ARCH
:
Error 19504 Creating archive
log
file
to
\
'+RECOVERY\'
*
*
*
2015
-
01
-
05 13
:
08
:
23
.
362 2747 krsi
.
c
krsi_dst_fail
:
dest
:
1 err
:
19504
force
:
0 blast
:
1
DDE rules
only
execution
for
:
ORA 312
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
----- START DDE Actions Dump -----
Executing SYNC actions
----- START DDE Action: \'DB_STRUCTURE_INTEGRITY_CHECK\' (Async) -----
Successfully dispatched
----- END DDE Action: \'DB_STRUCTURE_INTEGRITY_CHECK\' (SUCCESS, 0 csec) -----
Executing ASYNC actions
----- END DDE Actions Dump (total 0 csec) -----
DDE
:
Problem
Key
\
'ORA 312\'
was flood controlled
(
0x1
)
(
no incident
)
ORA
-
00312
:
online
log
2 thread 1
:
\
'+DATA_GROUP/prod/onlinelog/group_2.262.861981267\'
ORA
-
00312
:
online
log
2 thread 1
:
\
'+RECOVERY/prod/onlinelog/group_2.258.861981273\'
ORA
-
16038
:
log
2
sequence
#
56 cannot be archived
ORA
-
19504
:
failed
to
create
file
\
"\"
ORA
-
00312
:
online
log
2 thread 1
:
\
'+DATA_GROUP/prod/onlinelog/group_2.262.861981267\'
ORA
-
00312
:
online
log
2 thread 1
:
\
'+RECOVERY/prod/onlinelog/group_2.258.861981273\'
*
*
*
2015
-
01
-
05 13
:
08
:
23
.
374
USER
(
ospid
:
7133
)
:
terminating the instance due
to
error 16038
ksuitm
:
waiting up
to
[
5
]
seconds before killing DIAG
(
7003
)