ORA-03113 ORA-19504 ORA-17502 ORA-15041

数据库版本：11.2.0.1  rac

点击( 此处 )折叠或打开

1. SQL > archive log list
   

2. Database log mode            Archive Mode
   

3. Automatic archival           Enabled
   

4. Archive destination     + RECOVERY
   

5. Oldest online log sequence 42
   

6. Next log sequence to archive   43
   

7. Current log sequence            43
   

8. SQL > show parameter archive
   

9. 
   

10. NAME                 TYPE      VALUE
    

11. ------------------------------------ ----------- ------------------------------
    

12. archive_lag_target         integer      0
    

13. log_archive_config             string
    

14. log_archive_dest             string
    

15. log_archive_dest_1             string     location = + RECOVERY

开库过程中告警日志信息

点击( 此处 )折叠或打开

1. Database mounted in Shared Mode ( CLUSTER_DATABASE = TRUE )
   

2. Lost write protection disabled
   

3. Completed : ALTER DATABASE   MOUNT
   

4. Mon Jan 05 13 : 08 : 21 2015
   

5. alter database open
   

6. Picked broadcast on commit scheme to generate SCNs
   

7. Mon Jan 05 13 : 08 : 21 2015
   

8. LGWR : STARTING ARCH PROCESSES
   

9. Mon Jan 05 13 : 08 : 21 2015
   

10. ARC0 started with pid = 35 , OS id = 7140
    

11. ARC0 : Archival started
    

12. LGWR : STARTING ARCH PROCESSES COMPLETE
    

13. ARC0 : STARTING ARCH PROCESSES
    

14. Mon Jan 05 13 : 08 : 22 2015
    

15. ARC2 started with pid = 37 , OS id = 7144
    

16. Mon Jan 05 13 : 08 : 22 2015
    

17. ARC1 started with pid = 36 , OS id = 7142
    

18. ARC1 : Archival started
    

19. ARC2 : Archival started
    

20. ARC1 : Becoming the \ 'no FAL\' ARCH
    

21. ARC1 : Becoming the \ 'no SRL\' ARCH
    

22. ARC2 : Becoming the heartbeat ARCH
    

23. Mon Jan 05 13 : 08 : 22 2015
    

24. ARC3 started with pid = 38 , OS id = 7146
    

25. Errors in file /u01/app/oracle/diag/rdbms/prod/prod1/trace/prod1_ora_7133 . trc :
    

26. ORA - 19504 : failed to create file \ "+RECOVERY\"
    

27. ORA - 17502 : ksfdcre : 4 Failed to create file + RECOVERY
    

28. ORA - 15041 : diskgroup \ "RECOVERY\" space exhausted
    

29. ARCH : Error 19504 Creating archive log file to \ '+RECOVERY\'
    

30. Errors in file /u01/app/oracle/diag/rdbms/prod/prod1/trace/prod1_ora_7133 . trc :
    

31. ORA - 16038 : log 2 sequence# 56 cannot be archived
    

32. ORA - 19504 : failed to create file \ "\"
    

33. ORA - 00312 : online log 2 thread 1 : \ '+DATA_GROUP/prod/onlinelog/group_2.262.861981267\'
    

34. ORA - 00312 : online log 2 thread 1 : \ '+RECOVERY/prod/onlinelog/group_2.258.861981273\'
    

35. USER ( ospid : 7133 ) : terminating the instance due to error 16038
    

36. Mon Jan 05 13 : 08 : 23 2015
    

37. System state dump is made for local instance
    

38. System State dumped to trace file /u01/app/oracle/diag/rdbms/prod/prod1/trace/prod1_diag_7003 . trc
    

39. Trace dumping is performing id = [ cdmp_20150105130823 ]
    

40. Instance terminated by USER , pid = 7133

查看trace

点击( 此处 )折叠或打开

[ oracle @ node1 trace ] $ cat / u01 / app / oracle / diag / rdbms / prod / prod1 / trace / prod1_ora_7133 . trc

Trace file / u01 / app / oracle / diag / rdbms / prod / prod1 / trace / prod1_ora_7133 . trc

Oracle Database 11g Enterprise Edition Release 11 . 2 . . 1 . 0 - Production

With the Partitioning , Real Application Clusters , Automatic Storage Management , OLAP ,

Data Mining and Real Application Testing options

ORACLE_HOME = / u01 / app / oracle / product / 11 . 2 . / db_1

System name :     Linux

Node name :     node1

Release :     2 . 6 . 18 - 194 . el5

Version :     #1 SMP Tue Mar 16 21 : 52 : 43 EDT 2010

Machine :     i686

Instance name : prod1

Redo thread mounted by this instance : 1

Oracle process number : 31

Unix process pid : 7133 , image : oracle @ node1 ( TNS V1 - V3 )

* * * 2015 - 01 - 05 13 : 08 : 23 . 360

* * * SESSION ID : ( 1 . 5 ) 2015 - 01 - 05 13 : 08 : 23 . 360

* * * CLIENT ID : ( ) 2015 - 01 - 05 13 : 08 : 23 . 360

* * * SERVICE NAME : ( ) 2015 - 01 - 05 13 : 08 : 23 . 360

* * * MODULE NAME : ( sqlplus @ node1 ( TNS V1 - V3 ) ) 2015 - 01 - 05 13 : 08 : 23 . 360

* * * ACTION NAME : ( ) 2015 - 01 - 05 13 : 08 : 23 . 360

 

DDE rules only execution for : ORA 15041

----- START Event Driven Actions Dump ----

---- END Event Driven Actions Dump ----

----- START DDE Actions Dump -----

Executing SYNC actions

Executing ASYNC actions

----- END DDE Actions Dump (total 0 csec) -----

Failed to create file \ '+RECOVERY\' ( file not accessible ? )

ORA - 19504 : failed to create file \ "+RECOVERY\"

ORA - 17502 : ksfdcre : 4 Failed to create file + RECOVERY

ORA - 15041 : diskgroup \ "RECOVERY\" space exhausted

* * * 2015 - 01 - 05 13 : 08 : 23 . 362 4132 krsh . c

ARCH : Error 19504 Creating archive log file to \ '+RECOVERY\'

* * * 2015 - 01 - 05 13 : 08 : 23 . 362 2747 krsi . c

krsi_dst_fail : dest : 1 err : 19504 force : 0 blast : 1

DDE rules only execution for : ORA 312

----- START Event Driven Actions Dump ----

---- END Event Driven Actions Dump ----

----- START DDE Actions Dump -----

Executing SYNC actions

----- START DDE Action: \'DB_STRUCTURE_INTEGRITY_CHECK\' (Async) -----

Successfully dispatched

----- END DDE Action: \'DB_STRUCTURE_INTEGRITY_CHECK\' (SUCCESS, 0 csec) -----

Executing ASYNC actions

----- END DDE Actions Dump (total 0 csec) -----

DDE : Problem Key \ 'ORA 312\' was flood controlled ( 0x1 ) ( no incident )

ORA - 00312 : online log 2 thread 1 : \ '+DATA_GROUP/prod/onlinelog/group_2.262.861981267\'

ORA - 00312 : online log 2 thread 1 : \ '+RECOVERY/prod/onlinelog/group_2.258.861981273\'

ORA - 16038 : log 2 sequence # 56 cannot be archived

ORA - 19504 : failed to create file \ "\"

ORA - 00312 : online log 2 thread 1 : \ '+DATA_GROUP/prod/onlinelog/group_2.262.861981267\'

ORA - 00312 : online log 2 thread 1 : \ '+RECOVERY/prod/onlinelog/group_2.258.861981273\'

* * * 2015 - 01 - 05 13 : 08 : 23 . 374

USER ( ospid : 7133 ) : terminating the instance due to error 16038

ksuitm : waiting up to [ 5 ] seconds before killing DIAG ( 7003 )

查看ASM磁盘组发现 归档满了

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/29990276/viewspace-1390577/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/29990276/viewspace-1390577/