oracle系统级掉电,oracle 服务器掉电 重启后观察日志情况

大家好

今天机房突然断电了，启动之后oralce警告日志有好多包报错

oracle版本是 11.2.3  安装在IBM p720 操作系统是 AIX 6100-06-08-1216

以下是报错信息，请大家帮忙分析下

SQL>  select group#,sequence#,status from v$log;

GROUP#  SEQUENCE# STATUS

---------- ---------- ----------------

1       2197 CURRENT

2       2194 INACTIVE

3        189 INACTIVE

4        190 INACTIVE

5       2195 INACTIVE

6       2196 INACTIVE

7        191 INACTIVE

8        192 INACTIVE

8 rows selected.

$ cat alert_CWEOL1.log |grep ORA

Starting ORACLE instance (normal)

ORACLE_HOME = /oracle/product/ora11gr2/db_1

ORACLE_BASE from environment = /oracle/product/ora11gr2

Starting ORACLE instance (normal)

ORACLE_HOME = /oracle/product/ora11gr2/db_1

ORACLE_BASE from environment = /oracle/product/ora11gr2

ORA-1109 signalled during: ALTER DATABASE CLOSE NORMAL...

Starting ORACLE instance (normal)

ORACLE_HOME = /oracle/product/ora11gr2/db_1

ORACLE_BASE from environment = /oracle/product/ora11gr2

ORA-00313: open failed for members of log group 1 of thread 1

ORA-00313: open failed for members of log group 1 of thread 1

ORA-00313: open failed for members of log group 1 of thread 1

ORA-00313: open failed for members of log group 2 of thread 1

ORA-00313: open failed for members of log group 2 of thread 1

ORA-00313: open failed for members of log group 2 of thread 1

ORA-00313: open failed for members of log group 5 of thread 1

ORA-00313: open failed for members of log group 5 of thread 1

ORA-00313: open failed for members of log group 5 of thread 1

ORA-00313: open failed for members of log group 6 of thread 1

ORA-00313: open failed for members of log group 6 of thread 1

ORA-00313: open failed for members of log group 6 of thread 1

Starting ORACLE instance (normal)

ORACLE_HOME = /oracle/product/ora11gr2/db_1

ORACLE_BASE from environment = /oracle/product/ora11gr2

Starting ORACLE instance (normal)

ORACLE_HOME = /oracle/product/ora11gr2/db_1

ORACLE_BASE not set in environment. It is recommended

that ORACLE_BASE be set in the environment

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

ORA-29280: invalid directory path

ORA-06512: at "ORACLE_OCM.MGMT_DB_LL_METRICS", line 2436

ORA-06512: at line 1

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

ORA-29280: invalid directory path

ORA-06512: at "ORACLE_OCM.MGMT_DB_LL_METRICS", line 2436

ORA-06512: at line 1

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

ORA-29280: invalid directory path

ORA-06512: at "ORACLE_OCM.MGMT_DB_LL_METRICS", line 2436

ORA-06512: at line 1

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

ORA-29280: invalid directory path

ORA-06512: at "ORACLE_OCM.MGMT_DB_LL_METRICS", line 2436

ORA-06512: at line 1

Starting ORACLE instance (normal)

ORACLE_HOME = /oracle/product/ora11gr2/db_1

ORACLE_BASE not set in environment. It is recommended

that ORACLE_BASE be set in the environment

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

ORA-29280: invalid directory path

ORA-06512: at "ORACLE_OCM.MGMT_DB_LL_METRICS", line 2436

ORA-06512: at line 1

ORA-01555 caused by SQL statement below (SQL ID: 7dg78f8rg7xgk, Query Duration=0 sec, SCN: 0x0000.0325d6f7):

WARNING: inbound connection timed out (ORA-3136)

Starting ORACLE instance (normal)

ORACLE_HOME = /oracle/product/ora11gr2/db_1

ORACLE_BASE from environment = /oracle/product/ora11gr2

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

ORA-29280: invalid directory path

ORA-06512: at "ORACLE_OCM.MGMT_DB_LL_METRICS", line 2436

ORA-06512: at line 1

WARNING: inbound connection timed out (ORA-3136)

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

ORA-29280: invalid directory path

ORA-06512: at "ORACLE_OCM.MGMT_DB_LL_METRICS", line 2436

ORA-06512: at line 1

ORA-27072: File I/O error

ORA-00202: control file: '+DATA/cweol/controlfile/current.260.797570831'

ORA-15081: failed to submit an I/O operation to a disk

ORA-27063: number of bytes read/written is incorrect

ORA-27063: number of bytes read/written is incorrect

ORA-15080: synchronous I/O operation to a disk failed

ORA-15080: synchronous I/O operation to a disk failed

ORA-00345: redo log write error block 93936 count 63

ORA-00312: online log 6 thread 1: '+DATA/cweol/onlinelog/group_6.264.797570853'

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-00345: redo log write error block 93936 count 63

ORA-00312: online log 6 thread 1: '+RECO/cweol/onlinelog/group_6.260.797570855'

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-00340: IO error processing online log 6 of thread 1

ORA-00345: redo log write error block 93936 count 63

ORA-00312: online log 6 thread 1: '+DATA/cweol/onlinelog/group_6.264.797570853'

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-00345: redo log write error block 93936 count 63

ORA-00312: online log 6 thread 1: '+RECO/cweol/onlinelog/group_6.260.797570855'

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-1092 : opitsk aborting process

ORA-1092 : opitsk aborting process

Starting ORACLE instance (normal)

ORACLE_HOME = /oracle/product/ora11gr2/db_1

ORACLE_BASE not set in environment. It is recommended

that ORACLE_BASE be set in the environment

Reusing ORACLE_BASE from an earlier startup = /oracle/product/ora11gr2

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

NOTE: Deferred communication with ASM instance

NOTE: deferred map free for map id 58

NOTE: Deferred communication with ASM instance

NOTE: Deferred communication with ASM instance

NOTE: deferred map free for map id 4

NOTE: Deferred communication with ASM instance

NOTE: deferred map free for map id 2

minact-scn: Master returning as live inst:2 has inc# mismatch instinc:0 cur:4 errcnt:0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12606

nt main err code: 0

nt secondary err code: 0

nt OS err code: 0

ORA-12012: error on auto execute of job "ORACLE_OCM"."MGMT_CONFIG_JOB_2_1"

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

ORA-27072: File I/O error

WARNING: failed to read mirror side 1 of virtual extent 4 logical extent 0 of file 260 in group [1.2634245900] from disk DATA_0002  allocation unit 227 reason error; if possible, will try another mirror side

IBM AIX RISC System/6000 Error: 5: I/O error

ORA-00345: redo log write error block 93936 count 63

ORA-00345: redo log write error block 93936 count 63

ORA-00340: IO error processing online log 6 of thread 1

ORA-00345: redo log write error block 93936 count 63

ORA-00345: redo log write error block 93936 count 63

LGWR (ospid: 12451964): terminating the instance due to error 340

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

Fatal NI connect error 12170.

Tns error struct:

ns main err code: 12535

ns secondary err code: 12560

nt main err code: 505

nt secondary err code: 78

nt OS err code: 0

$  cat alert_CWEOL1.log |grep fail

ORA-00313: open failed for members of log group 1 of thread 1

ORA-00313: open failed for members of log group 1 of thread 1

ORA-00313: open failed for members of log group 1 of thread 1

Checker run found 1 new persistent data failures

ORA-00313: open failed for members of log group 2 of thread 1

ORA-00313: open failed for members of log group 2 of thread 1

ORA-00313: open failed for members of log group 2 of thread 1

ORA-00313: open failed for members of log group 5 of thread 1

ORA-00313: open failed for members of log group 5 of thread 1

ORA-00313: open failed for members of log group 5 of thread 1

ORA-00313: open failed for members of log group 6 of thread 1

ORA-00313: open failed for members of log group 6 of thread 1

ORA-00313: open failed for members of log group 6 of thread 1

WARNING: failed to read mirror side 1 of virtual extent 4 logical extent 0 of file 260 in group [1.2634245900] from disk DATA_0002  allocation unit 227 reason error; if possible, will try another mirror side

ORA-15081: failed to submit an I/O operation to a disk

ORA-15080: synchronous I/O operation to a disk failed

WARNING: failed to write mirror side 1 of virtual extent 45 logical extent 0 of file 264 in group 1 on disk 1 allocation unit 358

ORA-15080: synchronous I/O operation to a disk failed

WARNING: failed to write mirror side 1 of virtual extent 45 logical extent 0 of file 260 in group 3 on disk 1 allocation unit 467

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

ORA-15081: failed to submit an I/O operation to a disk

Instance termination failed to kill one or more processes