(二)数据库故障处理的案例-处理归档不能执行

Starting up ORACLE RDBMS Version: 10.2.0.4.0.
System parameters with non-default values:
  processes                = 300
  sessions                 = 335
  __shared_pool_size       = 687865856
  __large_pool_size        = 16777216
  __java_pool_size         = 16777216
  __streams_pool_size      = 0
  spfile                   = +DG/dqb/spfiledqb.ora
  sga_target               = 1610612736
  control_files            = +DG/dqb/controlfile/current.272.803844991
  control_file_record_keep_time= 8
  db_block_size            = 8192
  __db_cache_size          = 872415232
  compatible               = 10.2.0.3.0
  log_archive_dest_1       = LOCATION=+dg/dqb/arch/arch1
  db_file_multiblock_read_count= 16
  cluster_database         = TRUE
  cluster_database_instances= 2
  db_create_file_dest      = +DG
  db_recovery_file_dest_size= 10737418240
  thread                   = 1
  instance_number          = 1
  undo_management          = AUTO
  undo_tablespace          = UNDOTBS1
  remote_login_passwordfile= EXCLUSIVE
  db_domain                = 
  dispatchers              = (PROTOCOL=TCP) (SERVICE=dqbXDB)
  remote_listener          = LISTENERS_DQB
  job_queue_processes      = 10
  background_dump_dest     = /oracle/product/admin/dqb/bdump
  user_dump_dest           = /oracle/product/admin/dqb/udump
  core_dump_dest           = /oracle/product/admin/dqb/cdump
  audit_file_dest          = /oracle/product/admin/dqb/adump
  db_name                  = dqb
  open_cursors             = 300
  pga_aggregate_target     = 3363831808
Cluster communication is configured to use the following interface(s) for this instance
  192.168.1.1
Wed May 14 11:42:25 2014
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=3, OS id=5315
DIAG started with pid=7, OS id=5317
PSP0 started with pid=11, OS id=5319
LMON started with pid=15, OS id=5321
LMD0 started with pid=2, OS id=5323
LMS0 started with pid=6, OS id=5325
LMS1 started with pid=19, OS id=5329
LMS2 started with pid=4, OS id=5333
LMS3 started with pid=5, OS id=5337
LMS4 started with pid=10, OS id=5341
LMS5 started with pid=23, OS id=5345
LMS6 started with pid=8, OS id=5349
LMS7 started with pid=9, OS id=5353
MMAN started with pid=27, OS id=5357
DBW0 started with pid=14, OS id=5359
DBW1 started with pid=31, OS id=5361
DBW2 started with pid=12, OS id=5363
DBW3 started with pid=13, OS id=5365
LGWR started with pid=35, OS id=5367
CKPT started with pid=39, OS id=5369
SMON started with pid=43, OS id=5371
RECO started with pid=47, OS id=5373
CJQ0 started with pid=18, OS id=5375
MMON started with pid=51, OS id=5377
Wed May 14 11:42:26 2014
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=55, OS id=5379
Wed May 14 11:42:26 2014
starting up 1 shared server(s) ...
Wed May 14 11:42:26 2014
lmon registered with NM - instance id 1 (internal mem no 0)
Wed May 14 11:42:26 2014
Reconfiguration started (old inc 0, new inc 2)
List of nodes:
 0
 Global Resource Directory frozen
* allocate domain 0, invalid = TRUE 
 Communication channels reestablished
 Master broadcasted resource hash value bitmaps
 Non-local Process blocks cleaned out
Wed May 14 11:42:26 2014
 LMS 1: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:42:26 2014
 LMS 0: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:42:26 2014
 LMS 5: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:42:26 2014
 LMS 2: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:42:26 2014
 LMS 4: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:42:26 2014
 LMS 3: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:42:26 2014
 LMS 6: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:42:26 2014
 LMS 7: 0 GCS shadows cancelled, 0 closed
 Set master node info 
 Submitted all remote-enqueue requests
 Dwn-cvts replayed, VALBLKs dubious
 All grantable enqueues granted
 Post SMON to start 1st pass IR
Wed May 14 11:42:26 2014
 LMS 2: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:42:26 2014
 LMS 0: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:42:26 2014
 LMS 3: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:42:26 2014
 LMS 6: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:42:26 2014
 LMS 1: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:42:26 2014
 LMS 5: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:42:26 2014
 LMS 7: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:42:26 2014
 LMS 4: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:42:26 2014
 Submitted all GCS remote-cache requests
 Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=30, OS id=5390
Wed May 14 11:42:27 2014
ALTER DATABASE   MOUNT
Wed May 14 11:42:27 2014
This instance was first to mount
Wed May 14 11:42:27 2014
Starting background process ASMB
ASMB started with pid=59, OS id=5396
Starting background process RBAL
RBAL started with pid=63, OS id=5405
Wed May 14 11:42:30 2014
SUCCESS: diskgroup DG was mounted
Wed May 14 11:42:34 2014
Setting recovery target incarnation to 2
Wed May 14 11:42:34 2014
Successful mount of redo thread 1, with mount id 4126485027
Wed May 14 11:42:34 2014
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: ALTER DATABASE   MOUNT
Wed May 14 11:42:34 2014
ALTER DATABASE OPEN
This instance was first to open
Picked broadcast on commit scheme to generate SCNs
Wed May 14 11:42:38 2014
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=42, OS id=5465
Wed May 14 11:42:38 2014
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=71, OS id=5467
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
Wed May 14 11:42:38 2014
ARC0: Becoming the heartbeat ARCH
Wed May 14 11:42:38 2014
ARC1: Log corruption near block 140236 change 13881059252670 time ?
Wed May 14 11:42:38 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb1_arc1_5467.trc:
ORA-00354: corrupt redo log block header
ORA-00353: log corruption near block 140236 change 13881059252670 time 05/13/2014 13:09:30
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
ARC1: All Archive destinations made inactive due to error 354
Wed May 14 11:42:41 2014
ARC1: Closing local archive destination LOG_ARCHIVE_DEST_1: '+DG/dqb/arch/arch1/1_15107_803844992.dbf' (error 354)
 (dqb1)
Committing creation of archivelog '+DG/dqb/arch/arch1/1_15107_803844992.dbf' (error 354)
ARCH: Archival stopped, error occurred. Will continue retrying
Wed May 14 11:42:41 2014
ORACLE Instance dqb1 - Archival Error
Wed May 14 11:42:41 2014
ORA-16038: log 1 sequence# 15107 cannot be archived
ORA-00354: corrupt redo log block header
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
Wed May 14 11:42:41 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb1_arc1_5467.trc:
ORA-16038: log 1 sequence# 15107 cannot be archived
ORA-00354: corrupt redo log block header
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
Wed May 14 11:42:41 2014
Errors in file /oracle/product/admin/dqb/udump/dqb1_ora_5446.trc:
ORA-16014: log 1 sequence# 15107 not archived, no available destinations
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
Wed May 14 11:42:41 2014
USER: terminating instance due to error 16014
Wed May 14 11:42:41 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb1_lms4_5341.trc:
ORA-16014: log  sequence#  not archived, no available destinations
Wed May 14 11:42:41 2014
System state dump is made for local instance
System State dumped to trace file /oracle/product/admin/dqb/bdump/dqb1_diag_5317.trc
Wed May 14 11:42:41 2014
Trace dumping is performing id=[cdmp_20140514114241]
Wed May 14 11:42:44 2014
Instance terminated by USER, pid = 5446
Wed May 14 11:44:14 2014
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.1.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 10.177.1.0 configured from OCR for use as  a public interface
Picked latch-free SCN scheme 3
Autotune of undo retention is turned on. 
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.4.0.
System parameters with non-default values:
  processes                = 300
  sessions                 = 335
  __shared_pool_size       = 687865856
  __large_pool_size        = 16777216
  __java_pool_size         = 16777216
  __streams_pool_size      = 0
  spfile                   = +DG/dqb/spfiledqb.ora
  sga_target               = 1610612736
  control_files            = +DG/dqb/controlfile/current.272.803844991
  control_file_record_keep_time= 8
  db_block_size            = 8192
  __db_cache_size          = 872415232
  compatible               = 10.2.0.3.0
  log_archive_dest_1       = LOCATION=+dg/dqb/arch/arch1
  db_file_multiblock_read_count= 16
  cluster_database         = TRUE
  cluster_database_instances= 2
  db_create_file_dest      = +DG
  db_recovery_file_dest_size= 10737418240
  thread                   = 1
  instance_number          = 1
  undo_management          = AUTO
  undo_tablespace          = UNDOTBS1
  remote_login_passwordfile= EXCLUSIVE
  db_domain                = 
  dispatchers              = (PROTOCOL=TCP) (SERVICE=dqbXDB)
  remote_listener          = LISTENERS_DQB
  job_queue_processes      = 10
  background_dump_dest     = /oracle/product/admin/dqb/bdump
  user_dump_dest           = /oracle/product/admin/dqb/udump
  core_dump_dest           = /oracle/product/admin/dqb/cdump
  audit_file_dest          = /oracle/product/admin/dqb/adump
  db_name                  = dqb
  open_cursors             = 300
  pga_aggregate_target     = 3363831808
Cluster communication is configured to use the following interface(s) for this instance
  192.168.1.1
Wed May 14 11:44:15 2014
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=4, OS id=6201
DIAG started with pid=8, OS id=6203
PSP0 started with pid=12, OS id=6205
LMON started with pid=16, OS id=6207
LMD0 started with pid=2, OS id=6209
LMS0 started with pid=6, OS id=6211
LMS1 started with pid=3, OS id=6215
LMS2 started with pid=20, OS id=6219
LMS3 started with pid=5, OS id=6223
LMS4 started with pid=10, OS id=6227
LMS5 started with pid=7, OS id=6231
LMS6 started with pid=24, OS id=6235
LMS7 started with pid=9, OS id=6239
MMAN started with pid=28, OS id=6243
DBW0 started with pid=14, OS id=6245
DBW1 started with pid=11, OS id=6247
DBW2 started with pid=32, OS id=6249
DBW3 started with pid=13, OS id=6251
LGWR started with pid=15, OS id=6253
CKPT started with pid=36, OS id=6255
SMON started with pid=40, OS id=6257
RECO started with pid=44, OS id=6259
CJQ0 started with pid=18, OS id=6261
MMON started with pid=48, OS id=6263
Wed May 14 11:44:15 2014
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=52, OS id=6265
Wed May 14 11:44:16 2014
starting up 1 shared server(s) ...
Wed May 14 11:44:16 2014
lmon registered with NM - instance id 1 (internal mem no 0)
Wed May 14 11:44:16 2014
Reconfiguration started (old inc 0, new inc 2)
List of nodes:
 0
 Global Resource Directory frozen
* allocate domain 0, invalid = TRUE 
 Communication channels reestablished
 Master broadcasted resource hash value bitmaps
 Non-local Process blocks cleaned out
Wed May 14 11:44:16 2014
 LMS 2: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:44:16 2014
 LMS 0: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:44:16 2014
 LMS 1: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:44:16 2014
 LMS 3: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:44:16 2014
 LMS 4: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:44:16 2014
 LMS 6: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:44:16 2014
 LMS 5: 0 GCS shadows cancelled, 0 closed
Wed May 14 11:44:16 2014
 LMS 7: 0 GCS shadows cancelled, 0 closed
 Set master node info 
 Submitted all remote-enqueue requests
 Dwn-cvts replayed, VALBLKs dubious
 All grantable enqueues granted
 Post SMON to start 1st pass IR
Wed May 14 11:44:16 2014
 LMS 3: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:44:16 2014
 LMS 1: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:44:16 2014
 LMS 2: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:44:16 2014
 LMS 6: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:44:16 2014
 LMS 0: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:44:16 2014
 LMS 5: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:44:16 2014
 LMS 7: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:44:16 2014
 LMS 4: 0 GCS shadows traversed, 0 replayed
Wed May 14 11:44:16 2014
 Submitted all GCS remote-cache requests
 Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=30, OS id=6276
Wed May 14 11:44:17 2014
ALTER DATABASE   MOUNT
Wed May 14 11:44:17 2014
This instance was first to mount
Wed May 14 11:44:17 2014
Starting background process ASMB
ASMB started with pid=56, OS id=6298
Starting background process RBAL
RBAL started with pid=60, OS id=6302
Wed May 14 11:44:20 2014
SUCCESS: diskgroup DG was mounted
Wed May 14 11:44:24 2014
Setting recovery target incarnation to 2
Wed May 14 11:44:24 2014
Successful mount of redo thread 1, with mount id 4126492305
Wed May 14 11:44:24 2014
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: ALTER DATABASE   MOUNT
Wed May 14 12:55:07 2014
ALTER SYSTEM ARCHIVE LOG
Wed May 14 12:55:32 2014
alter database open
Wed May 14 12:55:32 2014
This instance was first to open
Picked broadcast on commit scheme to generate SCNs
Wed May 14 12:55:35 2014
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=50, OS id=2919
Wed May 14 12:55:35 2014
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=23, OS id=2921
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
Wed May 14 12:55:35 2014
ARC0: Becoming the heartbeat ARCH
Wed May 14 12:55:39 2014
ARCH: Log corruption near block 140236 change 13881059252670 time ?
Wed May 14 12:55:39 2014
Errors in file /oracle/product/admin/dqb/udump/dqb1_ora_6434.trc:
ORA-00354: corrupt redo log block header
ORA-00353: log corruption near block 140236 change 13881059252670 time 05/13/2014 13:09:30
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
ARCH: All Archive destinations made inactive due to error 354
Wed May 14 12:55:39 2014
ARCH: Closing local archive destination LOG_ARCHIVE_DEST_1: '+DG/dqb/arch/arch1/1_15107_803844992.dbf' (error 354)
 (dqb1)
Committing creation of archivelog '+DG/dqb/arch/arch1/1_15107_803844992.dbf' (error 354)
Wed May 14 12:55:39 2014
Errors in file /oracle/product/admin/dqb/udump/dqb1_ora_6434.trc:
ORA-16038: log 1 sequence# 15107 cannot be archived
ORA-00354: corrupt redo log block header
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
USER: terminating instance due to error 16038
Wed May 14 12:55:39 2014
System state dump is made for local instance
System State dumped to trace file /oracle/product/admin/dqb/bdump/dqb1_diag_6203.trc
Wed May 14 12:55:39 2014
Trace dumping is performing id=[cdmp_20140514125539]
Wed May 14 12:55:39 2014
Shutting down instance (abort)
License high water mark = 6
Wed May 14 12:55:43 2014
Instance terminated by USER, pid = 6434
Wed May 14 12:55:44 2014
Instance terminated by USER, pid = 2974
Wed May 14 12:55:46 2014
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.1.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 10.177.1.0 configured from OCR for use as  a public interface
Picked latch-free SCN scheme 3
Autotune of undo retention is turned on. 
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.4.0.
System parameters with non-default values:
  processes                = 300
  sessions                 = 335
  __shared_pool_size       = 687865856
  __large_pool_size        = 16777216
  __java_pool_size         = 16777216
  __streams_pool_size      = 0
  spfile                   = +DG/dqb/spfiledqb.ora
  sga_target               = 1610612736
  control_files            = +DG/dqb/controlfile/current.272.803844991
  control_file_record_keep_time= 8
  db_block_size            = 8192
  __db_cache_size          = 872415232
  compatible               = 10.2.0.3.0
  log_archive_dest_1       = LOCATION=+dg/dqb/arch/arch1
  db_file_multiblock_read_count= 16
  cluster_database         = TRUE
  cluster_database_instances= 2
  db_create_file_dest      = +DG
  db_recovery_file_dest_size= 10737418240
  thread                   = 1
  instance_number          = 1
  undo_management          = AUTO
  undo_tablespace          = UNDOTBS1
  remote_login_passwordfile= EXCLUSIVE
  db_domain                = 
  dispatchers              = (PROTOCOL=TCP) (SERVICE=dqbXDB)
  remote_listener          = LISTENERS_DQB
  job_queue_processes      = 10
  background_dump_dest     = /oracle/product/admin/dqb/bdump
  user_dump_dest           = /oracle/product/admin/dqb/udump
  core_dump_dest           = /oracle/product/admin/dqb/cdump
  audit_file_dest          = /oracle/product/admin/dqb/adump
  db_name                  = dqb
  open_cursors             = 300
  pga_aggregate_target     = 3363831808
Cluster communication is configured to use the following interface(s) for this instance
  192.168.1.1
Wed May 14 12:55:46 2014
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=3, OS id=3047
DIAG started with pid=7, OS id=3049
PSP0 started with pid=11, OS id=3056
LMON started with pid=15, OS id=3058
LMD0 started with pid=2, OS id=3060
LMS0 started with pid=6, OS id=3062
LMS1 started with pid=19, OS id=3066
LMS2 started with pid=4, OS id=3070
LMS3 started with pid=5, OS id=3074
LMS4 started with pid=10, OS id=3078
LMS5 started with pid=23, OS id=3082
LMS6 started with pid=8, OS id=3086
LMS7 started with pid=9, OS id=3090
MMAN started with pid=27, OS id=3094
DBW0 started with pid=14, OS id=3096
DBW1 started with pid=31, OS id=3098
DBW2 started with pid=12, OS id=3100
DBW3 started with pid=13, OS id=3102
LGWR started with pid=35, OS id=3104
CKPT started with pid=39, OS id=3106
SMON started with pid=43, OS id=3108
RECO started with pid=47, OS id=3110
CJQ0 started with pid=18, OS id=3112
MMON started with pid=51, OS id=3114
Wed May 14 12:55:47 2014
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=55, OS id=3116
Wed May 14 12:55:47 2014
starting up 1 shared server(s) ...
Wed May 14 12:55:47 2014
lmon registered with NM - instance id 1 (internal mem no 0)
Wed May 14 12:55:48 2014
Reconfiguration started (old inc 0, new inc 2)
List of nodes:
 0
 Global Resource Directory frozen
* allocate domain 0, invalid = TRUE 
 Communication channels reestablished
 Master broadcasted resource hash value bitmaps
 Non-local Process blocks cleaned out
Wed May 14 12:55:48 2014
 LMS 5: 0 GCS shadows cancelled, 0 closed
Wed May 14 12:55:48 2014
 LMS 1: 0 GCS shadows cancelled, 0 closed
Wed May 14 12:55:48 2014
 LMS 0: 0 GCS shadows cancelled, 0 closed
Wed May 14 12:55:48 2014
 LMS 3: 0 GCS shadows cancelled, 0 closed
Wed May 14 12:55:48 2014
 LMS 2: 0 GCS shadows cancelled, 0 closed
Wed May 14 12:55:48 2014
 LMS 4: 0 GCS shadows cancelled, 0 closed
Wed May 14 12:55:48 2014
 LMS 6: 0 GCS shadows cancelled, 0 closed
Wed May 14 12:55:48 2014
 LMS 7: 0 GCS shadows cancelled, 0 closed
 Set master node info 
 Submitted all remote-enqueue requests
 Dwn-cvts replayed, VALBLKs dubious
 All grantable enqueues granted
 Post SMON to start 1st pass IR
Wed May 14 12:55:48 2014
 LMS 0: 0 GCS shadows traversed, 0 replayed
Wed May 14 12:55:48 2014
 LMS 1: 0 GCS shadows traversed, 0 replayed
Wed May 14 12:55:48 2014
 LMS 3: 0 GCS shadows traversed, 0 replayed
Wed May 14 12:55:48 2014
 LMS 5: 0 GCS shadows traversed, 0 replayed
Wed May 14 12:55:48 2014
 LMS 2: 0 GCS shadows traversed, 0 replayed
Wed May 14 12:55:48 2014
 LMS 4: 0 GCS shadows traversed, 0 replayed
Wed May 14 12:55:48 2014
 LMS 6: 0 GCS shadows traversed, 0 replayed
Wed May 14 12:55:48 2014
 LMS 7: 0 GCS shadows traversed, 0 replayed
Wed May 14 12:55:48 2014
 Submitted all GCS remote-cache requests
 Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=30, OS id=3127
Wed May 14 12:55:48 2014
ALTER DATABASE   MOUNT
Wed May 14 12:55:48 2014
This instance was first to mount
Wed May 14 12:55:48 2014
Starting background process ASMB
ASMB started with pid=59, OS id=3133
Starting background process RBAL
RBAL started with pid=63, OS id=3137
Wed May 14 12:55:51 2014
SUCCESS: diskgroup DG was mounted
Wed May 14 12:55:56 2014
Setting recovery target incarnation to 2
Wed May 14 12:55:56 2014
Successful mount of redo thread 1, with mount id 4126524244
Wed May 14 12:55:56 2014
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: ALTER DATABASE   MOUNT
Wed May 14 12:55:56 2014
ALTER DATABASE OPEN
This instance was first to open
Picked broadcast on commit scheme to generate SCNs
Wed May 14 12:55:59 2014
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=42, OS id=3204
Wed May 14 12:55:59 2014
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=71, OS id=3206
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
Wed May 14 12:55:59 2014
ARC0: Becoming the heartbeat ARCH
Wed May 14 12:56:00 2014
ARCH: Log corruption near block 140236 change 13881059252670 time ?
Wed May 14 12:56:00 2014
Errors in file /oracle/product/admin/dqb/udump/dqb1_ora_3183.trc:
ORA-00354: corrupt redo log block header
ORA-00353: log corruption near block 140236 change 13881059252670 time 05/13/2014 13:09:30
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
ARCH: All Archive destinations made inactive due to error 354
Wed May 14 12:56:00 2014
ARCH: Closing local archive destination LOG_ARCHIVE_DEST_1: '+DG/dqb/arch/arch1/1_15107_803844992.dbf' (error 354)
 (dqb1)
Committing creation of archivelog '+DG/dqb/arch/arch1/1_15107_803844992.dbf' (error 354)
Wed May 14 12:56:00 2014
Errors in file /oracle/product/admin/dqb/udump/dqb1_ora_3183.trc:
ORA-16038: log 1 sequence# 15107 cannot be archived
ORA-00354: corrupt redo log block header
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
USER: terminating instance due to error 16038
Wed May 14 12:56:00 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb1_lms6_3086.trc:
ORA-16038: log  sequence#  cannot be archived
Wed May 14 12:56:00 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb1_lms4_3078.trc:
ORA-16038: log  sequence#  cannot be archived
Wed May 14 12:56:00 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb1_lmd0_3060.trc:
ORA-16038: log  sequence#  cannot be archived
Wed May 14 12:56:00 2014
System state dump is made for local instance
System State dumped to trace file /oracle/product/admin/dqb/bdump/dqb1_diag_3049.trc
Wed May 14 12:56:00 2014
Trace dumping is performing id=[cdmp_20140514125600]
Wed May 14 12:56:03 2014
Instance terminated by USER, pid = 3183
Wed May 14 13:20:00 2014
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.1.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 10.177.1.0 configured from OCR for use as  a public interface
Picked latch-free SCN scheme 3
Autotune of undo retention is turned on. 
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization      
根据上面的日志,可以清楚的得出,现在的问题是由于联机日志存在问题,无法进行归档动作,导致数据库不能启动。
      1、 
执行以下SQL,确认故障原因
       SQL> alter system archive log current;

alter system archive log current
*
ERROR at line 1:
ORA-16038: log 1 sequence# 15107 cannot be archived
ORA-00354: corrupt redo log block header
ORA-00312: online log 1 thread 1: '+DG/dqb/onlinelog/group_1.271.803844993'
查看数据库的V$LOG ,V$logfile的状态信息
select * from v$log;

    GROUP#    THREAD#  SEQUENCE#      BYTES    MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIM
---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ---------

  1     1    15107  104857600      1 NO  INACTIVE   1.3881E+13 13-MAY-14
  
  2     1    15108  104857600      1 NO  CURRENT    1.3881E+13 13-MAY-14
 
  3     2    11977  104857600      1 NO  INACTIVE   1.3881E+13 13-MAY-14

    GROUP#    THREAD#  SEQUENCE#      BYTES    MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIM
---------- ---------- ---------- ---------- ---------- --- --------------- -------------- -----

  4     2    11978  104857600      1 NO  CURRENT    1.3881E+13 13-MAY-14

 select * from v$logfile;

    GROUP# STATUS  TYPE    MEMBER  IS_
---------- ------- --------  ---------------------------------------------

  2 STALE   ONLINE +DG/dqb/onlinelog/group_2.275.803844993 NO


  1 STALE   ONLINE +DG/dqb/onlinelog/group_1.271.803844993 NO

 

    GROUP# STATUS  TYPE    MEMBER IS_
---------- ------- ------- -----------------------------------------------

  3 STALE   ONLINE +DG/dqb/onlinelog/group_3.268.803845083 NO

 


  4 STALE   ONLINE +DG/dqb/onlinelog/group_4.266.803845083 NO
2、如果提示与上面一致,则执行下面这一步。
SQL> alter database clear unarchived logfile group 1;
Database altered
  SQL>   alter database clear logfile group 1; 第一个节点执行
Database altered
SQL>   alter database clear unarchived logfile group  1 ; 第一个节点执行
Database altered
SQL>   alter database clear logfile group     3;  第二个节点执行
Database altered
SQL>    alter database clear unarchived logfile group  3 ; 第二个节点执行
Database altered
3、执行上面的步骤,再执行手工归档看是否正常。
SQL> alter system switch logfile;
System altered
执行完后,数据库可以open。
  • 1
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值