一次无法mount数据库的经历

本文系原创:

8月27日凌晨为用户troubleshooting数据库问题时需要重新启动数据库，当数据库启动步骤进行mount时，系统不断出现ARC1: Thread not mounted，截取部分alert.log信息如下:
ARCH: STARTING ARCH PROCESSES
ARC0 started with pid=11, OS id=28762
ARC0: Archival started
ARC1 started with pid=12, OS id=28764
Sat Aug 27 00:54:31 2011
ARCH: STARTING ARCH PROCESSES COMPLETE
Sat Aug 27 00:54:31 2011
ARC1: Archival started
Sat Aug 27 00:54:31 2011
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no FAL' ARCHARC0: Thread not mounted
Sat Aug 27 00:54:31 2011
ARC1: Becoming the heartbeat ARCH
ARC1: Becoming the heartbeat ARCHARC1: Thread not mounted
Sat Aug 27 00:54:31 2011
ALTER DATABASE   MOUNT
Sat Aug 27 00:55:31 2011
ARC1: Thread not mounted
Sat Aug 27 00:56:31 2011
ARC1: Thread not mounted
Sat Aug 27 00:57:31 2011
ARC1: Thread not mounted
Sat Aug 27 00:58:31 2011
ARC1: Thread not mounted
Sat Aug 27 00:59:31 2011
ARC0: Thread not mounted
Sat Aug 27 00:59:31 2011
ARC1: Thread not mounted
在持续了20分钟后，还在出现ARC1: Thread not mounted时,通过在网上和metalink上搜索相关信息，采取措施：
1、重新起一个sqlplus的session
2、运行shutdown abort后，启动数据库,启动过程的问题现象依旧，反复出现“ARC0: Thread not mounted
Sat Aug 27 01:31:55 2011
ARC1: Thread not mounted”后，再次出现ORA-00600错误,部分alert.log如下:
Sat Aug 27 01:30:55 2011
ARC1: Thread not mounted
Sat Aug 27 01:31:55 2011
ARC0: Thread not mounted
Sat Aug 27 01:31:55 2011
ARC1: Thread not mounted
Sat Aug 27 01:32:00 2011
Errors in file /oracle/ora92/admin/ctais/udump/ctais_ora_1324.trc:
ORA-00600: internal error code, arguments: [2116], [900], [], [], [], [], [], []
Sat Aug 27 01:32:55 2011
ARC1: Thread not mounted
Sat Aug 27 01:33:55 2011
ARC1: Thread not mounted
我采取一直等待措施，一直等到20分钟后，数据库session因ORA-00600异常中断为止。
启动session中显示如下:
SQL> shutdown abort
ORACLE instance shut down.
SQL> startup
ORACLE instance started.

Total System Global Area 7520358264 bytes
Fixed Size                   745336 bytes
Variable Size            3221225472 bytes
Database Buffers         4294967296 bytes
Redo Buffers                3420160 bytes
ORA-00600: internal error code, arguments: [2116], [900], [], [], [], [], [],
[]

在网上查找很久，没有一个很好的关于ORA-00600[2116], [900]的解释，据国外一位网友介绍，一般在数据库进行I/0 CALL时才出现这种有关存储的错误。

我决定再干净的关闭一次数据库，试一把
 shutdown immediate,不一会儿，数据库干净的关闭，检查主机(HP-UX  B.11.11 U 9000/800 )层面的进程:
 ps -ef|grep ora,没有发现oracle相关进程,执行ipcs,没有ORACLE的共享内存，说明数据库关闭的比较干净。

由于两次启动数据库，均在mount时出现问题，网上的分析说，有可能和归档进程的争用有关，可以忽略提示。所以我准备这次分三个阶段启动数据库，
先做startup nomount  结果成功启动
再做alter database mount;
日志显示:
alter database mount
Sat Aug 27 01:59:04 2011
Successful mount of redo thread 1, with mount id 1142904611
Sat Aug 27 01:59:04 2011
Database mounted in Exclusive Mode.
Completed: alter database mount
终于成功mount了

最后做:alter database open
日志显示:
alter database open
Sat Aug 27 01:59:28 2011
LGWR: Primary database is in CLUSTER CONSISTENT mode
Thread 1 opened at log sequence 8034
  Current log# 2 seq# 8034 mem# 0: /dev/vgora/rlv_c01g02
Successful open of redo thread 1
Sat Aug 27 01:59:28 2011
SMON: enabling cache recovery
Sat Aug 27 01:59:45 2011
Successfully onlined Undo Tablespace 1.
Sat Aug 27 01:59:45 2011
SMON: enabling tx recovery
Sat Aug 27 01:59:45 2011
Database Characterset is US7ASCII
replication_dependency_tracking turned off (no async multimaster replication found)
Completed: alter database open
成功启动.

在前台操作业务也没有问题。
这时，再做一次干净的数据库关闭和启动，结果一些OK!
只是最后一次关闭数据库的时间比较长,等了5分钟,日志如下:
Shutting down instance (immediate)
License high water mark = 7
Sat Aug 27 02:02:28 2011
ALTER DATABASE CLOSE NORMAL
Sat Aug 27 02:07:33 2011
Waiting for smon to disable tx recovery.
Sat Aug 27 02:12:42 2011
SMON: disabling tx recovery
SMON: disabling cache recovery
Sat Aug 27 02:12:42 2011
Shutting down archive processes
Archiving is disabled
Sat Aug 27 02:12:42 2011
ARCH shutting down
Sat Aug 27 02:12:42 2011
ARCH shutting down
Sat Aug 27 02:12:42 2011
ARC0: Archival stopped
Sat Aug 27 02:12:42 2011
ARC1: Archival stopped
Sat Aug 27 02:12:42 2011
Thread 1 closed at log sequence 8034
Successful close of redo thread 1
Sat Aug 27 02:12:42 2011
Completed: ALTER DATABASE CLOSE NORMAL
Sat Aug 27 02:12:42 2011
ALTER DATABASE DISMOUNT
Completed: ALTER DATABASE DISMOUNT
ARCH: Archiving is disabled
Shutting down archive processes
Archiving is disabled
Archive process shutdown avoided: 0 active
ARCH: Archiving is disabled
Shutting down archive processes
Archiving is disabled
Archive process shutdown avoided: 0 active

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/543979/viewspace-705953/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/543979/viewspace-705953/