Oracle启动错误处理一则

客户反映业务有问题，远程连接数据库一看，又发现一个老古董数据库，呵呵。闲话不说，看看解决过程。
主机版本为
[quote]# oslevel
4.3.3.0[/quote]
数据库版本为
[quote]SVRMGR> select * from v$version;
BANNER
----------------------------------------------------------------
Oracle8 Enterprise Edition Release 8.0.6.0.0 - Production
PL/SQL Release 8.0.6.0.0 - Production
CORE Version 4.0.6.0.0 - Production
TNS for IBM/AIX RISC System/6000: Version 8.0.6.0.0 - Production
NLSRTL Version 3.3.3.0.0 - Production
已选择5行。[/quote]
用svrmgrl进入数据库，真是老古董了
[quote]% svrmgrl

Oracle Server Manager Release 3.0.6.0.0 - Production

Oracle 公司，版权 (c) 1999。保留所有权利

Oracle8 Enterprise Edition Release 8.0.6.0.0 - Production
PL/SQL Release 8.0.6.0.0 - Production

SVRMGR> connect internal/oracle
连接成功。
SVRMGR> startup mount
已启动 ORACLE 实例。
系统全局区域合计有 178472000个字节
Fixed Size 50240个字节
Variable Size 61607936个字节
Database Buffers 116736000个字节
Redo Buffers 77824个字节
已装入数据库。[/quote]

查看数据文件物理位置
[quote]SVRMGR> select file#,name from v$datafile;
FILE# NAME
---------- --------------------------------------------------------------------------------
1 /u01/oradata/oracle8/system01.dbf
2 /u01/oradata/oracle8/rbs01.dbf
3 /u01/oradata/oracle8/temp01.dbf
4 /u01/oradata/oracle8/tools01.dbf
5 /u01/oradata/oracle8/users01.dbf
6 /u01/oradata/oracle8/usr_data01.dbf
7 /u02/oradata/oracle8/usr_data02.dbf
8 /u03/oradata/oracle8/usr_data03.dbf
9 /u01/oradata/oracle8/ind_data01.dbf
10 /u02/oradata/oracle8/ind_data02.dbf
11 /u03/oradata/oracle8/ind_data03.dbf
12 /u01/oradata/oracle8/usr_data07.dbf
13 /u02/oradata/oracle8/usr_data08.dbf
14 /u03/oradata/oracle8/usr_data09.dbf
15 /u02/oradata/oracle8/usr_data05.dbf
16 /u03/oradata/oracle8/usr_data06.dbf
17 /u02/oradata/oracle8/ind_data05.dbf
18 /u03/oradata/oracle8/ind_data06.dbf
19 /u03/oradata/oracle8/usr_data10.dbf
20 /u03/oradata/oracle8/ind_data07.dbf
21 /u03/oradata/oracle8/usr_data11.dbf
22 /u01/oradata/oracle8/usr_data10.dbf
23 /u01/oradata/oracle8/usr_data12.dbf
24 /u02/oradata/oracle8/usr_data13.dbf
25 /u01/oradata/oracle8/usr_data14.dbf
26 /u01/oradata/oracle8/usr_data15.dbf
27 /u03/oradata/oracle8/usr_data16.dbf
28 /u02/oradata/oracle8/usr_data17.dbf
29 /u03/oradata/oracle8/usr_data18.dbf
30 /u01/oradata/oracle8/usr_data19.dbf
31 /u02/oradata/oracle8/temp02.dbf
32 /u01/oradata/oracle8/usr_data21.dbf
33 /u01/oradata/oracle8/usr_data20.dbf
34 /u01/oradata/oracle8/usr_data22.dbf
35 /u04/oradata/oracle8/usr_data20.dbf
36 /u04/oradata/oracle8/usr_data23.dbf
37 /u06/oradata/oracle8/usr_data25.dbf
38 /u06/oradata/oracle8/usr_data26.dbf
39 /u06/oradata/oracle8/usr_data27.dbf
已选择39行。[/quote]

查看alert日志信息
[quote]% tail -f *.log
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
Mon Mar 8 15:55:42 2010
Errors in file /oracle/app/oracle/admin/oracle8/bdump/dbw0_13420_oracle8.trc:
ORA-01157: cannot identify data file 36 - file not found
ORA-01110: data file 36: '/u04/oradata/oracle8/usr_data23.dbf'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
ORA-1157 signalled during: alter database open ...
Tue Mar 9 09:49:25 2010
alter database open
Tue Mar 9 09:49:25 2010
Errors in file /oracle/app/oracle/admin/oracle8/bdump/dbw0_13420_oracle8.trc:
ORA-01157: cannot identify data file 37 - file not found
ORA-01110: data file 37: '/u06/oradata/oracle8/usr_data25.dbf'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
Tue Mar 9 09:49:25 2010
Errors in file /oracle/app/oracle/admin/oracle8/bdump/dbw0_13420_oracle8.trc:
ORA-01157: cannot identify data file 38 - file not found
ORA-01110: data file 38: '/u06/oradata/oracle8/usr_data26.dbf'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
Tue Mar 9 09:49:25 2010
Errors in file /oracle/app/oracle/admin/oracle8/bdump/dbw0_13420_oracle8.trc:
ORA-01157: cannot identify data file 39 - file not found
ORA-01110: data file 39: '/u06/oradata/oracle8/usr_data27.dbf'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
Tue Mar 9 09:49:27 2010
ORA-1157 signalled during: alter database open...[/quote]

查看vg使用情况
[quote]% lsvg -o
ora2vg
oravg
rootvg


# lsvg -l oravg
oravg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
oralv1 jfs 416 832 4 open/syncd /u01
oralv2 jfs 304 608 4 open/syncd /u02
oralv3 jfs 354 708 4 open/syncd /u03
loglv00 jfslog 1 1 1 open/syncd N/A


% lsvg -l ora2vg
ora2vg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
loglv01 jfslog 1 1 1 open/syncd N/A
lv00 jfs 153 153 1 closed/syncd /u04
lv02 jfs 306 306 1 open/syncd /u06[/quote]

查看文件系统mount点
[quote]# more /etc/filesystems
* @(#)filesystems @(#)29 1.20 src/bos/etc/filesystems/filesystems, cmdfs, bos430, 9737A_430 4/16/93 15:38:14
* IBM_PROLOG_BEGIN_TAG
* This is an automatically generated prolog.
*
* bos430 src/bos/etc/filesystems/filesystems 1.20
*
* Licensed Materials - Property of IBM
*
* (C) COPYRIGHT International Business Machines Corp. 1985,1993
* All Rights Reserved
*
* US Government Users Restricted Rights - Use, duplication or
* disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
*
* IBM_PROLOG_END_TAG
*
* COMPONENT_NAME: CMDFS
*
* FUNCTIONS: none
*
* ORIGINS: 27
*
* (C) COPYRIGHT International Business Machines Corp. 1985, 1993
* All Rights Reserved
* Licensed Materials - Property of IBM
*
* US Government Users Restricted Rights - Use, duplication or
* disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
*
*
*
* This version of /etc/filesystems assumes that only the root file system
* is created and ready. As new file systems are added, change the check,
* mount, free, log, vol and vfs entries for the appropriate stanza.
*

/:
dev = /dev/hd4
vfs = jfs
log = /dev/hd8
mount = automatic
check = false
type = bootfs
vol = root
free = true

/home:
dev = /dev/hd1
vol = "/home"
mount = true
check = true
free = false
vfs = jfs
log = /dev/hd8

/usr:
dev = /dev/hd2
vfs = jfs
log = /dev/hd8
mount = automatic
check = false
type = bootfs
vol = /usr
free = false

/var:
dev = /dev/hd9var
vfs = jfs
log = /dev/hd8
mount = automatic
check = false
type = bootfs
vol = /var
free = false

/tmp:
dev = /dev/hd3
vfs = jfs
log = /dev/hd8
mount = automatic
check = false
vol = /tmp
free = false

/mnt:
dev = /dev/cd0
vfs = cdrfs
mount = false
options = ro
account = false

/cdrom:
dev = /dev/cd0
vfs = cdrfs
mount = false
options = ro
account = false

/oracle:
dev = /dev/oralv0
vfs = jfs
log = /dev/hd8
mount = true
options = rw
account = false

/u03:
dev = /dev/oralv3
vfs = jfs
log = /dev/loglv00
mount = true
options = rw
account = false

/u01:
dev = /dev/oralv1
vfs = jfs
log = /dev/loglv00
mount = true
options = rw
account = false

/u02:
dev = /dev/oralv2
vfs = jfs
log = /dev/loglv00
mount = true
options = rw
account = false

/u04:
dev = /dev/lv00
vfs = jfs
log = /dev/loglv01
mount = true
options = rw
account = false

/u06:
dev = /dev/lv02
vfs = jfs
log = /dev/loglv01
mount = true
options = rw
account = false[/quote]

mount文件系统报错：
[quote]# mount /u04
Replaying log for /dev/lv00.
mount: 0506-324 Cannot mount /dev/lv00 on /u04: The media is not formatted or the format is not correct.
0506-342 The superblock on /dev/lv00 is dirty. Run a full fsck to fix.[/quote]

用fsck检查lv/dev/lv00
[quote]# fsck -y /dev/lv00

** Checking /dev/rlv00 (/u04)
** Phase 0 - Check Log
log redo processing for /dev/rlv00
** Phase 1 - Check Blocks and Sizes
^[** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
** Phase 5 - Check Inode Map
** Phase 6 - Check Block Map
Superblock is marked dirty (FIXED)
12 files 4729984 blocks 15324032 free
***** Filesystem was modified *****[/quote]

再次mount文件系统：
[quote]# mount /u04
# df
Filesystem 512-blocks Free %Used Iused %Iused Mounted on
/dev/hd4 196608 169512 14% 1494 4% /
/dev/hd2 5570560 2978896 47% 45699 7% /usr
/dev/hd9var 1114112 918856 18% 566 1% /var
/dev/hd3 196608 160680 19% 496 3% /tmp
/dev/hd1 65536 63240 4% 25 1% /home
/dev/oralv0 4194304 2965096 30% 4562 1% /oracle
/dev/oralv3 23199744 3725784 84% 32 1% /u03
/dev/oralv1 27262976 2446056 92% 41 1% /u01
/dev/oralv2 19922944 1761400 92% 30 1% /u02
/dev/lv00 20054016 15324032 24% 21 1% /u04[/quote]

打开数据库：
[quote]SVRMGR> alter database open;
语句已处理。[/quote]