各位高手,本人目前遇到一个头疼问题,如标题所见, oracle 10g bdump 下的 sid_smon_xxxx.trc 文件非常大,造成磁盘空间满,系统无法运行,请各位高台贵手,顺便解决了,不胜感激!
数据库运行在win2003 server 企业版上,数据库版本 为 10.2.0.1 ,目前,数据库 里面 有 几个类似 sid_smon_xxxx.trc的文件,非常大,每个都有几个G,造成磁盘空间满、系统停摆。目前已经将数据库中几个大的trc文件移走,暂时解决问题,但是实在找不到原因,随时可能磁盘满,非常头大。
几个trc文件并非连续日期产生的,不知道触发条件是什么。
数据库之前出过一次故障,系统一个表空间下的较大的表出现坏段问题,导致该表无法访问,只好重建新表替换旧表。旧表改名备份。
该故障目前在alert日志中提示如下,该提示出现很多次:
Wed Dec 29 09:40:32 2010
SMON: Restarting fast_start parallel rollback
SMON: ignoring slave err,downgrading to serial rollback
ORACLE Instance hybhdb (pid = 8) - Error 1578 encountered while recovering transaction (1, 28) on object 52188.
Wed Dec 29 09:40:32 2010
Errors in file d:\oracle\product\10.2.0\admin\hybhdb\bdump\hybhdb_smon_1648.trc:
ORA-01578: ORACLE data block corrupted (file # 5, block # 126104)
ORA-01110: data file 5: 'D:\ORACLE\PRODUCT\10.2.0\ORADATA\HYBHDB\HYBHOA.ORA'
Wed Dec 29 09:45:34 2010
SMON: Restarting fast_start parallel rollback
SMON: ignoring slave err,downgrading to serial rollback
ORACLE Instance hybhdb (pid = 8) - Error 1578 encountered while recovering transaction (1, 28) on object 52188.
Wed Dec 29 09:45:34 2010
Errors in file d:\oracle\product\10.2.0\admin\hybhdb\bdump\hybhdb_smon_1648.trc:
ORA-01578: ORACLE data block corrupted (file # 5, block # 126104)
ORA-01110: data file 5: 'D:\ORACLE\PRODUCT\10.2.0\ORADATA\HYBHDB\HYBHOA.ORA'
本人目前是半路出家的oracle数据库免费管理员,以前一直做开发方面,对oracle 数据库体系可谓略懂
皮毛而已。我看了smon进程的说明,怀疑造成trc文件巨大的原因,可能与 smon进程和表的坏段有关。
但是为什么会不停写入到trc文件,实在是不知道原因。
更不知道如何解决了。
我打开过其中一个2G左右的trc文件,实在看不懂。
我已经将坏段所在的表drop掉了,不过数据库没有重启,好像现在还在告警,并且不停的写到trc文件中。该文件已经高达8G左右了。
盼高手出手,解惑!
下面是提取的一点trc文件内容,不知道有用与否:
*** SESSION ID
164.1) 2010-12-02 20:11:12.671
Parallel Transaction recovery caught exception 12801
Parallel Transaction recovery caught error 1578
*** 2010-12-02 20:11:13.109
SMON: Restarting fast_start parallel rollback
Parallel Transaction recovery caught exception 12801
Parallel Transaction recovery caught error 1578
SMON: ignoring slave err,downgrading to serial rollback
ORACLE Instance hybhdb (pid = 8) - Error 1578 encountered while recovering transaction (1, 28) on object 52188.
*** 2010-12-02 20:11:13.140
ksedmp: internal or fatal error
ORA-01578: ORACLE data block corrupted (file # 5, block # 126104)
ORA-01110: data file 5: 'D:\ORACLE\PRODUCT\10.2.0\ORADATA\HYBHDB\HYBHOA.ORA'
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
_ksedst+38 CALLrel _ksedst1+0 0 1
_ksedmp+898 CALLrel _ksedst+0 0
_kturrt+1740 CALLrel _ksedmp+0 3
_kturec+755 CALLrel _kturrt+0 689EE8C 1C 1 0 1 4 1
_kturax+382 CALLrel _kturec+0 1 0 1 0 FFFF 1 4
_ktprbeg+4732 CALLrel _kturax+0 0 0
_ktmmon+1331 CALLrel _ktprbeg+0 0
_ktmSmonMain+21 CALLrel _ktmmon+0 3C4B140
_ksbrdp+747 CALLreg 00000000 3C4B140
_opirip+674 CALLrel _ksbrdp+0
_opidrv+857 CALLrel _opirip+0 32 4 689FEC0
_sou2o+45 CALLrel _opidrv+0 32 4 689FEC0
_opimai_real+227 CALLrel _sou2o+0 689FEB4 32 4 689FEC0
_opimai+92 CALLrel _opimai_real+0 3 689FEEC
_BackgroundThreadSt CALLrel _opimai+0
[email=art@4+422]art@4+422[/email]
7C82482C CALLreg 00000000
--------------------- Binary Stack Dump ---------------------
========== FRAME [1] (_ksedst+38 -> _ksedst1+0) ==========
Dump of memory from 0x0689EA7C to 0x0689EA8C
689EA70 0689EA8C [....]
689EA80 0040468B 00000000 00000001 [.F@.........]
========== FRAME [2] (_ksedmp+898 -> _ksedst+0) ==========
Dump of memory from 0x0689EA8C to 0x0689EB4C
689EA80 0689EB4C [L...]
689EA90 00403083 00000000 00001DE2 0689EDD0 [.0@.............]
689EAA0 00000004 0689EC58 0689EE8C 0689ED7C [....X.......|...]
689EAB0 000016A0 00000000 0000001B 00000000 [................]
689EAC0 068A0048 00000000 00000000 00000000 [H...............]
689EAD0 00000000 00000000 00000000 00000000 [................]
689EAE0 3DF5DF1C 0689EB04 00000000 00000000 [...=............]
689EAF0 00000000 031C165C 00000070 00000000 [....\...p.......]
689EB00 00000000 0689ED5C 00000001 00000000 [....\...........]
689EB10 00000000 00000000 00000000 00000000 [................]
689EB20 00000000 068A05A4 0689ED5C 00000000 [........\.......]
689EB30 0689EB48 0689EA98 00000001 0689EE1C [H...............]
689EB40 0261348C 031C1800 FFFFFFFF [.4a.........]
========== FRAME [3] (_kturrt+1740 -> _ksedmp+0) ==========
Dump of memory from 0x0689EB4C to 0x0689EE2C
689EB40 0689EE2C [,...]
689EB50 00940909 00000003 4341524F 4920454C [........ORACLE I]
689EB60 6174736E 2065636E 68627968 28206264 [nstance hybhdb (]
689EB70 20646970 2938203D 45202D20 726F7272 [pid = 8) - Error]
689EB80 37353120 6E652038 6E756F63 65726574 [ 1578 encountere]
689EB90 68772064 20656C69 6F636572 69726576 [d while recoveri]
689EBA0 7420676E 736E6172 69746361 28206E6F [ng transaction (]
689EBB0 32202C31 6F202938 626F206E 7463656A [1, 28) on object]
689EBC0 31323520 0A2E3838 00400100 00000000 [ 52188....@.....]
689EBD0 0689EBB8 EBAD3201 0689F1E8 7C958290 [.....2.........|]
689EBE0 7C95B050 0689EC10 7C95D5E3 00400000 [P..|.......|..@.]
689EBF0 00000001 00003970 0689EC20 7C342526 [....p9.. ...&%4|]
689EC00 0689F1E8 0689F1E8 7C34252E 3DE49C7C [.........%4||..=]
689EC10 00000000 00000000 000001E0 3D1860CC [.............`.=]
689EC20 068A0048 0689EE8C 00000008 00000000 [H...............]
689EC30 03C38510 3DE49F4C 00000000 0689F000 [....L..=........]
689EC40 00000018 3D3CD640 0689EC68 004672DB [....@.<=h....rF.]
689EC50 00000018 3D1860CC 00000001 0081954F [.....`.=....O...]
689EC60 FFFFFFFF 00000000 00030000 00001FE8 [................]
689EC70 FFFFFFFF 00000012 00000000 00000000 [................]
689EC80 00000000 380F0014 00000000 00000000 [.......8........]
689EC90 00000000 00000000 00000000 00000000 [................]
Repeat 1 times
689ECB0 00000000 00000000 00000000 FFFFFFFF [................]
689ECC0 0000FFFF 00000187 00000000 00000002 [................]
689ECD0 00000063 00000000 00000000 00000000 [c...............]
689ECE0 00000000 00000000 3D3CD658 00000008 [........X.<=....]
689ECF0 3D3CD634 3D186304 3DE49C7C 00000000 [4.<=.c.=|..=....]
689ED00 3D1860CC 0689ED18 68627968 3D006264 [.`.=....hybhdb.=]
689ED10 3D1860CC 00000000 0689ED40 0049926D [.`.=....@...m.I.]
689ED20 00000000 3D2BC500 20000008 00000000 [......+=... ....]
689ED30 3D2BC540 FFFFFFFF 00000001 0689EE8C [@.+=............]
689ED40 00000000 017C0000 00000000 3D2BC578 [......|.....x.+=]
689ED50 00000000 00000000 02002001 00000000 [......... ......]
689ED60 00000002 00000006 068A097E 0689EF2C [........~...,...]
689ED70 06AA3460 00000001 3D2ACB02 068A0048 [`4........*=H...]
689ED80 001B0002 0081954F 001B1DE2 00000000 [....O...........]
689ED90 00000000 EBAD062A 00000000 00000000 [....*...........]
689EDA0 068A0048 3B6F5E68 0689EE04 00579106 [H...h^o;......W.]
689EDB0 3B6F5E68 0000062A 068A05A4 00000001 [h^o;*...........]
689EDC0 00000054 4CF78CE0 00000000 00000000 [T......L........]
689EDD0 001C0001 000018CC 3D434450 00000064 [........PDC=d...]
689EDE0 00000000 381A37D0 0000000A 00000001 [.....7.8........]
689EDF0 381A3C98 3D485290 00001FE8 381A37D0 [.<.8.rh>
689EE00 00000000 0689EFA0 0689EE8C 381A3004 [.............0.8]
689EE10 0000000D 0689EB58 0689DF34 0689EF90 [....X...4.......]
689EE20 0261348C 03462CB4 FFFFFFFF [.4a..,F.....]
========== FRAME [4] (_kturec+755 -> _kturrt+0) ==========
Dump of memory from 0x0689EE2C to 0x0689EFA0
689EE20 0689EFA0 [....]
689EE30 0093FF78 0689EE8C 0000001C 00000001 [x...............]
689EE40 00000000 00000001 00000004 00000001 [................]
689EE50 00000000 00000000 603B1889 3DB457A0 [..........;`.W.=]
689EE60 3BFEDEB0 3DB45798 0689EEB0 600002C1 [...;.W.=.......`]
689EE70 03C3A35C 00000000 0501D708 3BFEDE68 [\...........h..;]
689EE80 3DB45798 00000000 068A0048 00000001 [.W.=....H.......]
689EE90 00800009 FFFFFFFF 00000000 00030000 [................]
689EEA0 00001FE8 FFFFFFFF 00000011 00000000 [................]
689EEB0 00000000 00000000 381A2014 00001008 [......... .8....]
689EEC0 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
689EEF0 FFFFFFFF 0000FFFF 0000017C 00000000 [........|.......]
689EF00 00000002 00000062 00000000 00000000 [....b...........]
689EF10 00000000 00000000 00000000 00000001 [................]
689EF20 3CFE6E7C 00000000 00001FE8 0689F01C [|n.<............>
689EF30 00000000 00000001 3D47DB00 00000000 [..........G=....]
689EF40 00000000 381A37D0 00000000 00000000 [.....7.8........]
689EF50 00000000 00000000 00000000 00000001 [................]
689EF60 068A05A4 00000000 00000030 3C00001C [........0......
689EF70 068A05A4 068A04A8 00000000 0689F034 [............4...]
689EF80 068A05A4 068A0048 0689EE50 0689EFA8 [....H...P.......]
689EF90 0689F07C 0261348C 03462C9C 00000000 [|....4a..,F.....]
========== FRAME [5] (_kturax+382 -> _kturec+0) ==========
Dump of memory from 0x0689EFA0 to 0x0689F08C
689EFA0 0689F08C 0093F303 00000001 00000000 [................]
689EFB0 00000001 00000000 0000FFFF 00000001 [................]
689EFC0 00000004 0000000F 068A05A4 068A04A8 [................]
689EFD0 3DE49C7C 00000000 0689F090 0040D5D1 [|..=..........@.]
689EFE0 3DF5DF10 00000002 068A0048 00000005 [...=....H.......]
689EFF0 0689F050 7C80BEF7 0689F000 068A04A8 [P......|........]
689F000 EBAD062A 00000000 00000000 00000000 [*...............]
689F010 00000000 00000000 00000000 0689F3A4 [................]
689F020 00000000 00000001 03C3C400 00000000 [................]
689F030 00000000 00000000 3CFE6D80 3CFE6E70 [.........m.
689F040 00000000 068A05A4 00000000 00000000 [................]
689F050 0689F084 3CFE6E7C 00000000 00000000 [....|n.<........>
689F060 00000000 068A05A4 068A0048 00000000 [........H.......]
689F070 00007FFF 0689EFC4 068A0048 0689F1E8 [........H.......]
689F080 0261348C 03462C6C 00000000 [.4a.l,F.....]
========== FRAME [6] (_ktprbeg+4732 -> _kturax+0) ==========
Dump of memory from 0x0689F08C to 0x0689F1F8
689F080 0689F1F8 [....]
689F090 011737A5 00000000 00000000 00000000 [.7..............]
689F0A0 00000001 00000004 068A09C4 00000000 [................]
689F0B0 00000001 00000005 068A09C4 0689F0CC [................]
689F0C0 06AA3460 00000001 068A0002 0689F3A4 [`4..............]
689F0D0 06AA3460 00000001 00000002 00000000 [`4..............]
689F0E0 00000001 00000004 068A0930 00000005 [........0.......]
689F0F0 00002710 EBAD062A 0689F198 EBAD3201 [.'..*........2..]
689F100 03C3C3D0 3D4AD56C 00000000 068A0048 [....l.J=....H...]
689F110 00000005 00002710 0689F144 00002710 [.....'..D....'..]
689F120 00000024 00000001 00000012 068A05A4 [$...............]
689F130 3DF5CB3C 0000000F 3D4AEE4C 068A05A4 [<..>
689F140 0689F1E8 00483FAE 3DF5CB3C 00000002 [.....?H.<..>
689F150 00000000 00000000 00000000 0000062A [............*...]
689F160 068A05A4 00000000 00000001 068A05A4 [................]
689F170 00002710 EBAD7669 00003201 3D4B90B4 [.'..iv...2....K=]
689F180 0689F104 3D4AEEB0 0689F3A4 0261348C [......J=.....4a.]
689F190 00000000 FFFFFF00 0689F3A4 06AA0020 [............ ...]
689F1A0 00000001 00000002 00007669 00000000 [........iv......]
689F1B0 00000000 00000001 00000000 00000000 [................]
689F1C0 00000001 00000001 00000010 00000000 [................]
689F1D0 068A05A4 0689F3A4 00000001 00000000 [................]
689F1E0 0689F09C 0689EC3C 0689F408 0261348C [....<........4a.>
689F1F0 035CB3A4 FFFFFFFF