故 障 简 述
近日我管辖的数据库在查询等待事件相关系统视图时出现“ORA-12805”错误提示,多次接收到Oracle_HOME文件系统使用率告警,随即进行如下的问题排查和分析;
分 析 过 程
查看出现大量生成trc文件的情况,经过简单的统计,每天大致产生300多个trc、trm文件,涉及多个Oracle后台进程,频繁触发文件系统目录使用率告警,随即检查数据库Alert日志,无其他异常信息。
随即转向排查trace文件,经过检查多个后台进程trc文件主要内容如下:
2020-10-23 02:39:52.490 :00000222:db_trace:ksl2.c@19742:ksl_update_post_stats():8960:55701: [10005:19999] KSL POST SENT postee=43 num=73 loc=’ksa2.h LINE:291 ID:ksasnd’ flags=0x0 id1=0 id2=02020-10-23 02:39:52.490 :00000223:db_trace:ksl2.c@18045:ksliwat():8960:55701: [10005:19999] KSL POST RCVD poster=42 num=2 loc=’ksa2.h LINE:295 ID:ksasnr’ id1=0 id2=0 name= type=0 fac#=2 posted=0x1 may_be_posted=12020-10-23 02:39:52.494 :00000224:db_trace:ksl2.c@18045:ksliwat():8960:55701: [10005:19999] KSL POST RCVD poster=43 num=2 loc=’ksa2.h LINE:295 ID:ksasnr’ id1=0 id2=0 name= type=0 fac#=2 posted=0x3 may_be_posted=12020-10-23 02:39:52.494 :00000225:db_trace:ksl2.c@19742:ksl_update_post_stats():8960:55701: [10005:19999] KSL POST SENT postee=44 num=74 loc=’ksa2.h LINE:291 ID:ksasnd’ flags=0x0 id1=0 id2=02020-10-23 02:39:52.494 :00000226:db_trace:ksl2.c@18045:ksliwat():8960:55701: [10005:19999] KSL POST RCVD poster=43 num=2 loc=’ksa2.h LINE:295 ID:ksasnr’ id1=0 id2=0 name= type=0 fac#=2 posted=0x1 may_be_posted=12020-10-23 02:39:52.498 :00000227:db_trace:ksl2.c@18045:ksliwat():8960:55701: [10005:19999] KSL POST RCVD poster=44 num=2 loc=’ksa2.h LINE:295 ID:ksasnr’ id1=0 id2=0 name= type=0 fac#=2 posted=0x3 may_be_posted=12020-10-23 02:39:52.498 :00000228:db_trace:ksl2.c@19742:ksl_update_post_stats():8960:55701: [10005:19999] KSL POST SENT postee=45 num=75 loc=’ksa2.h LINE:291 ID:ksasnd’ flags=0x0 id1=0 id2=02020-10-23 02:39:52.498 :00000229:db_trace:ksl2.c@18045:ksliwat():8960:55701: [10005:19999] KSL POST RCVD poster=44 num=2 loc=’ksa2.h LINE:295 ID:ksasnr’ id1=0 id2=0 name= type=0 fac#=2 posted=0x1 may_be_posted=12020-10-23 02:39:52.502 :0000022A:db_trace:ksl2.c@18045:ksliwat():8960:55701: [10005:19999] KSL POST RCVD poster=45 num=2 loc=’ksa2.h LINE:295 ID:ksasnr’ id1=0 id2=0 name= type=0 fac#=2 posted=0x3 may_be_posted=12020-10-23 02:39:52.502 :0000022B:db_trace:ksl2.c@19742:ksl_update_post_stats():8960:55701: [10005:19999] KSL POST SENT postee=46 num=76 loc=’ksa2.h LINE:291 ID:ksasnd’ flags=0x0 id1=0 id2=02020-10-23 02:39:52.502 :0000022C:db_trace:ksl2.c@18045:ksliwat():8960:55701: [10005:19999] KSL POST RCVD poster=45 num=2 loc=’ksa2.h LINE:295 ID:ksasnr’ id1=0 id2=0 name= type=0 fac#=2 posted=0x1 may_be_posted=1
解 决 方 案
根据trace文件信息,查阅相关资料,初步怀疑命中已知BUG【 bug29371157】,该BUG已经默认包含在12.2.0.1.190115DBRU【Patch28822515】里面,通过比对本地环境的Opatch信息,发现我们的数据库版本为12.2.0.1.181016,确认命中相关BUG,安排维护窗口,应用Opatch后,观察数据库运行正常,未出现日志快速增长等情况。