环境:
OS:AIX 7.1
DB:
主库:oracle RAC 11.2.0.4.0
备库:Oracle RAC 11.2.0.4.0
问题:
备库节点一,关闭selinux,重启服务器生效,数据库启动后,发现备库端可以接收主库归档,但是无法应用归档。
问题原因:
之前备库mrp进程在节点一上,备库重启服务器前,并没有将mrp进程切换到节点二上,备库节点一重启服务器后,没有马上执行mrp进程,导致备库没有应用主要归档日志。
此时DBA又手动执行了测试归档备份的脚步,即将所有归档文件备份到存储上,备份完成后自动删除所有归档。
从而导致了备库端部分还没有应用的归档文件被备份后删除。
解决过程:
查看备库归档应用和接收情况。
set line 300
select * from v$managed_standby;
手动启动备库节点1 mrp进程,启动非实时应用。
ALTER DATABASE RECOVER MANAGED STANDBY DATABASE DISCONNECT FROM SESSION;
告警日志:
MRP0 started with pid=62, OS id=23658926
MRP0: Background Managed Standby Recovery process started (cjcdb1)
......
Thu Oct 15 19:50:50 2020
Managed Standby Recovery not using Real Time Apply
备库正常接收主库归档
Thu Oct 15 19:38:36 2020
Archived Log entry 10425 added for thread 1 sequence 99925 ID 0xffffffffd79553a3 dest 1:
Thu Oct 15 19:38:38 2020
RFS[1]: Selected log 17 for thread 2 sequence 101427 dbid -678121821 branch 829764899
Thu Oct 15 19:38:38 2020
Archived Log entry 10426 added for thread 2 sequence 101426 ID 0xffffffffd79553a3 dest 1:
RFS[1]: Selected log 18 for thread 2 sequence 101428 dbid -678121821 branch 829764899
Thu Oct 15 19:38:47 2020
Archived Log entry 10427 added for thread 2 sequence 101427 ID 0xffffffffd79553a3 dest 1:
Thu Oct 15 19:38:48 2020
Archived Log entry 10428 added for thread 1 sequence 99926 ID 0xffffffffd79553a3 dest 1:
Thu Oct 15 19:38:48 2020
RFS[2]: Selected log 11 for thread 1 sequence 99927 dbid -678121821 branch 829764899
Thu Oct 15 19:46:56 2020
RFS[5]: Assigned to RFS process 22937884
RFS[5]: Opened log for thread 1 sequence 99926 dbid -678121821 branch 829764899
Archived Log entry 10429 added for thread 1 sequence 99926 rlc 829764899 ID 0xd79553a3 dest 2:
但是没有应用主库归档,因为部分归档日志已经删除。
查看告警日志,thread 1 中 缺少sequence 99924-99925,导致备库端应用归档日志中断。
Thu Oct 15 19:49:27 2020
Media Recovery Waiting for thread 1 sequence 99924
Fetching gap sequence in thread 1, gap sequence 99924-99925
Thu Oct 15 19:51:20 2020
FAL[client]: Failed to request gap sequence
GAP - thread 1 sequence 99924-99925
DBID 3616845475 branch 829764899
FAL[client]: All defined FAL servers have been attempted.
------------------------------------------------------------
Check that the CONTROL_FILE_RECORD_KEEP_TIME initialization
parameter is defined to a value that's sufficiently large
enough to maintain adequate log switch information to resolve
archivelog gaps.
------------------------------------------------------------
Thu Oct 15 20:00:16 2020
查看备库节点1本地归档日志,显示已经没有thread 1 sequence 99924-99925了。
rman target /
list archivelog all;
查看控制文件记录的备份中是存在thread 1 sequence 99924-99925归档
list backup of archivelog all;
手动将缺失的归档restore
restore archivelog sequence between 99924 and 99925 thread 1;
查看告警日志,99924正常恢复了
Thu Oct 15 19:08:51 2020
Media Recovery Log +BJ_SY_POS_ARCH/arch/2_101424_829764899.dbf
Media Recovery Log +BJ_SY_POS_ARCH/arch/1_99923_829764899.dbf
Media Recovery Waiting for thread 1 sequence 99924 (in transit)
thread 1恢复后,又提示thread 2 归档丢失,thread 2, gap sequence 101424-101427
Thu Oct 15 20:32:05 2020
Fetching gap sequence in thread 2, gap sequence 101424-101427
Thu Oct 15 20:33:58 2020
FAL[client]: Failed to request gap sequence
GAP - thread 2 sequence 101424-101427
DBID 3616845475 branch 829764899
FAL[client]: All defined FAL servers have been attempted.
------------------------------------------------------------
Check that the CONTROL_FILE_RECORD_KEEP_TIME initialization
parameter is defined to a value that's sufficiently large
enough to maintain adequate log switch information to resolve
archivelog gaps.
------------------------------------------------------------
手动将缺失的归档restore
restore archivelog sequence between 101424 and 101427 thread 2;
查看告警日志,mrp可以正常恢复归档了
Thu Oct 15 20:58:20 2020
Media Recovery Log +BJ_SY_POS_ARCH/arch/2_101424_829764899.dbf
Media Recovery Log +BJ_SY_POS_ARCH/arch/2_101425_829764899.dbf
Media Recovery Log +BJ_SY_POS_ARCH/arch/2_101426_829764899.dbf
Media Recovery Log +BJ_SY_POS_ARCH/arch/1_99925_829764899.dbf
Media Recovery Log +BJ_SY_POS_ARCH/arch/1_99926_829764899.dbf
Media Recovery Log +BJ_SY_POS_ARCH/arch/2_101427_829764899.dbf
欢迎关注我的微信公众号"IT小Chen",共同学习,共同成长!!
!