Data Guard 故障一则：主库归档删除失败（RMAN-08137）

现象描述：

Oracle(2节点RAC+单实例Data Guard)，主备库因为某些原因产生GAP之后，主库rman无法删除归档日志，报错信息如下：

主库实例alert日志：
Thu Dec 10 09:51:50 2020
ARCn: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (270)
ARC6: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
ARCn: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Thu Dec 10 09:51:50 2020
ARC5: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (270)
Thu Dec 10 09:51:50 2020
ARCm: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (270)
ARC5: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
ARCm: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Thu Dec 10 09:51:50 2020
ARCk: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (270)
ARCk: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
FAL[server, ARCl]: Error 270 creating remote archivelog file ‘TESTstd’
FAL[server, ARC3]: FAL archive failed, see trace file.
ARCH: FAL archive failed. Archiver continuing
ORACLE Instance TEST1 - Archival Error. Archiver continuing.
FAL[server, ARCp]: Error 270 creating remote archivelog file ‘TESTstd’
FAL[server, ARCq]: FAL archive failed, see trace file.
ARCH: FAL archive failed. Archiver continuing
ORACLE Instance TEST1 - Archival Error. Archiver continuing.
FAL[server, ARCr]: Error 270 creating remote archivelog file ‘TESTstd’
FAL[server, ARC0]: Error 270 creating remote archivelog file ‘TESTstd’