oracle集群一个节点无故挂掉,RAC环境异常 一个节点自动断掉

环境：oracle  11.02.04

oracle2:

[grid@oracle2 ~]$ crsctl status res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.DATA.dg

ONLINE  ONLINE       oracle2

ora.LISTENER.lsnr

ONLINE  ONLINE       oracle2

ora.asm

ONLINE  ONLINE       oracle2                  Started

ora.gsd

OFFLINE OFFLINE      oracle2

ora.net1.network

ONLINE  ONLINE       oracle2

ora.ons

ONLINE  ONLINE       oracle2

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1        ONLINE  ONLINE       oracle2

ora.LISTENER_SCAN2.lsnr

1        ONLINE  ONLINE       oracle2

ora.LISTENER_SCAN3.lsnr

1        ONLINE  ONLINE       oracle2

ora.cvu

1        ONLINE  ONLINE       oracle2

ora.oc4j

1        ONLINE  ONLINE       oracle2

ora.oracle1.vip

1        ONLINE  INTERMEDIATE oracle2                  FAILED OVER

ora.oracle2.vip

1        ONLINE  ONLINE       oracle2

ora.orcl.db

1        ONLINE  ONLINE       oracle2                  Open

ora.orcl.oracle.svc

1        ONLINE  ONLINE       oracle2

ora.scan1.vip

1        ONLINE  ONLINE       oracle2

ora.scan2.vip

1        ONLINE  ONLINE       oracle2

ora.scan3.vip

1        ONLINE  ONLINE       oracle2

节点1 oracle1

[grid@oracle1 ~]$ crsctl status res -t

CRS-4535: Cannot communicate with Cluster Ready Services

CRS-4000: Command Status failed, or completed with errors.

[grid@oracle1 ~]$

集群警告日志：alert

2020-02-26 18:22:28.654:

[crsd(9062)]CRS-2765:Resource 'ora.net1.network' has failed on server 'oracle1'.

2020-02-26 18:22:33.185:

[crsd(9062)]CRS-2765:Resource 'ora.oracle1.vip' has failed on server 'oracle1'.

2020-02-26 18:22:33.186:

[crsd(9062)]CRS-2771:Maximum restart attempts reached for resource 'ora.oracle1.vip'; will not restart.

2020-02-26 18:22:33.197:

[crsd(9062)]CRS-2769:Unable to failover resource 'ora.oracle1.vip'.

2020-02-26 18:22:33.232:

[crsd(9062)]CRS-2769:Unable to failover resource 'ora.oracle1.vip'.

2020-02-26 18:22:33.662:

[/u01/app/11.2.0/grid/bin/oraagent.bin(9174)]CRS-5016:Process "/u01/app/11.2.0/grid/bin/lsnrctl" spawned by agent "/u01/app/11.2.0/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010