CRS-0184: Cannot communicate with the CRS daemon.之节点脱离集群问题解决

报错信息：
[grid@rac01 ~]$ crs_stat -t               
CRS-0184: Cannot communicate with the CRS daemon.   
报错原因查找：
在节点1节点查看IP地址，VIP已经不存在

在节点2上运行“crs_stat -t”发现，节点1好像已经退出集群环境
[root@rac02 ~]# su - grid
[grid@rac02 ~]$  crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type ONLINE    ONLINE    rac02      
ora....ER.lsnr ora....er.type ONLINE    OFFLINE               
ora....N1.lsnr ora....er.type ONLINE    ONLINE    rac02      
ora.asm        ora.asm.type   ONLINE    ONLINE    rac02      
ora.cvu        ora.cvu.type   ONLINE    ONLINE    rac02      
ora.gsd        ora.gsd.type   OFFLINE   OFFLINE               
ora....network ora....rk.type ONLINE    ONLINE    rac02      
ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    rac02      
ora.ons        ora.ons.type   ONLINE    ONLINE    rac02      
ora.rac01.vip  ora....t1.type ONLINE    ONLINE    rac02      
ora....SM2.asm application    ONLINE    ONLINE    rac02      
ora....02.lsnr application    OFFLINE   OFFLINE               
ora.rac02.gsd  application    OFFLINE   OFFLINE               
ora.rac02.ons  application    ONLINE    ONLINE    rac02      
ora.rac02.vip  ora....t1.type ONLINE    ONLINE    rac02      
ora....ry.acfs ora....fs.type ONLINE    ONLINE    rac02      
ora.scan1.vip  ora....ip.type ONLINE    ONLINE    rac02      

问题解决：
清理节点1的配置信息，重新运行root.sh
[root@rac01 ~]# /u01/app/11.2.0/grid/crs/install/rootcrs.pl -verbose -deconfig -force
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
PRCR-1119 : Failed to look up CRS resources of ora.cluster_vip_net1.type type
PRCR-1068 : Failed to query resources
Cannot communicate with crsd
PRCR-1070 : Failed to check if resource ora.gsd is registered
Cannot communicate with crsd
PRCR-1070 : Failed to check if resource ora.ons is registered
Cannot communicate with crsd

CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Stop failed, or completed with errors.
CRS-4544: Unable to connect to OHAS
CRS-4000: Command Stop failed, or completed with errors.
ACFS-9313: No ADVM/ACFS installation detected.
Successfully deconfigured Oracle clusterware stack on this node
#
#
# /u01/app/11.2.0/grid/crs/install/roothas.pl -verbose -deconfig -force
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Delete failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
You must kill ohasd processes or reboot the system to properly
cleanup the processes started by Oracle clusterware
ACFS-9313: No ADVM/ACFS installation detected.
Either /etc/oracle/olr.loc does not exist or is not readable
Make sure the file exists and it has read and execute access
Failure in execution (rc=-1, 512, A file or directory in the path name does not exist.) for command /etc/ohasd deinstall
Successfully deconfigured Oracle Restart stack



环境清理后，root用户下运行root.sh
[root@rac01 grid]# ./u01/app/11.2.0/grid/root.sh
-bash: ./u01/app/11.2.0/grid/root.sh: 没有那个文件或目录
[root@rac01 grid]# /u01/app/11.2.0/grid/./root.sh
Performing root user operation for Oracle 11g

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
User ignored Prerequisites during installation
Installing Trace File Analyzer
OLR initialization - successful
Adding Clusterware entries to upstart
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac02, number 2, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
PRKO-2190 : 节点 rac01 存在 VIP, VIP 名称 rac01-vip
Preparing packages for installation...
cvuqdisk-1.0.9-1
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@rac01 grid]#

验证
[root@rac01 ~]# su - grid
[grid@rac01 ~]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type ONLINE    ONLINE    rac01      
ora....ER.lsnr ora....er.type OFFLINE   OFFLINE               
ora....N1.lsnr ora....er.type ONLINE    ONLINE    rac02      
ora.asm        ora.asm.type   ONLINE    ONLINE    rac01      
ora.cvu        ora.cvu.type   ONLINE    ONLINE    rac02      
ora.gsd        ora.gsd.type   OFFLINE   OFFLINE               
ora....network ora....rk.type ONLINE    ONLINE    rac01      
ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    rac02      
ora.ons        ora.ons.type   ONLINE    ONLINE    rac01      
ora....SM1.asm application    ONLINE    ONLINE    rac01      
ora....01.lsnr application    OFFLINE   OFFLINE               
ora.rac01.gsd  application    OFFLINE   OFFLINE               
ora.rac01.ons  application    ONLINE    ONLINE    rac01      
ora.rac01.vip  ora....t1.type ONLINE    ONLINE    rac01      
ora....SM2.asm application    ONLINE    ONLINE    rac02      
ora....02.lsnr application    OFFLINE   OFFLINE               
ora.rac02.gsd  application    OFFLINE   OFFLINE               
ora.rac02.ons  application    ONLINE    ONLINE    rac02      
ora.rac02.vip  ora....t1.type ONLINE    ONLINE    rac02      
ora....ry.acfs ora....fs.type ONLINE    ONLINE    rac01      
ora.scan1.vip  ora....ip.type ONLINE    ONLINE    rac02