oracle 11g RAC 停机之后启动rac 时报 CRS-0184: Cannot communicate with the CRS daemon.

# ./crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.

检查日志

# pwd
/u01/app/11.2.0/grid/log/expquery01/crsd
# tail -200  crsd.log | more
....
2013-10-03 05:35:48.659: [    CRSD][1] ENV Logging level for Module: UiServer  0
2013-10-03 05:35:48.659: [ CRSMAIN][1] Checking the OCR device
2013-10-03 05:35:48.660: [ CRSMAIN][1] Sync-up with OCR
2013-10-03 05:35:48.660: [ CRSMAIN][1] Connecting to the CSS Daemon
2013-10-03 05:35:48.660: [ CRSMAIN][1] Getting local node number
2013-10-03 05:35:48.660: [ CRSMAIN][3] Policy Engine is not initialized yet!
2013-10-03 05:35:48.661: [ CRSMAIN][1] Initializing OCR
[   CLWAL][1]clsw_Initialize: OLR initlevel [70000]
2013-10-03 05:35:49.134: [  OCRASM][1]proprasmo: Error in open/create file in dg [DATA]
[  OCRASM][1]SLOS : SLOS: cat=8, opn=kgfoOpen01, dep=15056, loc=kgfokge

2013-10-03 05:35:49.134: [  OCRASM][1]ASM Error Stack :
2013-10-03 05:35:49.221: [  OCRASM][1]proprasmo: kgfoCheckMount returned [6]
2013-10-03 05:35:49.221: [  OCRASM][1]proprasmo: The ASM disk group DATA is not found or not mounted
2013-10-03 05:35:49.222: [  OCRRAW][1]proprioo: Failed to open [+DATA]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2013-10-03 05:35:49.222: [  OCRRAW][1]proprioo: No OCR/OLR devices are usable
2013-10-03 05:35:49.222: [  OCRASM][1]proprasmcl: asmhandle is NULL
2013-10-03 05:35:49.223: [    GIPC][1] gipcCheckInitialization: possible incompatible non-threaded init from [prom.c : 690], original from [clsss.c : 5326]
2013-10-03 05:35:49.226: [ default][1]clsvactversion:4: Retrieving Active Version from local storage.
2013-10-03 05:35:49.228: [ CSSCLNT][1]clssgsgrppubdata: group (ocr_expquer-cluster) not found

2013-10-03 05:35:49.228: [  OCRRAW][1]proprio_repairconf: Failed to retrieve the group public data. CSS ret code [20]
2013-10-03 05:35:49.251: [  OCRRAW][1]proprioo: Failed to auto repair the OCR configuration.
2013-10-03 05:35:49.251: [  OCRRAW][1]proprinit: Could not open raw device
2013-10-03 05:35:49.251: [  OCRASM][1]proprasmcl: asmhandle is NULL
2013-10-03 05:35:49.253: [  OCRAPI][1]a_init:16!: Backend init unsuccessful : [26]
2013-10-03 05:35:49.254: [  CRSOCR][1] OCR context init failure.  Error: PROC-26: Error while accessing the physical storage

2013-10-03 05:35:49.254: [ CRSMAIN][1] Created alert : (:CRSD00111:) :  Could not init OCR, error: PROC-26: Error while accessing the physical storage

2013-10-03 05:35:49.254: [    CRSD][1][PANIC] CRSD exiting: Could not init OCR, code: 26
2013-10-03 05:35:49.254: [    CRSD][1] Done.


问题判断：可能是停机之后服务器比存储先起来，导致crs启动的时候未找到存储。
尝试解决方案： 重启服务器

结果： reboot 每个节点之后，crs正常启动，然后成功开启每个实例。