CRS-0184: Cannot communicate with the CRS daemon.之存储故障解决办法

$crs_stat-t

CRS-0184: Cannot communicate with the CRSdaemon.

$crsctlcheck crs

CRS-4638: Oracle High Availability Servicesis online

CRS-4535: Cannot communicate with ClusterReady Services

CRS-4529: Cluster Synchronization Servicesis online

CRS-4533: Event Manager is online

查看CRS日志

#find/ -name crsd.log

2014-12-09 12:02:56.530: [ CRSMAIN][1]Checking the OCR device

2014-12-09 12:02:56.531: [ CRSMAIN][1]Sync-up with OCR

2014-12-09 12:02:56.531: [ CRSMAIN][1]Connecting to the CSS Daemon

2014-12-09 12:02:56.531: [ CRSMAIN][1]Getting local node number

2014-12-09 12:02:56.533: [ CRSMAIN][1]Initializing OCR

[  CLWAL][1]clsw_Initialize: OLR initlevel [70000]

2014-12-09 12:02:56.993: [  OCRASM][1]proprasmo: Error in open/createfile in dg [OCR]

[ OCRASM][1]SLOS : SLOS: cat=8, opn=kgfoOpen01, dep=15056, loc=kgfokge

 

2014-12-09 12:02:56.993: [  OCRASM][1]ASM Error Stack :

2014-12-09 12:02:57.053: [  OCRASM][1]proprasmo: kgfoCheckMount returned[6]

2014-12-09 12:02:57.053: [  OCRASM][1]proprasmo: The ASM disk group OCRis not found or not mounted

2014-12-09 12:02:57.054: [  OCRRAW][1]proprioo: Failed to open [+OCR].Returned proprasmo() with [26]. Marking location as UNAVAILABLE.

2014-12-09 12:02:57.054: [  OCRRAW][1]proprioo: No OCR/OLR devices areusable

2014-12-09 12:02:57.054: [  OCRASM][1]proprasmcl: asmhandle is NULL

2014-12-09 12:02:57.056: [    GIPC][1] gipcCheckInitialization: possibleincompatible non-threaded init from [prom.c : 690], original from [clsss.c :5343]

2014-12-09 12:02:57.082: [default][1]clsvactversion:4: Retrieving Active Version from local storage.

2014-12-09 12:02:57.100: [CSSCLNT][1]clssgsgrppubdata: group (ocr_testvhf-cluster) not found

 

2014-12-09 12:02:57.100: [  OCRRAW][1]proprio_repairconf: Failed toretrieve the group public data. CSS ret code [20]

2014-12-09 12:02:57.102: [  OCRRAW][1]proprioo: Failed to auto repair theOCR configuration.

2014-12-09 12:02:57.102: [  OCRRAW][1]proprinit: Could not open rawdevice

2014-12-09 12:02:57.102: [  OCRASM][1]proprasmcl: asmhandle is NULL

2014-12-09 12:02:57.112: [  OCRAPI][1]a_init:16!: Backend initunsuccessful : [26]

2014-12-09 12:02:57.112: [  CRSOCR][1] OCR context init failure.  Error: PROC-26: Error while accessing thephysical storage

 

2014-12-09 12:02:57.112: [    CRSD][1] Created alert : (:CRSD00111:):  Could not init OCR, error: PROC-26:Error while accessing the physical storage

 

2014-12-09 12:02:57.112: [    CRSD][1][PANIC] CRSD exiting: Could notinit OCR, code: 26

2014-12-09 12:02:57.112: [    CRSD][1] Done.

 

查看磁盘

#lsdev -Cc disk

hdisk0 Available          Virtual SCSI Disk Drive

hdisk1 Available          Virtual SCSI Disk Drive

hdisk2 Defined            Virtual SCSI Disk Drive

hdisk3 Available 21-T1-01 MPIO DS4800 Disk

hdisk4 Available 21-T1-01 MPIO DS4800 Disk

hdisk5 Available 21-T1-01 MPIO DS4800 Disk

hdisk6 Available 22-T1-01 MPIO DS4800 Disk

hdisk7 Available 22-T1-01 MPIO DS4800 Disk

hdisk8 Available 22-T1-01 MPIO DS4800 Disk

 

查看asm_disk是否正常

# su– grid

$sqlplus/ as sysasm

SQL>col name format a15

SQL>col path format a17

SQL>select name,path,header_status,mount_status,state from v$asm_disk;

 

NAME            PATH              HEADER_STATU MOUNT_S STATE

--------------- ----------------------------- ------- --------

                /dev/rhdisk6      MEMBER       CLOSED NORMAL

                /dev/rhdisk7      MEMBER       CLOSED NORMAL

                /dev/rhdisk8      MEMBER       CLOSED NORMAL

DATA_0000       /dev/rhdisk3      MEMBER       CACHED NORMAL

DATA_0001       /dev/rhdisk4      MEMBER       CACHED NORMAL

DATA_0002       /dev/rhdisk5      MEMBER       CACHED NORMAL

#su –grid

$asmcmd

ASMCMD>lsdg

State   Type    Rebal  Sector Block       AU  Total_MB Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks Voting_files  Name

MOUNTED EXTERN  N         512  4096  1048576   3145728 2058582                0         2058582              0             N  DATA/

 

mount未正常加载的asm DG

ASMCMD>mount -a

ORA-15032: not all alterations performed

ORA-15017: diskgroup "DATA"cannot be mounted

ORA-15013: diskgroup "DATA" isalready mounted (DBD ERROR: OCIStmtExecute)

ASMCMD>lsdg

State   Type    Rebal  Sector Block       AU  Total_MB Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks Voting_files  Name

MOUNTED EXTERN  N         512  4096  1048576   3145728 2058582                0         2058582              0             N DATA/

MOUNTED  NORMAL N         512   4096 1048576      3072     2146             1024             561              0             Y OCR/

 

# su– grid

$sqlplus/ as sysasm

SQL>col name format a15

SQL>col path format a17

SQL>  selectname,path,header_status,mount_status,state from v$asm_disk;

 

NAME            PATH              HEADER_STATU MOUNT_S STATE

--------------- ----------------------------- ------- --------

DATA_0000       /dev/rhdisk3      MEMBER       CACHED NORMAL

DATA_0001       /dev/rhdisk4      MEMBER       CACHED NORMAL

DATA_0002       /dev/rhdisk5      MEMBER       CACHED NORMAL

OCR_0000        /dev/rhdisk6      MEMBER       CACHED NORMAL

OCR_0001        /dev/rhdisk7      MEMBER       CACHED NORMAL

OCR_0002        /dev/rhdisk8      MEMBER       CACHED NORMAL

 

查看crs状态

#su- grid

$crs_stat-t -v

Name           Type           R/RA   F/FT  Target    State     Host       

----------------------------------------------------------------------

ora.DATA.dg    ora....up.type 0/5    0/    ONLINE    ONLINE    testvhfs1  

ora....ER.lsnr ora....er.type 0/5    0/    ONLINE    ONLINE    testvhfs1  

ora....N1.lsnr ora....er.type 0/5    0/0   ONLINE    ONLINE    testvhfs2  

ora....N2.lsnr ora....er.type 0/5    0/0   ONLINE    ONLINE    testvhfs1  

ora....N3.lsnr ora....er.type 0/5    0/0   ONLINE    ONLINE    testvhfs1  

ora.OCR.dg     ora....up.type 0/5    0/    ONLINE    ONLINE    testvhfs1  

ora.asm        ora.asm.type   0/5   0/     ONLINE    ONLINE   testvhfs1  

ora.cvu        ora.cvu.type   0/5   0/0    ONLINE    ONLINE   testvhfs1  

ora.gsd        ora.gsd.type   0/5   0/     OFFLINE   OFFLINE              

ora....network ora....rk.type 0/5    0/    ONLINE    ONLINE    testvhfs1  

ora.oc4j       ora.oc4j.type  0/1   0/2    ONLINE    ONLINE   testvhfs1  

ora.ons        ora.ons.type   0/3   0/     ONLINE    ONLINE   testvhfs1   

ora....ry.acfs ora....fs.type 0/5    0/    ONLINE    ONLINE    testvhfs1  

ora.scan1.vip  ora....ip.type 0/0    0/0   ONLINE    ONLINE    testvhfs2  

ora.scan2.vip  ora....ip.type 0/0    0/0   ONLINE    ONLINE    testvhfs1  

ora.scan3.vip  ora....ip.type 0/0    0/0   ONLINE    ONLINE    testvhfs1  

ora....vhfs.db ora....se.type 0/2    0/1   ONLINE    ONLINE    testvhfs2  

ora....SM1.asm application    0/5   0/0    ONLINE    ONLINE   testvhfs1  

ora....S1.lsnr application    0/5   0/0    ONLINE    ONLINE   testvhfs1  

ora....fs1.gsd application    0/5   0/0    OFFLINE   OFFLINE              

ora....fs1.ons application    0/3   0/0    ONLINE    ONLINE   testvhfs1  

ora....fs1.vip ora....t1.type 0/0    0/0   ONLINE    ONLINE    testvhfs1  

ora....SM2.asm application    0/5   0/0    ONLINE    ONLINE   testvhfs2  

ora....S2.lsnr application    0/5   0/0    ONLINE    ONLINE   testvhfs2  

ora....fs2.gsd application    0/5   0/0    OFFLINE   OFFLINE              

ora....fs2.ons application    0/3   0/0    ONLINE    ONLINE   testvhfs2  

ora....fs2.vip ora....t1.type 0/0    0/0   ONLINE    ONLINE    testvhfs2  

 

至此，CRS-0814错误解决。