11g R2 OCR和votedisk不可用的解决方案

查看 votedisk信息
[root@rac1 bin]# ./crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   649b109da77a4f0cbf4b922be1b44312 (ORCL:VOL1) [GRIDDG]
Located 1 voting disk(s).

查看OCR信息
[root@rac1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
Version                  :          3
Total space (kbytes)     :     262120
Used space (kbytes)      :       3212
Available space (kbytes) :     258908
ID                       : 2126600233
Device/File Name         :    +GRIDDG
                                    Device/File integrity check succeeded
Device/File Name         : +OCR_VOTE_BAK
                                    Device/File integrity check succeeded


                                    Device/File not configured


                                    Device/File not configured


                                    Device/File not configured


Cluster registry integrity check succeeded


Logical corruption check succeeded

停止两个节点的CRS
[root@rac1 bin]# ./crsctl stop crs
[root@rac2 bin]# ./crsctl stop crs

破坏磁盘组 +GRIDDG所在磁盘的磁盘头信息
[root@rac1 bin]# dd if=/dev/zero of=/dev/sdb bs=1M count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.009277 seconds, 113 MB/s
[root@rac1 bin]# dd if=/dev/zero of=/dev/sdc bs=1M count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.005399 seconds, 194 MB/s



尝试启动CRS
[root@rac1 bin]# ./crsctl start crs
CRS-4123: Oracle High Availability Services has been started.

alertrac1.log告警日记报如下错误：
[cssd(10753)]CRS-1714: Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log
2014-09-22 06:36:54.759: 
[cssd(10753)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log
2014-09-22 06:37:09.775: 
[cssd(10753)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log
2014-09-22 06:37:24.787: 
[cssd(10753)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log



ocssd.log告警日记内容如下：
2014-09-22 06:37:39.798: [   SKGFD][1097218368]Discovery with asmlib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: str ::


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Fetching asmlib disk :ORCL:VOL1:


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Fetching asmlib disk :ORCL:VOL2:


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Fetching asmlib disk :ORCL:VOL4:


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Fetching asmlib disk :ORCL:VOL5:


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Handle 0x18a420d0 from lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: for disk :ORCL:VOL2:


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Handle 0x18a431a0 from lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: for disk :ORCL:VOL3:


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Handle 0x189e9b90 from lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: for disk :ORCL:VOL4:


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Handle 0x189ea3c0 from lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: for disk :ORCL:VOL5:


2014-09-22 06:37:39.799: [   SKGFD][1097218368]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x189f6080 for disk :ORCL:VOL1:


2014-09-22 06:37:39.800: [   SKGFD][1097218368]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x18a420d0 for disk :ORCL:VOL2:


2014-09-22 06:37:39.800: [   SKGFD][1097218368]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x18a431a0 for disk :ORCL:VOL3:


2014-09-22 06:37:39.801: [   SKGFD][1097218368]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x189e9b90 for disk :ORCL:VOL4:


2014-09-22 06:37:39.801: [   SKGFD][1097218368]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x189ea3c0 for disk :ORCL:VOL5:


2014-09-22 06:37:39.801: [    CSSD][1097218368]clssnmvDiskVerify: Successful discovery of 0 disks
2014-09-22 06:37:39.801: [    CSSD][1097218368]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2014-09-22 06:37:39.801: [    CSSD][1097218368]clssnmvFindInitialConfigs: No voting files found
2014-09-22 06:37:39.801: [    CSSD][1097218368](:CSSNM00070:)clssnmCompleteInitVFDiscovery: Voting file not found. Retrying discovery in 15 seconds







强行停止CRS
[root@rac1 bin]# ./crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'


CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
You have new mail in /var/spool/mail/root

上面停止CRS的过程有点慢，打开另外一个窗口，强行关闭CRS
[root@rac1 ~]# /u01/app/11.2.0/grid/bin/crsctl stop crs -f
CRS-2797: Shutdown is already in progress for 'rac1', waiting for it to complete
CRS-2797: Shutdown is already in progress for 'rac1', waiting for it to complete
CRS-4133: Oracle High Availability Services has been stopped.


以排他方式启动，只启动asm，不启动crs
[root@rac1 bin]# ./crsctl start crs -excl -nocrs
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'
CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'
CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'
CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rac1'
CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'
CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded
CRS-2676: Start of 'ora.drivers.acfs' on 'rac1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1'
CRS-2676: Start of 'ora.asm' on 'rac1' succeeded


创建OCR和votedisk磁盘组GRIDDG

SQL> create diskgroup GRIDDG external redundancy disk 'ORCL:VOL1','ORCL:VOL2' attribute 'compatible.asm'='11.2','compatible.rdbms'='11.2';

利用备份还原OCR
[root@rac1 bin]# ./ocrconfig -restore /u01/app/11.2.0/grid/cdata/scan-cluster/backup_20140922_060338.ocr
查看OCR
[root@rac1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
Version                  :          3
Total space (kbytes)     :     262120
Used space (kbytes)      :       3192
Available space (kbytes) :     258928
ID                       : 2126600233
Device/File Name         :    +GRIDDG
                                    Device/File integrity check succeeded


                                    Device/File not configured


                                    Device/File not configured


                                    Device/File not configured


                                    Device/File not configured


Cluster registry integrity check succeeded


Logical corruption check succeeded

还原votedisk
[root@rac1 bin]# ./crsctl replace votedisk +GRIDDG
Successful addition of voting disk 552cc5ad9b064f81bf047faee44bbcdf.
Successfully replaced voting disk group with +GRIDDG.
CRS-4266: Voting file(s) successfully replaced

查看votedisk
[root@rac1 bin]# ./crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   552cc5ad9b064f81bf047faee44bbcdf (ORCL:VOL1) [GRIDDG]
Located 1 voting disk(s).

强行关闭CRS
[root@rac1 bin]# ./crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.drivers.acfs' on 'rac1' succeeded
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.

重新启动CRS
[root@rac1 bin]# ./crsctl start crs
CRS-4123: Oracle High Availability Services has been started.


已经可以查看集群资源
[grid@rac1 scan-cluster]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATADG.dg  ora....up.type ONLINE    ONLINE    rac1        
ora.FLASHDG.dg ora....up.type ONLINE    ONLINE    rac1        
ora.GRIDDG.dg  ora....up.type ONLINE    ONLINE    rac1        
ora....ER.lsnr ora....er.type ONLINE    ONLINE    rac1        
ora....N1.lsnr ora....er.type ONLINE    ONLINE    rac1                   
ora.asm        ora.asm.type   ONLINE    ONLINE    rac1        
ora.cvu        ora.cvu.type   ONLINE    ONLINE    rac1        
ora.devdb.db   ora....se.type ONLINE    ONLINE    rac1        
ora.gsd        ora.gsd.type   OFFLINE   OFFLINE               
ora....network ora....rk.type ONLINE    ONLINE    rac1        
ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    rac1        
ora.ons        ora.ons.type   ONLINE    ONLINE    rac1        
ora....SM1.asm application    ONLINE    ONLINE    rac1        
ora....C1.lsnr application    ONLINE    ONLINE    rac1        
ora.rac1.gsd   application    OFFLINE   OFFLINE               
ora.rac1.ons   application    ONLINE    ONLINE    rac1        
ora.rac1.vip   ora....t1.type ONLINE    ONLINE    rac1        
ora....SM2.asm application    ONLINE    ONLINE    rac2        
ora....C2.lsnr application    ONLINE    ONLINE    rac2        
ora.rac2.gsd   application    OFFLINE   OFFLINE               
ora.rac2.ons   application    ONLINE    ONLINE    rac2        
ora.rac2.vip   ora....t1.type ONLINE    ONLINE    rac2        
ora....ry.acfs ora....fs.type ONLINE    ONLINE    rac1        
ora.scan1.vip  ora....ip.type ONLINE    ONLINE    rac1 


还有两种类似的恢复方法，参考

http://blog.itpub.net/28786649/viewspace-1277775/
http://blog.itpub.net/28786649/viewspace-1277783/

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/28786649/viewspace-1277770/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/28786649/viewspace-1277770/