存储更换，ASM集群重构-CSDN博客

  生产ADG存储空间不够，无法通过添加磁盘的方式来进行扩容，只能通过更换存储的方式来进行扩容，更换存储后ASM实例是无法启动的，下面方法为如何通过本地OCR备份来恢复集群，参考MOS文档： How to restore ASM based OCR after complete loss of the CRS diskgroup on Linux/Unix systems (文档 ID 1062983.1)

[jianwg@adgdb2 ~]$ sudo su - root
1、在两个节点查看最新的OCR backup
[root@adgdb2 ~]# su - grid
[grid@adgdb2 ~]$ cd /u01/app/grid_home/cdata/adgdb-cluster
[grid@adgdb2 adgdb-cluster]$ ls -lrt
total 53536
-rw------- 1 root root 7831552 Apr 13 06:00 week.ocr
-rw------- 1 root root 7831552 Apr 19 10:00 day.ocr
-rw------- 1 root root 7831552 Apr 20 02:00 backup02.ocr
-rw------- 1 root root 7831552 Apr 20 06:00 backup01.ocr
-rw------- 1 root root 7831552 Apr 20 06:00 week_.ocr
-rw------- 1 root root 7831552 Apr 20 10:00 backup00.ocr
-rw------- 1 root root 7831552 Apr 20 10:00 day_.ocr
[grid@adgdb2 adgdb-cluster]$ ps -ef|grep d.bin
grid 57898 53461 0 20:20 pts/2 00:00:00 grep d.bin
[grid@adgdb2 adgdb-cluster]$ exirt
-bash: exirt: command not found
[grid@adgdb2 adgdb-cluster]$ exit
logout

2、确保所有节点的集群是关闭的
/u01/app/grid_home/bin/crsctl stop crs -f

3、在OCR backup比较新的节点以排他方式启动crs
[root@adgdb2 ~]# /u01/app/grid_home/bin/crsctl start crs -excl -nocrs
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.mdnsd' on 'adgdb2'
CRS-2676: Start of 'ora.mdnsd' on 'adgdb2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'adgdb2'
CRS-2676: Start of 'ora.gpnpd' on 'adgdb2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'adgdb2'
CRS-2672: Attempting to start 'ora.gipcd' on 'adgdb2'
CRS-2676: Start of 'ora.cssdmonitor' on 'adgdb2' succeeded
CRS-2676: Start of 'ora.gipcd' on 'adgdb2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'adgdb2'
CRS-2672: Attempting to start 'ora.diskmon' on 'adgdb2'
CRS-2676: Start of 'ora.diskmon' on 'adgdb2' succeeded
CRS-2676: Start of 'ora.cssd' on 'adgdb2' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'adgdb2'
CRS-2672: Attempting to start 'ora.ctssd' on 'adgdb2'
CRS-2676: Start of 'ora.ctssd' on 'adgdb2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'adgdb2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'adgdb2'
CRS-2676: Start of 'ora.asm' on 'adgdb2' succeeded

4、创建新的ASM磁盘组
[root@adgdb2 ~]# su - grid
[grid@adgdb2 ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.3.0 Production on Sat Apr 23 20:27:54 2016

Copyright (c) 1982, 2011, Oracle. All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> select name from v$asm_diskgroup;

no rows selected

SQL> create diskgroup CRS NORMAL redundancy disk 'ORCL:CRS_10G_1','ORCL:CRS_10G_2','ORCL:CRS_10G_3' attribute 'COMPATIBLE.ASM' = '11.2';

Diskgroup created.

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@adgdb2 ~]$ exit
logout

5、恢复OCR
[root@adgdb2 ~]# cd /u01/app/grid_home/cdata/adgdb-cluster
[root@adgdb2 adgdb-cluster]# ls -lrt
total 53536
-rw------- 1 root root 7831552 Apr 13 06:00 week.ocr
-rw------- 1 root root 7831552 Apr 19 10:00 day.ocr
-rw------- 1 root root 7831552 Apr 20 02:00 backup02.ocr
-rw------- 1 root root 7831552 Apr 20 06:00 backup01.ocr
-rw------- 1 root root 7831552 Apr 20 06:00 week_.ocr
-rw------- 1 root root 7831552 Apr 20 10:00 backup00.ocr
-rw------- 1 root root 7831552 Apr 20 10:00 day_.ocr
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/ocrconfig -restore backup00.ocr

6、重建Voting file
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl replace votedisk +CRS
Successful addition of voting disk 66480399e85a4f8bbf067f5213a62bda.
Successful addition of voting disk a3c56fbc276d4f64bfd4f1853a9927ed.
Successful addition of voting disk 63db415d5f924f98bf25ea05ceb017fb.
Successfully replaced voting disk group with +CRS.
CRS-4266: Voting file(s) successfully replaced

7、生成一个零时的ASM实例的pfile文件
vi pfile.ora
*.asm_diskstring='/dev/oracleasm/disks/*'
*.asm_power_limit=1
*.diagnostic_dest='/u01/app/grid_base'
*.instance_type='asm'
*.large_pool_size=12M
*.memory_max_target=4294967296
*.memory_target=1610612736
*.remote_login_passwordfile='EXCLUSIVE'

[root@adgdb2 adgdb-cluster]# su - grid
[grid@adgdb2 ~]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.3.0 Production on Sat Apr 23 20:49:34 2016

Copyright (c) 1982, 2011, Oracle. All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> create spfile='+CRS' from pfile='/home/grid/pfile.ora';

File created.

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@adgdb2 ~]$ exit
logout

8、关闭集群
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'adgdb2'
CRS-2673: Attempting to stop 'ora.ctssd' on 'adgdb2'
CRS-2673: Attempting to stop 'ora.asm' on 'adgdb2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'adgdb2'
CRS-2677: Stop of 'ora.ctssd' on 'adgdb2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'adgdb2' succeeded
CRS-2677: Stop of 'ora.asm' on 'adgdb2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'adgdb2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'adgdb2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'adgdb2'
CRS-2677: Stop of 'ora.cssd' on 'adgdb2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'adgdb2'
CRS-2677: Stop of 'ora.gipcd' on 'adgdb2' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'adgdb2'
CRS-2677: Stop of 'ora.gpnpd' on 'adgdb2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'adgdb2' has completed
CRS-4133: Oracle High Availability Services has been stopped.

9、Rescan ASM disks（两个节点都要执行）
[root@adgdb2 adgdb-cluster]# /usr/sbin/oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...

10、启动集群
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl stat res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
[root@adgdb2 adgdb-cluster]# ps -ef|grep d.bin
root 28054 1 2 20:51 ? 00:00:02 /u01/app/grid_home/bin/ohasd.bin reboot
grid 28213 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/mdnsd.bin
grid 28234 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/gpnpd.bin
grid 28251 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/gipcd.bin
root 28266 1 1 20:52 ? 00:00:01 /u01/app/grid_home/bin/osysmond.bin
grid 28324 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/ocssd.bin
root 30372 53427 0 20:53 pts/2 00:00:00 grep d.bin
[root@adgdb2 adgdb-cluster]# ps -ef|grep d.bin
root 28054 1 2 20:51 ? 00:00:02 /u01/app/grid_home/bin/ohasd.bin reboot
grid 28213 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/mdnsd.bin
grid 28234 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/gpnpd.bin
grid 28251 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/gipcd.bin
root 28266 1 1 20:52 ? 00:00:01 /u01/app/grid_home/bin/osysmond.bin
grid 28324 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/ocssd.bin
root 30391 1 1 20:53 ? 00:00:00 /u01/app/grid_home/bin/octssd.bin reboot
grid 30412 1 1 20:53 ? 00:00:00 /u01/app/grid_home/bin/evmd.bin
root 30425 53427 0 20:53 pts/2 00:00:00 grep d.bin
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl stat res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
[root@adgdb2 adgdb-cluster]# ps -ef|grep d.bin
root 28054 1 2 20:51 ? 00:00:02 /u01/app/grid_home/bin/ohasd.bin reboot
grid 28213 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/mdnsd.bin
grid 28234 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/gpnpd.bin
grid 28251 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/gipcd.bin
root 28266 1 1 20:52 ? 00:00:02 /u01/app/grid_home/bin/osysmond.bin
grid 28324 1 0 20:52 ? 00:00:00 /u01/app/grid_home/bin/ocssd.bin
root 30391 1 0 20:53 ? 00:00:00 /u01/app/grid_home/bin/octssd.bin reboot
grid 30412 1 0 20:53 ? 00:00:00 /u01/app/grid_home/bin/evmd.bin
root 30652 1 29 20:54 ? 00:00:01 /u01/app/grid_home/bin/crsd.bin reboot
root 30914 53427 0 20:54 pts/2 00:00:00 grep d.bin
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRS.dg
ONLINE ONLINE adgdb2
ora.DATA.dg
ONLINE OFFLINE adgdb2
ora.FRA.dg
ONLINE OFFLINE adgdb2
ora.LISTENER.lsnr
ONLINE ONLINE adgdb2
ora.asm
ONLINE ONLINE adgdb2 Started
ora.gsd
OFFLINE OFFLINE adgdb2
ora.net1.network
ONLINE ONLINE adgdb2
ora.ons
ONLINE OFFLINE adgdb2 STARTING
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE OFFLINE
ora.LISTENER_SCAN2.lsnr
1 ONLINE OFFLINE
ora.LISTENER_SCAN3.lsnr
1 ONLINE OFFLINE
ora.adgdb1.vip
1 ONLINE OFFLINE STARTING
ora.adgdb2.vip
1 ONLINE OFFLINE STARTING
ora.bpsdbstd.db
1 ONLINE OFFLINE
2 ONLINE OFFLINE Instance Shutdown
ora.crmdbstd.crmdb.svc
1 ONLINE OFFLINE
ora.crmdbstd.db
1 ONLINE OFFLINE
2 ONLINE OFFLINE Instance Shutdown
ora.cvu
1 ONLINE ONLINE adgdb2
ora.oc4j
1 ONLINE OFFLINE STARTING
ora.phyfinance.banksms.svc
1 ONLINE OFFLINE
ora.phyfinance.db
1 ONLINE OFFLINE
2 ONLINE OFFLINE Instance Shutdown
ora.phyfinance.fin.svc
1 ONLINE OFFLINE
ora.phyfinance.finmanager.svc
1 ONLINE OFFLINE
ora.phyfinance.lms.svc
1 ONLINE OFFLINE
ora.phyfinance.lsp.svc
1 ONLINE OFFLINE
ora.scan1.vip
1 ONLINE OFFLINE STARTING
ora.scan2.vip
1 ONLINE OFFLINE STARTING
ora.scan3.vip
1 ONLINE OFFLINE STARTING
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRS.dg
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
ora.DATA.dg
ONLINE OFFLINE adgdb1
ONLINE OFFLINE adgdb2
ora.FRA.dg
ONLINE OFFLINE adgdb1
ONLINE OFFLINE adgdb2
ora.LISTENER.lsnr
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
ora.asm
ONLINE ONLINE adgdb1 Started
ONLINE ONLINE adgdb2 Started
ora.gsd
OFFLINE OFFLINE adgdb1
OFFLINE OFFLINE adgdb2
ora.net1.network
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
ora.ons
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE adgdb1
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE adgdb2
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE adgdb2
ora.adgdb1.vip
1 ONLINE ONLINE adgdb1
ora.adgdb2.vip
1 ONLINE ONLINE adgdb2
ora.bpsdbstd.db
1 ONLINE OFFLINE Instance Shutdown
2 ONLINE OFFLINE Instance Shutdown
ora.crmdbstd.crmdb.svc
1 ONLINE OFFLINE
ora.crmdbstd.db
1 ONLINE OFFLINE Instance Shutdown
2 ONLINE OFFLINE Instance Shutdown
ora.cvu
1 ONLINE ONLINE adgdb2
ora.oc4j
1 ONLINE ONLINE adgdb2
ora.phyfinance.banksms.svc
1 ONLINE OFFLINE
ora.phyfinance.db
1 ONLINE OFFLINE Instance Shutdown
2 ONLINE OFFLINE Instance Shutdown
ora.phyfinance.fin.svc
1 ONLINE OFFLINE
ora.phyfinance.finmanager.svc
1 ONLINE OFFLINE
ora.phyfinance.lms.svc
1 ONLINE OFFLINE
ora.phyfinance.lsp.svc
1 ONLINE OFFLINE
ora.scan1.vip
1 ONLINE ONLINE adgdb1
ora.scan2.vip
1 ONLINE ONLINE adgdb2
ora.scan3.vip
1 ONLINE ONLINE adgdb2


11、确认集群状态
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl check cluster -all
**************************************************************
adgdb1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
adgdb2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@adgdb2 adgdb-cluster]# /u01/app/grid_home/bin/crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRS.dg
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
ora.DATA.dg
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
ora.FRA.dg
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
ora.LISTENER.lsnr
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
ora.asm
ONLINE ONLINE adgdb1 Started
ONLINE ONLINE adgdb2 Started
ora.gsd
OFFLINE OFFLINE adgdb1
OFFLINE OFFLINE adgdb2
ora.net1.network
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
ora.ons
ONLINE ONLINE adgdb1
ONLINE ONLINE adgdb2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE adgdb1
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE adgdb2
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE adgdb2
ora.adgdb1.vip
1 ONLINE ONLINE adgdb1
ora.adgdb2.vip
1 ONLINE ONLINE adgdb2
ora.bpsdbstd.db
1 ONLINE OFFLINE Instance Shutdown
2 ONLINE OFFLINE Instance Shutdown
ora.crmdbstd.crmdb.svc
1 ONLINE OFFLINE
ora.crmdbstd.db
1 ONLINE OFFLINE Instance Shutdown
2 ONLINE OFFLINE Instance Shutdown
ora.cvu
1 ONLINE ONLINE adgdb2
ora.oc4j
1 ONLINE ONLINE adgdb2
ora.phyfinance.banksms.svc
1 ONLINE OFFLINE
ora.phyfinance.db
1 ONLINE OFFLINE Instance Shutdown
2 ONLINE OFFLINE Instance Shutdown
ora.phyfinance.fin.svc
1 ONLINE OFFLINE
ora.phyfinance.finmanager.svc
1 ONLINE OFFLINE
ora.phyfinance.lms.svc
1 ONLINE OFFLINE
ora.phyfinance.lsp.svc
1 ONLINE OFFLINE
ora.scan1.vip
1 ONLINE ONLINE adgdb1
ora.scan2.vip
1 ONLINE ONLINE adgdb2
ora.scan3.vip
1 ONLINE ONLINE adgdb2


13、asmca创建DATA、FRA磁盘组
su - grid
asmca

14、使用全备恢复数据库

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/29953799/viewspace-2087103/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/29953799/viewspace-2087103/