11g RAC更换存储（rebulance方式）

说明：本次实验采用ASMCA图形化方式来操作

一、环境说明

1、rac环境  操作系统 

[oracle@host03 ~]$ cat /etc/redhat-release 
Red Hat Enterprise Linux Server release 6.4 (Santiago)

      数据库： grid  database   11.2.0.4

2、磁盘组情况（磁盘分区方式）

旧存储磁盘：

Disk /dev/sdc: 112.7 GB, 112742891520 bytes
255 heads, 63 sectors/track, 13706 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xac699177

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1               1        1306    10490413+  83  Linux
/dev/sdc2            1307        2612    10490445   83  Linux
/dev/sdc3            2613        3918    10490445   83  Linux
/dev/sdc4            3919       13706    78622110    5  Extended
/dev/sdc5            3919        5224    10490413+  83  Linux
/dev/sdc6            5225        6530    10490413+  83  Linux
/dev/sdc7            6531        7836    10490413+  83  Linux
/dev/sdc8            7837        9142    10490413+  83  Linux
/dev/sdc9            9143       10448    10490413+  83  Linux
/dev/sdc10          10449       11754    10490413+  83  Linux
/dev/sdc11          11755       13060    10490413+  83  Linux

对应asm磁盘：

二、创建磁盘，并使之成为asmlib方式格式的磁盘

1、新存储磁盘：

Disk /dev/sdd: 112.7 GB, 112742891520 bytes
255 heads, 63 sectors/track, 13706 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x2b7fbdc0

   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1               1        1306    10490413+  83  Linux
/dev/sdd2            1307        2612    10490445   83  Linux
/dev/sdd3            2613        3918    10490445   83  Linux
/dev/sdd4            3919       13706    78622110    5  Extended
/dev/sdd5            3919        5224    10490413+  83  Linux
/dev/sdd6            5225        6530    10490413+  83  Linux
/dev/sdd7            6531        7836    10490413+  83  Linux
/dev/sdd8            7837        9142    10490413+  83  Linux
/dev/sdd9            9143       10448    10490413+  83  Linux
/dev/sdd10          10449       11754    10490413+  83  Linux
/dev/sdd11          11755       13060    10490413+  83  Linux

对应asm磁盘：

 备注：创建方式

[root@host03 oracle]# cat initdisknew.sh 
## Delete asmdisk on host03
## Create disk asmdisk on host03
/etc/init.d/oracleasm createdisk asmdisk8p1 /dev/sdd1
/etc/init.d/oracleasm createdisk asmdisk8p2 /dev/sdd2
/etc/init.d/oracleasm createdisk asmdisk8p3 /dev/sdd3
/etc/init.d/oracleasm createdisk asmdisk8p4 /dev/sdd5
/etc/init.d/oracleasm createdisk asmdisk8p5 /dev/sdd6
/etc/init.d/oracleasm createdisk asmdisk8p6 /dev/sdd7
/etc/init.d/oracleasm createdisk asmdisk8p7 /dev/sdd8
/etc/init.d/oracleasm createdisk asmdisk8p8 /dev/sdd9
/etc/init.d/oracleasm createdisk asmdisk9p1 /dev/sdd10
/etc/init.d/oracleasm createdisk asmdisk9p2 /dev/sdd11
## Scan disk asmdisk on host03
/etc/init.d/oracleasm scandisks
/etc/init.d/oracleasm listdisks
## Scan disk asmdisk on host04
ssh host04 /etc/init.d/oracleasm scandisks
ssh host04 /etc/init.d/oracleasm listdisks

三、将磁盘添加到磁盘组（图形化）

以此类推，将10块盘添加到相应的磁盘组中

OCR   ASMDISK8P1-ASMDISK8P3

DATA  ASMDISK8P4-ASMDISK8P7

FRA   ASMDISK8P8-ASMDISK9P2

四、修改asm_power_limit参数 

[root@host03 oracle]# su - grid
-bash-4.1$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.4.0 Production on Tue Sep 21 16:57:03 2021

Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> show parameter power_limit;

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
asm_power_limit                      integer     1

1、修改asm_power_limit=5

SQL> alter system set asm_power_limit=5 scope=both;

System altered.

SQL> show parameter power_limit;

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
asm_power_limit                      integer     5

五、查看磁盘组数据同步情况

1、检查磁盘组之间数据同步情况（grid用户）

SQL> select OPERATION,POWER,EST_RATE,EST_MINUTES,STATE from v$asm_operation;

no rows selected

备注：说明磁盘 rebalance 操作结束

2、将asm_power_limit参数改回1

SQL> alter system set asm_power_limit=1 scope=both;

六、确认无误，删除磁盘组旧存储磁盘，并删除/dev/oracleasm/disk/* 下的旧磁盘

1、找准磁盘名称

2、删除磁盘

以此方式，直至旧存储磁盘删除完成！ 

3、断开就存储连接

## Delete asmdisk on host03
/etc/init.d/oracleasm deletedisk asmdisk1p1
/etc/init.d/oracleasm deletedisk asmdisk1p2
/etc/init.d/oracleasm deletedisk asmdisk1p3
/etc/init.d/oracleasm deletedisk asmdisk1p4
/etc/init.d/oracleasm deletedisk asmdisk1p5
/etc/init.d/oracleasm deletedisk asmdisk1p6
/etc/init.d/oracleasm deletedisk asmdisk1p7
/etc/init.d/oracleasm deletedisk asmdisk1p8
/etc/init.d/oracleasm deletedisk asmdisk2p1
/etc/init.d/oracleasm deletedisk asmdisk2p2
## Scan disk asmdisk on host03
/etc/init.d/oracleasm scandisks
/etc/init.d/oracleasm listdisks
## Scan disk asmdisk on host04
ssh host04 /etc/init.d/oracleasm scandisks
ssh host04 /etc/init.d/oracleasm listdisks

执行：./initdiskdel.sh

发现没有看到原来旧存储磁盘asm盘
[root@host03 oracle]# ll /dev/oracleasm/disks/
total 0
brw-rw---- 1 grid asmadmin 8, 49 Sep 21 15:55 ASMDISK8P1
brw-rw---- 1 grid asmadmin 8, 50 Sep 21 15:55 ASMDISK8P2
brw-rw---- 1 grid asmadmin 8, 51 Sep 21 15:55 ASMDISK8P3
brw-rw---- 1 grid asmadmin 8, 53 Sep 21 15:55 ASMDISK8P4
brw-rw---- 1 grid asmadmin 8, 54 Sep 21 15:55 ASMDISK8P5
brw-rw---- 1 grid asmadmin 8, 55 Sep 21 15:55 ASMDISK8P6
brw-rw---- 1 grid asmadmin 8, 56 Sep 21 15:55 ASMDISK8P7
brw-rw---- 1 grid asmadmin 8, 57 Sep 21 15:55 ASMDISK8P8
brw-rw---- 1 grid asmadmin 8, 58 Sep 21 15:55 ASMDISK9P1
brw-rw---- 1 grid asmadmin 8, 59 Sep 21 15:55 ASMDISK9P2