Exadata 删除，添加物理磁盘过程

Exadata关于磁盘部分，新增加了lun，celldisk，griddisk的概念，这里简单介绍一下，如下图：

我们可以看到一个物理硬盘添加到Cell之后，会自动创建LUN，LUN对应的是创建一个celldisk，一个celldisk对应一个或者多个griddisk，而griddisk就可以提供给ASM实例使用了。

这里我主要记录一下我在将一个正在运行的Exadata机器， 它的一个磁盘正常删除并添加的完整过程。
(这里强调一下“CellCLI>”都是在Cell上执行的命令，“SQL>” 都是在compute node（既数据库节点）上执行的命令)

1.首先要确定我需要删除的硬盘的LUN的位置，celldisk名字，通过下面命令可以查询

1. CellCLI>  LIST CELLDISK WHERE name LIKE 'CD_03.*' detail  
2.          name:                   CD_03_dmorlcel08                    <<<<<<<<< celldisk名字  
3.          comment:  
4.          creationTime:           2012-04-20T04:37:54-04:00  
5.          deviceName:             /dev/sdd  
6.          devicePartition:        /dev/sdd  
7.          diskType:               HardDisk  
8.          errorCount:             0  
9.          freeSpace:              0  
10.          id:                     772cc8b1-ca81-468e-8b65-16e2724ef4da  
11.          interleaving:           none  
12.          lun:                    0_3                                  <<<<<<<<< 在0_3 这个LUN                           
13.          raidLevel:              0  
14.          size:                   557.859375G  
15.          status:                 normal 

2.查询griddisk的信息，这个可以找到asm中的disk name，以及diskgroup的name。
通过这个命令还可以看到这个celldisk对应三个griddisk。

1. CellCLI> LIST GRIDDISK WHERE cellDisk LIKE 'CD_03.*' detail  
2.          name:                   DATA_CD_03_dmorlcel08  
3.          asmDiskGroupName:       DATA  
4.          asmDiskName:            DATA_CD_03_DMORLCEL08  <<<<<<<<<<<<<<<<<<<<<<<<<ASM disk name  
5.          availableTo:  
6.          cellDisk:               CD_03_dmorlcel08  
7.          comment:  
8.          creationTime:           2012-04-20T04:39:48-04:00  
9.          diskType:               HardDisk  
10.          errorCount:             0  
11.          id:                     524f59b3-32af-4926-bc40-bf094d05a71d  
12.          offset:                 32M  
13.          size:                   423G  
14.          status:                 active 
15.  
16.          name:                   DBFS_DG_CD_03_dmorlcel08  
17.          asmDiskGroupName:       DBFS_DG  
18.          asmDiskName:            DBFS_DG_CD_03_DMORLCEL08  <<<<<<<<<<<<<<<<<<<<<<<<<ASM disk name  
19.          availableTo:  
20.          cellDisk:               CD_03_dmorlcel08  
21.          comment:  
22.          creationTime:           2012-04-20T04:57:22-04:00  
23.          diskType:               HardDisk  
24.          errorCount:             0  
25.          id:                     001ef1df-5d41-4fab-b1ad-5a8983a63b8c  
26.          offset:                 528.734375G  
27.          size:                   29.125G  
28.          status:                 active 
29.  
30.          name:                   RECO_CD_03_dmorlcel08  
31.          asmDiskGroupName:       RECO                       <<<<<<<<<<<<<<<<<<<<<<<<<ASM diskgroup name  
32.          asmDiskName:            RECO_CD_03_DMORLCEL08      <<<<<<<<<<<<<<<<<<<<<<<<<ASM disk name  
33.          availableTo:  
34.          cellDisk:               CD_03_dmorlcel08  
35.          comment:  
36.          creationTime:           2012-04-20T04:56:28-04:00  
37.          diskType:               HardDisk  
38.          errorCount:             0  
39.          id:                     544c54c0-2969-4ad3-bea0-f3e2b4f1bf31  
40.          offset:                 423.046875G  
41.          size:                   105.6875G  
42.          status:                 active 

3.通过ASM实例查询磁盘信息

1. $more  /etc/oratab  
2. #Backup file is  /u01/app/oracle/product/11.2.0.3/db_home1/srvm/admin/oratab.bak.dmorldb05 line added by Agent  
3. +ASM1:/u01/app/11.2.0.3/grid:N          # line added by Agent 
4.  
5. $ export ORACLE_SID=+ASM1  
6. $ export ORACLE_HOME=/u01/app/11.2.0.3/grid  
7. $ sqlplus / as sysasm  
8. SQL> set line 400  
9. SQL> select GROUP_NUMBER,DISK_NUMBER,LABEL,NAME,MOUNT_STATUS,state,FAILGROUP,MODE_STATUS,PATH from v$asm_disk where name='RECO_CD_03_DMORLCEL08';    <<<<<<<disk name need to correct 
10.  
11. GROUP_NUMBER DISK_NUMBER LABEL                           NAME                           PATH  
12. ------------ ----------- ------------------------------- ------------------------------   
13.            4          10 RECO_CD_03_DMORLCEL08           RECO_CD_03_DMORLCEL08          o/192.168.10.16/RECO_CD_03_dmorlcel08 
14.  
15. 查询对应的磁盘组  
16. SQL>  select GROUP_NUMBER,NAME from v$asm_diskgroup;      <<<<<determine the diskgroup number 
17.  
18. GROUP_NUMBER NAME  
19. ------------ ------------------------------  
20.           1 DATA  
21.           2 DBFS_DG  
22.           4 RECO  
23. SQL> select NAME,ALLOCATION_UNIT_SIZE,STATE,TOTAL_MB,OFFLINE_DISKS,TOTAL_MB,FREE_MB,REQUIRED_MIRROR_FREE_MB from v$asm_diskgroup; 

4.下面开始我们的删除操作，如果删除celldisk，首先应该从最上层，ASM层面开始删除磁盘

1. SQL> alter diskgroup RECO drop disk RECO_CD_03_DMORLCEL08 REBALANCE power 8;  
2. SQL> alter diskgroup DBFS_DG drop disk DBFS_DG_CD_03_DMORLCEL08 REBALANCE power 8;  
3. SQL> alter diskgroup DATA drop disk DATA_CD_03_DMORLCEL08 REBALANCE power 8; 

5.删除的过程中，通过这个命令查收reblance进度，确保ASM删除磁盘的动作完成，再进行下一步操作。

1. SQL> set line 200  
2. SQL> select * from v$asm_operation; 
3.  
4. GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE  EST_MINUTES ERROR_CODE  
5. ------------ ----- ---- ---------- ---------- ---------- ---------- ----------  
6.            1 REBAL RUN           8          8      58593     207611       7586    19  
7. SQL> / 
8.  
9. GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE   EST_MINUTES ERROR_CODE  
10. ------------ ----- ---- ---------- ---------- ---------- ---------- ----------  
11.            1 REBAL RUN           8          8      58856     207656       7643    19 
12.  
13. SQL> / 
14.  
15. no rows selected     <<<<<<<<<<<<表示reblance已经完成 

6.ASM中删除掉DBFS_DG_CD_03_DMORLCEL08磁盘后，通过griddisk命令查询，发现对应的asmDiskName，asmDiskGroupName，已经没有值了。

1. CellCLI> list GRIDDISK DBFS_DG_CD_03_DMORLCEL08 detail  
2.          name:                   DBFS_DG_CD_03_dmorlcel08  
3.          asmDiskGroupName:  
4.          asmDiskName:  
5.          availableTo:  
6.          cellDisk:               CD_03_dmorlcel08  
7.          comment:  
8.          creationTime:           2012-04-20T04:57:22-04:00  
9.          diskType:               HardDisk  
10.          errorCount:             0  
11.          id:                     001ef1df-5d41-4fab-b1ad-5a8983a63b8c  
12.          offset:                 528.734375G  
13.          size:                   29.125G  
14.          status:                 active  

7.删除griddisk，并查询，发现已经查询不到griddisk DBFS_DG_CD_03_DMORLCEL08的信息

1. CellCLI> DROP GRIDDISK DBFS_DG_CD_03_DMORLCEL08;  
2. GridDisk DBFS_DG_CD_03_dmorlcel08 successfully dropped 
3.  
4. CellCLI> list GRIDDISK DBFS_DG_CD_03_DMORLCEL08 detail 
5.  
6. CELL-02007: Grid disk does not exist: DBFS_DG_CD_03_DMORLCEL08 
7.  
8. CellCLI>  LIST gridDISK WHERE cellDisk LIKE '.*CD_03.*' detail  
9.          name:                   DATA_CD_03_dmorlcel08  
10.          asmDiskGroupName:       DATA  
11.          asmDiskName:            DATA_CD_03_DMORLCEL08  
12.          availableTo:  
13.          cellDisk:               CD_03_dmorlcel08  
14.          comment:  
15.          creationTime:           2012-04-20T04:39:48-04:00  
16.          diskType:               HardDisk  
17.          errorCount:             0  
18.          id:                     524f59b3-32af-4926-bc40-bf094d05a71d  
19.          offset:                 32M  
20.          size:                   423G  
21.          status:                 active 
22.  
23.          name:                   RECO_CD_03_dmorlcel08  
24.          asmDiskGroupName:  
25.          asmDiskName:  
26.          availableTo:  
27.          cellDisk:               CD_03_dmorlcel08  
28.          comment:  
29.          creationTime:           2012-04-20T04:56:28-04:00  
30.          diskType:               HardDisk  
31.          errorCount:             0  
32.          id:                     544c54c0-2969-4ad3-bea0-f3e2b4f1bf31  
33.          offset:                 423.046875G  
34.          size:                   105.6875G  
35.          status:                 active 

8.继续删除RECO_CD_03_dmorlcel08并查询

1. CellCLI> DROP GRIDDISK RECO_CD_03_dmorlcel08;  
2. GridDisk RECO_CD_03_dmorlcel08 successfully dropped 
3.  
4. CellCLI> LIST gridDISK WHERE cellDisk LIKE '.*CD_03.*' detail  
5.          name:                   DATA_CD_03_dmorlcel08  
6.          asmDiskGroupName:       DATA  
7.          asmDiskName:            DATA_CD_03_DMORLCEL08  
8.          availableTo:  
9.          cellDisk:               CD_03_dmorlcel08  
10.          comment:  
11.          creationTime:           2012-04-20T04:39:48-04:00  
12.          diskType:               HardDisk  
13.          errorCount:             0  
14.          id:                     524f59b3-32af-4926-bc40-bf094d05a71d  
15.          offset:                 32M  
16.          size:                   423G  
17.          status:                 active 

9.继续删除DATA_CD_03_DMORLCEL08，并查询

1. CellCLI> DROP GRIDDISK DATA_CD_03_DMORLCEL08  
2. GridDisk DATA_CD_03_dmorlcel08 successfully dropped 
3.  
4. CellCLI>  LIST gridDISK WHERE cellDisk LIKE '.*CD_03.*' detail 
5.  
6. CellCLI>  LIST CELLDISK WHERE name LIKE 'CD_03.*' detail  
7.          name:                   CD_03_dmorlcel08  
8.          comment:  
9.          creationTime:           2012-04-20T04:37:54-04:00  
10.          deviceName:             /dev/sdd  
11.          devicePartition:        /dev/sdd  
12.          diskType:               HardDisk  
13.          errorCount:             0  
14.          freeSpace:              557.8125G  
15.          freeSpaceMap:           offset=32M,size=19.96875G  
16.                                  offset=20.015625G,size=537.84375G  
17.          id:                     772cc8b1-ca81-468e-8b65-16e2724ef4da  
18.          interleaving:           none  
19.          lun:                    0_3  
20.          raidLevel:              0  
21.          size:                   557.859375G  
22.          status:                 normal 
23.  
24. CellCLI>  LIST CELLDISK WHERE name LIKE 'CD_03.*' detail  
25.          name:                   CD_03_dmorlcel08  
26.          comment:  
27.          creationTime:           2012-04-20T04:37:54-04:00  
28.          deviceName:             /dev/sdd  
29.          devicePartition:        /dev/sdd  
30.          diskType:               HardDisk  
31.          errorCount:             0  
32.          freeSpace:              557.8125G  
33.          freeSpaceMap:           offset=32M,size=19.96875G  
34.                                  offset=20.015625G,size=537.84375G  
35.          id:                     772cc8b1-ca81-468e-8b65-16e2724ef4da  
36.          interleaving:           none  
37.          lun:                    0_3  
38.          raidLevel:              0  
39.          size:                   557.859375G  
40.          status:                 normal 
41.  
42. CellCLI> drop celldisk CD_03_dmorlcel08  
43. CellDisk CD_03_dmorlcel08 successfully dropped 

10.删除celldisk，并查询LUN信息

1. CellCLI>  LIST CELLDISK WHERE name LIKE 'CD_03.*' detail 
2.  
3. CellCLI> LIST LUN 0_3 DETAIL  
4.          name:                   0_3  
5.          cellDisk:  
6.          deviceName:             /dev/sdd  
7.          diskType:               HardDisk  
8.          id:                     0_3  
9.          isSystemLun:            FALSE  
10.          lunAutoCreate:          FALSE  
11.          lunSize:                557.861328125G  
12.          lunUID:                 0_3  
13.          physicalDrives:         28:3  
14.          raidLevel:              0  
15.          lunWriteCacheMode:      "WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU"  
16.          status:                 normal  
17. 比较一个正常的LUN信息  
18. CellCLI> LIST LUN 0_4 DETAIL  
19.          name:                   0_4  
20.          cellDisk:               CD_04_dmorlcel08      <<<<<<<  
21.          deviceName:             /dev/sde  
22.          diskType:               HardDisk  
23.          id:                     0_4  
24.          isSystemLun:            FALSE  
25.          lunAutoCreate:          FALSE  
26.          lunSize:                557.861328125G  
27.          lunUID:                 0_4  
28.          physicalDrives:         28:4  
29.          raidLevel:              0  
30.          lunWriteCacheMode:      "WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU"  
31.          status:                 normal 

11.在删除完成后，我们要开始添加的过程，实际troubleshooting中，会遇到Exadata在磁盘更换完成后，并没有正常的创建celldisk和griddisk，我们需要手动创建celldisk和griddisk。

手动创建之前，我们需要查询physicaldisk状态，确认physicalSerial和你更换的磁盘是对应的

1. CellCLI> list physicaldisk where luns=0_3 detail  
2.          name:                   28:3  
3.          deviceId:               24  
4.          diskType:               HardDisk  
5.          enclosureDeviceId:      28  
6.          errMediaCount:          0  
7.          errOtherCount:          0  
8.          foreignState:           false  
9.          luns:                   0_3  
10.          makeModel:              "SEAGATE ST360057SSUN600G"  
11.          physicalFirmware:       0A25  
12.          physicalInsertTime:     2012-01-20T15:57:20-05:00  
13.          physicalInterface:      sas  
14.          physicalSerial:         E12EQY  
15.          physicalSize:           558.9109999993816G  
16.          slotNumber:             3  
17.          status:                 normal 

12.创建celldisk，根据前面的信息，确认需要创建的celldisk与LUN能准确的匹配上，不要写错

1. CellCLI>  create celldisk CD_03_dmorlcel08 lun=0_4（如果没有正确匹配，会遇到如下错误） 
2.  
3. CELL-04527: Cannot complete the creation of cell disk CD_03_dmorlcel08. Received error: CELL-04522: The LUN 0_4 has a valid celldisk.  
4. Cell disks are not created: CD_03_dmorlcel08 
5.  
6. 成功创建  
7. CellCLI>  create celldisk CD_03_dmorlcel08 lun=0_3  
8. CellDisk CD_03_dmorlcel08 successfully created 

14.首先查询一个正常的磁盘，确认后续需要设置的信息，如name,size,offset

1. CellCLI> list griddisk where celldisk=CD_04_dmorlcel08 attributes name,size,offset  
2.          DATA_CD_04_dmorlcel08           423G            32M  
3.          DBFS_DG_CD_04_dmorlcel08        29.125G         528.734375G  
4.          RECO_CD_04_dmorlcel08           105.6875G       423.046875G 

15.创建griddisk磁盘

1. CellCLI> create griddisk DATA_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=423G  
2. CellCLI> create griddisk DBFS_DG_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=29.125G 
3. CellCLI> create griddisk RECO_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=105.6875G 
4.  
5. 下面是执行的记录，以及查询结果  
6. CellCLI>  create celldisk CD_03_dmorlcel08 lun=0_3  
7. CellDisk CD_03_dmorlcel08 successfully created 
8.  
9. CellCLI> create griddisk DATA_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=423G  
10. GridDisk DATA_CD_03_dmorlcel08 successfully created 
11.  
12. CellCLI> create griddisk DBFS_DG_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=29.125G 
13. GridDisk DBFS_DG_CD_03_dmorlcel08 successfully created 
14.  
15. CellCLI> create griddisk RECO_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=105.6875G  
16. GridDisk RECO_CD_03_dmorlcel08 successfully created 
17.  
18. 可以查询到celldisk信息  
19. CellCLI> LIST CELLDISK WHERE name LIKE 'CD_03.*' detail  
20.          name:                   CD_03_dmorlcel08  
21.          comment:  
22.          creationTime:           2013-02-07T02:13:17-05:00  
23.          deviceName:             /dev/sdd  
24.          devicePartition:        /dev/sdd  
25.          diskType:               HardDisk  
26.          errorCount:             0  
27.          freeSpace:              0  
28.          id:                     2f3e651e-6fb6-47e7-a227-692645519ce4  
29.          interleaving:           none  
30.          lun:                    0_3  
31.          raidLevel:              0  
32.          size:                   557.859375G  
33.          status:                 normal 
34.  
35. 可以查询到griddisk信息  
36. CellCLI> LIST gridDISK WHERE cellDisk LIKE '.*CD_03.*' detail  
37.          name:                   DATA_CD_03_dmorlcel08  
38.          availableTo:  
39.          cellDisk:               CD_03_dmorlcel08  
40.          comment:  
41.          creationTime:           2013-02-07T02:14:17-05:00  
42.          diskType:               HardDisk  
43.          errorCount:             0  
44.          id:                     6f9cb08e-fd8f-4063-b902-439387237f5d  
45.          offset:                 32M  
46.          size:                   423G  
47.          status:                 active 
48.  
49.          name:                   DBFS_DG_CD_03_dmorlcel08  
50.          availableTo:  
51.          cellDisk:               CD_03_dmorlcel08  
52.          comment:  
53.          creationTime:           2013-02-07T02:14:26-05:00  
54.          diskType:               HardDisk  
55.          errorCount:             0  
56.          id:                     055710ce-216a-4b10-a215-b38763ea65df  
57.          offset:                 423.046875G  
58.          size:                   29.125G  
59.          status:                 active 
60.  
61.          name:                   RECO_CD_03_dmorlcel08  
62.          availableTo:  
63.          cellDisk:               CD_03_dmorlcel08  
64.          comment:  
65.          creationTime:           2013-02-07T02:14:33-05:00  
66.          diskType:               HardDisk  
67.          errorCount:             0  
68.          id:                     fdf9a255-0a0d-4152-a557-de80b112ddff  
69.          offset:                 452.171875G  
70.          size:                   105.6875G  
71.          status:                 active 
72.  
73. CellCLI> list griddisk where celldisk=CD_03_dmorlcel08 attributes name,size,offset  
74.          DATA_CD_03_dmorlcel08              423G            32M  
75.          DBFS_DG_CD_03_dmorlcel08        29.125G         423.046875G  
76.          RECO_CD_03_dmorlcel08              105.6875G       452.171875G 

16.如果磁盘没有删除的情况下，需要force再次删除一下，但是我们的测试中，前面已经正常删除磁盘 .

1. SQL> alter diskgroup data drop disk DATA_CD_07_dm03cel13 force; 
2.  
3. select GROUP_NUMBER,DISK_NUMBER,LABEL,NAME,MOUNT_STATUS,state,FAILGROUP,MODE_STATUS,PATH from v$asm_disk where name like '%CD_03_DMORLCEL08'; 

17.添加磁盘

1. SQL>  ALTER DISKGROUP DATA ADD DISK 'o/192.168.10.16/DATA_CD_03_dmorlcel08' rebalance power 10;  
2. SQL>  ALTER DISKGROUP DBFS_DG ADD DISK 'o/192.168.10.16/DBFS_DG_CD_03_dmorlcel08' rebalance power 10;  
3. SQL>  ALTER DISKGROUP RECO ADD DISK 'o/192.168.10.16/RECO_CD_03_dmorlcel08' rebalance power 10; 
4.  
5. 添加完成两个磁盘后，查询ASM的结果 
6.  
7. GROUP_NUMBER DISK_NUMBER LABEL                           NAME                           MOUNT_S STATE    FAILGROUP                      MODE_ST PATH  
8. ------------ ----------- ------------------------------- ------------------------------ ------- -------- ------------------------------ ------- ------------------ 
9.  
10.            1           3 DATA_CD_03_DMORLCEL08           DATA_CD_03_DMORLCEL08          CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/DATA_CD_03_dmorlcel08  
11.            2           6 DBFS_DG_CD_03_DMORLCEL08        DBFS_DG_CD_03_DMORLCEL08       CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/DBFS_DG_CD_03_dmorlcel08 
12.  
13.   

18.添加磁盘的过程，通过这个命令来检查完成状况

SQL> select * from v$asm_operation;

19.最后，全部完成的状态

1. SQL> select GROUP_NUMBER,DISK_NUMBER,LABEL,NAME,MOUNT_STATUS,state,FAILGROUP,MODE_STATUS,PATH from v$asm_disk where name like '%CD_03_DMORLCEL08'; 
2.  
3. GROUP_NUMBER DISK_NUMBER LABEL                           NAME                           MOUNT_S STATE    FAILGROUP                      MODE_ST PATH  
4. ------------ ----------- ------------------------------- ------------------------------ ------- -------- ------------------------------ -------  
5.  
6.            1           3 DATA_CD_03_DMORLCEL08           DATA_CD_03_DMORLCEL08          CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/DATA_CD_03_dmorlcel08  
7.            4           6 RECO_CD_03_DMORLCEL08           RECO_CD_03_DMORLCEL08          CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/RECO_CD_03_dmorlcel08  
8.            2           6 DBFS_DG_CD_03_DMORLCEL08        DBFS_DG_CD_03_DMORLCEL08       CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/DBFS_DG_CD_03_dmorlcel08 
9.  
10. 查询griddisk信息，可以看到asmDiskGroupName，asmDiskName都已经有了。 
11.  
12. CellCLI>  list griddisk where celldisk=CD_03_dmorlcel08 detail  
13.          name:                   DATA_CD_03_dmorlcel08  
14.          asmDiskGroupName:       DATA  
15.          asmDiskName:            DATA_CD_03_DMORLCEL08  
16.          availableTo:  
17.          cellDisk:               CD_03_dmorlcel08  
18.          comment:  
19.          creationTime:           2013-02-07T02:14:17-05:00  
20.          diskType:               HardDisk  
21.          errorCount:             0  
22.          id:                     6f9cb08e-fd8f-4063-b902-439387237f5d  
23.          offset:                 32M  
24.          size:                   423G  
25.          status:                 active 
26.  
27.          name:                   DBFS_DG_CD_03_dmorlcel08  
28.          asmDiskGroupName:       DBFS_DG  
29.          asmDiskName:            DBFS_DG_CD_03_DMORLCEL08  
30.          availableTo:  
31.          cellDisk:               CD_03_dmorlcel08  
32.          comment:  
33.          creationTime:           2013-02-07T02:14:26-05:00  
34.          diskType:               HardDisk  
35.          errorCount:             0  
36.          id:                     055710ce-216a-4b10-a215-b38763ea65df  
37.          offset:                 423.046875G  
38.          size:                   29.125G  
39.          status:                 active 
40.  
41.          name:                   RECO_CD_03_dmorlcel08  
42.          asmDiskGroupName:       RECO  
43.          asmDiskName:            RECO_CD_03_DMORLCEL08  
44.          availableTo:  
45.          cellDisk:               CD_03_dmorlcel08  
46.          comment:  
47.          creationTime:           2013-02-07T02:14:33-05:00  
48.          diskType:               HardDisk  
49.          errorCount:             0  
50.          id:                     fdf9a255-0a0d-4152-a557-de80b112ddff  
51.          offset:                 452.171875G  
52.          size:                   105.6875G  
53.          status:                 active 
54.  
55.   

       至此，全部的实验已经完成，如果在更换磁盘后没有正常添加，可以参考这个实验。

转载于:https://blog.51cto.com/hsbxxl/1132925