实验1
fast disk resync
在磁盘处于offline的这段时间里,ASM持续跟踪需要在offline磁盘上做的修改操作。
online后ASM会将这些修改操作应用到磁盘上去。
alter diskgroup ssddg offline disks in failgroup ssd01;
SQL> alter diskgroup ssddg offline disks in failgroup ssd01
2022-02-15T18:23:54.939962+08:00
NOTE: DRTimer CD Create: for disk group 2 disks:
NOTE: process _user41508_+asm2 (41508) initiating offline of disk 0.4041717961 (SSDDG_0000) with mask 0x7e in group 2 (SSDDG) without client assisting
NOTE: process _user41508_+asm2 (41508) initiating offline of disk 1.4041717960 (SSDDG_0001) with mask 0x7e in group 2 (SSDDG) without client assisting
NOTE: process _user41508_+asm2 (41508) initiating offline of disk 2.4041717959 (SSDDG_0002) with mask 0x7e in group 2 (SSDDG) without client assisting
NOTE: process _user41508_+asm2 (41508) initiating offline of disk 3.4041717958 (SSDDG_0003) with mask 0x7e in group 2 (SSDDG) without client assisting
NOTE: process _user41508_+asm2 (41508) initiating offline of disk 4.4041717957 (SSDDG_0004) with mask 0x7e in group 2 (SSDDG) without client assisting
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 0/0xf0e7b8c9, mask = 0x6a, op = clear mandatory
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 1/0xf0e7b8c8, mask = 0x6a, op = clear mandatory
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 2/0xf0e7b8c7, mask = 0x6a, op = clear mandatory
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 3/0xf0e7b8c6, mask = 0x6a, op = clear mandatory
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 4/0xf0e7b8c5, mask = 0x6a, op = clear mandatory
2022-02-15T18:23:54.948651+08:00
GMON updating disk modes for group 2 at 17 for pid 34, osid 41508
cluster guid (19c825cfae34ffefff565f5a6c5c679f) generated for PST Hbeat for instance 2
cluster guid (19c825cfae34ffefff565f5a6c5c679f) generated for PST Hbeat for instance 2
cluster guid (19c825cfae34ffefff565f5a6c5c679f) generated for PST Hbeat for instance 2
cluster guid (19c825cfae34ffefff565f5a6c5c679f) generated for PST Hbeat for instance 2
cluster guid (19c825cfae34ffefff565f5a6c5c679f) generated for PST Hbeat for instance 2
ARBA started with pid=36, OS id=2373
NOTE: starting process ARB0
Starting background process ARB0
2022-02-15T18:26:16.942743+08:00
ARB0 started with pid=44, OS id=2376
NOTE: assigning ARBA to group 2/0xda874857 (SSDDG) to compute estimates
NOTE: assigning ARB0 to group 2/0xda874857 (SSDDG) with 1 parallel I/O
2022-02-15T18:26:16.980568+08:00
NOTE: Starting resync using Staleness Registry and ATE scan for group 2
2022-02-15T18:26:23.016548+08:00
NOTE: Starting resync using Staleness Registry and ATE scan for group 2
NOTE: header on disk 0 advanced to format #2 using fcn 0.0
NOTE: F1X0 on disk 0 (fmt 2) relocated at fcn 0.57089: AU 0 -> AU 2
NOTE: F1B1 fcn on disk 9 synced at fcn 0.57089
NOTE: F1B1 fcn on disk 13 synced at fcn 0.57089
2022-02-15T18:26:25.856306+08:00
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 0/0x0, mask = 0x7f, op = assign mandatory
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 1/0x0, mask = 0x7f, op = assign mandatory
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 2/0x0, mask = 0x7f, op = assign mandatory
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 3/0x0, mask = 0x7f, op = assign mandatory
NOTE: initiating PST update: grp 2 (SSDDG), dsk = 4/0x0, mask = 0x7f, op = assign mandatory
2022-02-15T18:26:25.856761+08:00
GMON updating disk modes for group 2 at 27 for pid 44, osid 2376
2022-02-15T18:26:25.879461+08:00
NOTE: PST update grp = 2 completed successfully
NOTE: reset timers for disk: 0
NOTE: reset timers for disk: 1
NOTE: reset timers for disk: 2
NOTE: reset timers for disk: 3
NOTE: reset timers for disk: 4
NOTE: completed online of disk group 2 disks
SSDDG_0000 (0)
SSDDG_0001 (1)
SSDDG_0002 (2)
SSDDG_0003 (3)
SSDDG_0004 (4)
2022-02-15T18:26:25.949483+08:00
NOTE: stopping process ARBA
NOTE: stopping process ARB0
NOTE: Starting expel slave for group 2/0xda874857 (SSDDG)
2022-02-15T18:26:25.970349+08:00
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=2
2022-02-15T18:26:25.997227+08:00
NOTE: membership refresh pending for group 2/0xda874857 (SSDDG)
2022-02-15T18:26:25.998629+08:00
GMON querying group 2 at 28 for pid 26, osid 28875
2022-02-15T18:26:26.018513+08:00
SUCCESS: refreshed membership for 2/0xda874857 (SSDDG)
2022-02-15T18:26:28.983565+08:00
SUCCESS: rebalance completed for group 2/0xda874857 (SSDDG)
NOTE: Attempting voting file refresh on diskgroup SSDDG
NOTE: Refresh completed on diskgroup SSDDG. No voting file found.
asmcmd online -G ssddg -a
alter diskgroup ssddg online all;
实验2
----------------------------------------------------------------------------Fri Feb 18 14:17:28 2022
SQL> alter diskgroup ssddg2 offline disks in failgroup qone1
NOTE: DRTimer CD Create: for disk group 3 disks:
0
2
4
NOTE: process _user31366_+asm2 (31366) initiating offline of disk 0.3915997526 (SSDDG2_0000) with mask 0x7e in group 3
NOTE: process _user31366_+asm2 (31366) initiating offline of disk 2.3915997529 (SSDDG2_0002) with mask 0x7e in group 3
NOTE: process _user31366_+asm2 (31366) initiating offline of disk 4.3915997530 (SSDDG2_0004) with mask 0x7e in group 3
NOTE: initiating PST update: grp = 3, dsk = 0/0xe9696156, mask = 0x6a, op = clear
NOTE: initiating PST update: grp = 3, dsk = 2/0xe9696159, mask = 0x6a, op = clear
NOTE: initiating PST update: grp = 3, dsk = 4/0xe969615a, mask = 0x6a, op = clear
Fri Feb 18 14:17:28 2022
GMON updating disk modes for group 3 at 58 for pid 29, osid 31366
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: PST update grp = 3 completed successfully
NOTE: initiating PST update: grp = 3, dsk = 0/0xe9696156, mask = 0x7e, op = clear
NOTE: initiating PST update: grp = 3, dsk = 2/0xe9696159, mask = 0x7e, op = clear
NOTE: initiating PST update: grp = 3, dsk = 4/0xe969615a, mask = 0x7e, op = clear
GMON updating disk modes for group 3 at 59 for pid 29, osid 31366
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: cache closing disk 0 of grp 3: SSDDG2_0000
NOTE: cache closing disk 2 of grp 3: SSDDG2_0002
NOTE: cache closing disk 4 of grp 3: SSDDG2_0004
NOTE: PST update grp = 3 completed successfully
NOTE: DRTimer CD Destroy: for diskgroup 3
SUCCESS: alter diskgroup ssddg2 offline disks in failgroup qone1
-----------------------------------------------------------------Fri Feb 18 14:18:01 2022
SQL> alter diskgroup ssddg2 online disks in failgroup qone1
Fri Feb 18 14:18:01 2022
NOTE: initiating online disk group 3 disks
SSDDG2_0000 (0)
SSDDG2_0002 (2)
SSDDG2_0004 (4)
NOTE: process _s000_+asm2 (1099) initiating offline of disk 0.3915997526 (SSDDG2_0000) with mask 0x7e in group 3
NOTE: process _s000_+asm2 (1099) initiating offline of disk 2.3915997529 (SSDDG2_0002) with mask 0x7e in group 3
NOTE: process _s000_+asm2 (1099) initiating offline of disk 4.3915997530 (SSDDG2_0004) with mask 0x7e in group 3
NOTE: sending set offline flag message 3458690843 to 3 disk(s) in group 3
Fri Feb 18 14:18:01 2022
WARNING: Disk SSDDG2_0000 in mode 0x1 is now being offlined
WARNING: Disk SSDDG2_0002 in mode 0x1 is now being offlined
WARNING: Disk SSDDG2_0004 in mode 0x1 is now being offlined
NOTE: initiating PST update: grp = 3, dsk = 0/0xe9696156, mask = 0x6a, op = clear
NOTE: initiating PST update: grp = 3, dsk = 2/0xe9696159, mask = 0x6a, op = clear
NOTE: initiating PST update: grp = 3, dsk = 4/0xe969615a, mask = 0x6a, op = clear
GMON updating disk modes for group 3 at 60 for pid 34, osid 1099
NOTE: cache closing disk 0 of grp 3: (not open) SSDDG2_0000
NOTE: cache closing disk 2 of grp 3: (not open) SSDDG2_0002
NOTE: cache closing disk 4 of grp 3: (not open) SSDDG2_0004
NOTE: PST update grp = 3 completed successfully
NOTE: initiating PST update: grp = 3, dsk = 0/0xe9696156, mask = 0x7e, op = clear
NOTE: initiating PST update: grp = 3, dsk = 2/0xe9696159, mask = 0x7e, op = clear
NOTE: initiating PST update: grp = 3, dsk = 4/0xe969615a, mask = 0x7e, op = clear
GMON updating disk modes for group 3 at 61 for pid 34, osid 1099
NOTE: cache closing disk 0 of grp 3: (not open) SSDDG2_0000
NOTE: cache closing disk 2 of grp 3: (not open) SSDDG2_0002
NOTE: cache closing disk 4 of grp 3: (not open) SSDDG2_0004
NOTE: PST update grp = 3 completed successfully
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=3
NOTE: F1X0 copy 1 relocating from 0:2 to 0:4294967294 for diskgroup 3 (SSDDG2)
NOTE: initiating PST update: grp = 3, dsk = 0/0x0, mask = 0x11, op = assign
NOTE: initiating PST update: grp = 3, dsk = 2/0x0, mask = 0x11, op = assign
NOTE: initiating PST update: grp = 3, dsk = 4/0x0, mask = 0x11, op = assign
GMON updating disk modes for group 3 at 62 for pid 34, osid 1099
NOTE: cache closing disk 0 of grp 3: (not open) SSDDG2_0000
NOTE: cache closing disk 2 of grp 3: (not open) SSDDG2_0002
NOTE: cache closing disk 4 of grp 3: (not open) SSDDG2_0004
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: PST update grp = 3 completed successfully
NOTE: requesting all-instance disk validation for group=3
Fri Feb 18 14:18:02 2022
NOTE: disk validation pending for group 3/0x85a9d211 (SSDDG2)
NOTE: Found /dev/qdata/mpath-s01.3267.01.redo for disk SSDDG2_0002
WARNING: ignoring disk in deep discovery
NOTE: Found /dev/qdata/mpath-s01.3266.01.P1B00S07 for disk SSDDG2_0004
WARNING: ignoring disk in deep discovery
NOTE: Found /dev/qdata/mpath-s01.3265.01.P1B00S06 for disk SSDDG2_0000
WARNING: ignoring disk in deep discovery
SUCCESS: validated disks for 3/0x85a9d211 (SSDDG2)
GMON querying group 3 at 63 for pid 34, osid 1099
NOTE: initiating PST update: grp = 3, dsk = 0/0x0, mask = 0x19, op = assign
NOTE: initiating PST update: grp = 3, dsk = 2/0x0, mask = 0x19, op = assign
NOTE: initiating PST update: grp = 3, dsk = 4/0x0, mask = 0x19, op = assign
GMON updating disk modes for group 3 at 64 for pid 34, osid 1099
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: group SSDDG2: updated PST location: disk 0000 (PST copy 1)
NOTE: PST update grp = 3 completed successfully
NOTE: membership refresh pending for group 3/0x85a9d211 (SSDDG2)
GMON querying group 3 at 65 for pid 18, osid 9872
NOTE: cache opening disk 0 of grp 3: SSDDG2_0000 path:/dev/qdata/mpath-s01.3265.01.P1B00S06
NOTE: cache opening disk 2 of grp 3: SSDDG2_0002 path:/dev/qdata/mpath-s01.3267.01.redo
NOTE: cache opening disk 4 of grp 3: SSDDG2_0004 path:/dev/qdata/mpath-s01.3266.01.P1B00S07
SUCCESS: refreshed membership for 3/0x85a9d211 (SSDDG2)
NOTE: initiating PST update: grp = 3, dsk = 0/0x0, mask = 0x5d, op = assign
SUCCESS: alter diskgroup ssddg2 online disks in failgroup qone1
NOTE: initiating PST update: grp = 3, dsk = 2/0x0, mask = 0x5d, op = assign
NOTE: initiating PST update: grp = 3, dsk = 4/0x0, mask = 0x5d, op = assign
GMON updating disk modes for group 3 at 66 for pid 34, osid 1099
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: group SSDDG2: updated PST location: disk 0000 (PST copy 1)
NOTE: PST update grp = 3 completed successfully
NOTE: Attempting voting file refresh on diskgroup SSDDG2
NOTE: Refresh completed on diskgroup SSDDG2. No voting file found.
Fri Feb 18 14:18:17 2022
NOTE: initiating PST update: grp = 3, dsk = 0/0x0, mask = 0x7d, op = assign
NOTE: initiating PST update: grp = 3, dsk = 2/0x0, mask = 0x7d, op = assign
NOTE: initiating PST update: grp = 3, dsk = 4/0x0, mask = 0x7d, op = assign
Fri Feb 18 14:18:17 2022
GMON updating disk modes for group 3 at 67 for pid 34, osid 1099
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: group SSDDG2: updated PST location: disk 0000 (PST copy 1)
NOTE: PST update grp = 3 completed successfully
Fri Feb 18 14:18:17 2022
NOTE: Voting File refresh pending for group 3/0x85a9d211 (SSDDG2)
NOTE: F1X0 copy 1 relocating from 0:4294967294 to 0:2 for diskgroup 3 (SSDDG2)
NOTE: initiating PST update: grp = 3, dsk = 0/0x0, mask = 0x7f, op = assign
NOTE: initiating PST update: grp = 3, dsk = 2/0x0, mask = 0x7f, op = assign
NOTE: initiating PST update: grp = 3, dsk = 4/0x0, mask = 0x7f, op = assign
GMON updating disk modes for group 3 at 68 for pid 34, osid 1099
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: group SSDDG2: updated PST location: disk 0000 (PST copy 1)
NOTE: PST update grp = 3 completed successfully
NOTE: reset timers for disk: 0
NOTE: reset timers for disk: 2
NOTE: reset timers for disk: 4
NOTE: completed online of disk group 3 disks
SSDDG2_0000 (0)
SSDDG2_0002 (2)
SSDDG2_0004 (4)
NOTE: Attempting voting file refresh on diskgroup SSDDG2
NOTE: Refresh completed on diskgroup SSDDG2. No voting file found.
------------------------------------------------------------------
----------------------------------------------------------------Fri Feb 18 14:37:30 2022
NOTE: ASM did background COD recovery for group 3/0x85a9d211 (SSDDG2)
NOTE: starting rebalance of group 3/0x85a9d211 (SSDDG2) at power 1024
Starting background process ARB0
Fri Feb 18 14:37:30 2022
ARB0 started with pid=29, OS id=5870
NOTE: assigning ARB0 to group 3/0x85a9d211 (SSDDG2) with 1024 parallel I/Os
cellip.ora not found.
WARNING: Extent map changed during relocation for file 257
WARNING: Extent map changed during relocation for file 257
WARNING: Extent map changed during relocation for file 257
WARNING: Extent map changed during relocation for file 257
WARNING: Extent map changed during relocation for file 257
Fri Feb 18 14:37:45 2022
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=3
Fri Feb 18 14:37:48 2022
NOTE: membership refresh pending for group 3/0x85a9d211 (SSDDG2)
Fri Feb 18 14:37:51 2022
GMON querying group 3 at 69 for pid 18, osid 9872
SUCCESS: refreshed membership for 3/0x85a9d211 (SSDDG2)
NOTE: Attempting voting file refresh on diskgroup SSDDG2
NOTE: Refresh completed on diskgroup SSDDG2. No voting file found.
Fri Feb 18 14:39:41 2022
NOTE: stopping process ARB0
SUCCESS: rebalance completed for group 3/0x85a9d211 (SSDDG2)
alter diskgroup ssddg2 drop disks in failgroup qone1;
问题1:空间不够
问题2:不满足冗余度,normal至少两个故障组
------------------------------------------------------------Fri Feb 18 15:19:24 2022
SQL> alter diskgroup ssddg2 drop disks in failgroup qone1
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=3
Fri Feb 18 15:19:25 2022
NOTE: membership refresh pending for group 3/0x85a9d211 (SSDDG2)
Fri Feb 18 15:19:28 2022
GMON querying group 3 at 71 for pid 18, osid 9872
SUCCESS: refreshed membership for 3/0x85a9d211 (SSDDG2)
ORA-15067: command or option incompatible with diskgroup redundancy
ERROR: alter diskgroup ssddg2 drop disks in failgroup qone1
NOTE: Attempting voting file refresh on diskgroup SSDDG2
NOTE: Refresh completed on diskgroup SSDDG2. No voting file found.
------------------------------------------------------------
问题3:加force删
------------------------------------------------------------Fri Feb 18 15:25:34 2022
SQL> alter diskgroup ssddg2 drop disks in failgroup qone1 force
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=3
NOTE: process _user29525_+asm2 (29525) initiating offline of disk 0.3915997526 (SSDDG2_0000) with mask 0x7e in group 3
NOTE: process _user29525_+asm2 (29525) initiating offline of disk 2.3915997529 (SSDDG2_0002) with mask 0x7e in group 3
NOTE: process _user29525_+asm2 (29525) initiating offline of disk 4.3915997530 (SSDDG2_0004) with mask 0x7e in group 3
NOTE: initiating PST update: grp = 3, dsk = 0/0xe9696156, mask = 0x6a, op = clear
NOTE: initiating PST update: grp = 3, dsk = 2/0xe9696159, mask = 0x6a, op = clear
NOTE: initiating PST update: grp = 3, dsk = 4/0xe969615a, mask = 0x6a, op = clear
Fri Feb 18 15:25:34 2022
GMON updating disk modes for group 3 at 73 for pid 29, osid 29525
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: PST update grp = 3 completed successfully
NOTE: initiating PST update: grp = 3, dsk = 0/0xe9696156, mask = 0x7e, op = clear
NOTE: initiating PST update: grp = 3, dsk = 2/0xe9696159, mask = 0x7e, op = clear
NOTE: initiating PST update: grp = 3, dsk = 4/0xe969615a, mask = 0x7e, op = clear
GMON updating disk modes for group 3 at 74 for pid 29, osid 29525
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: cache closing disk 0 of grp 3: SSDDG2_0000
NOTE: cache closing disk 2 of grp 3: SSDDG2_0002
NOTE: cache closing disk 4 of grp 3: SSDDG2_0004
NOTE: PST update grp = 3 completed successfully
GMON updating for reconfiguration, group 3 at 75 for pid 29, osid 29525
NOTE: cache closing disk 0 of grp 3: (not open) SSDDG2_0000
NOTE: cache closing disk 2 of grp 3: (not open) SSDDG2_0002
NOTE: cache closing disk 4 of grp 3: (not open) SSDDG2_0004
NOTE: group SSDDG2: updated PST location: disk 0001 (PST copy 0)
NOTE: group 3 PST updated.
Fri Feb 18 15:25:34 2022
NOTE: membership refresh pending for group 3/0x85a9d211 (SSDDG2)
GMON querying group 3 at 76 for pid 18, osid 9872
NOTE: cache closing disk 0 of grp 3: (not open) _DROPPED_0000_SSDDG2
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SSDDG2
NOTE: cache closing disk 4 of grp 3: (not open) _DROPPED_0004_SSDDG2
SUCCESS: refreshed membership for 3/0x85a9d211 (SSDDG2)
SUCCESS: alter diskgroup ssddg2 drop disks in failgroup qone1 force
NOTE: starting rebalance of group 3/0x85a9d211 (SSDDG2) at power 512
Starting background process ARB0
Fri Feb 18 15:25:37 2022
ARB0 started with pid=33, OS id=31058
NOTE: assigning ARB0 to group 3/0x85a9d211 (SSDDG2) with 512 parallel I/Os
cellip.ora not found.
NOTE: F1X0 copy 1 relocating from 0:2 to 1:2 for diskgroup 3 (SSDDG2)
NOTE: F1X0 copy 2 relocating from 1:2 to 0:2 for diskgroup 3 (SSDDG2)
NOTE: Rebalance has restored redundancy for any existing control file or redo log in disk group SSDDG2
NOTE: Attempting voting file refresh on diskgroup SSDDG2
NOTE: Refresh completed on diskgroup SSDDG2. No voting file found.
NOTE: stopping process ARB0
SUCCESS: rebalance completed for group 3/0x85a9d211 (SSDDG2)