oracle acfs snap 恢复,删除ACFS系统碰到的问题

首先尝试UMOUNT文件系统：

[oracle@xsh-server1 ~]$ df -k

Filesystem 1K-blocks Used Available Use% Mounted on

/dev/mapper/VolGroup00-LogVol00 435653856 192338280 220828536 47% /

/dev/sda1 101086 16919 78948 18% /boot

tmpfs 65968984 195784 65773200 1% /dev/shm

/dev/asm/acfsdgvol1-57624951296 165746644 459204652 27% /backup

[root@xsh-server1 ~]# umount -t

acfs /backup

在节点2上执行同样的UMOUNT操作：

[root@xsh-server2 asm]# umount -t

acfs /backup/

在节点1上取消acfs的注册信息：

[root@xsh-server1 ~]# acfsutil

registry -m /dev/asm/acfsdgvol1-57

/backup

[root@xsh-server1 ~]# acfsutil registry -d /dev/asm/acfsdgvol1-57

acfsutil registry: successfully removed ACFS volume /dev/asm/acfsdgvol1-57 from

Oracle Registry

但是随后删除acfs文件系统的时候出现了错误：

[root@xsh-server1 ~]# acfsutil rmfs

/dev/asm/acfsdgvol1-57

acfsutil rmfs: ACFS-00511: /dev/asm/acfsdgvol1-57 is mounted on at least one

node of the cluster.

acfsutil rmfs: ACFS-03014: file system not removed

由于文件系统无法删除，是的VOLUME同样无法删除：

[root@xsh-server1 ~]# su - grid

[grid@xsh-server1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.2.0

Production on Thu Aug 11 11:15:02 2011

Copyright (c) 1982, 2010, Oracle.

All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

SQL> SELECT GROUP_NUMBER,

VOLUME_NAME, SIZE_MB, STATE, USAGE, VOLUME_DEVICE, MOUNTPATH

2 FROM V$ASM_VOLUME;

GROUP_NUMBER VOLUME_NAME SIZE_MB

STATE USAGE VOLUME_DEVICE MOUNTPATH

------------ ----------- ------- ------- ----- ----------------------

----------

4 ACFSDGVOL1 610304 ENABLED

ACFS /dev/asm/acfsdgvol1-57 /backup

SQL> SELECT GROUP_NUMBER, NAME

FROM V$ASM_DISKGROUP WHERE GROUP_NUMBER = 4;

GROUP_NUMBER NAME

------------ ------------------------------

4 ACFSDG

SQL> ALTER DISKGROUP ACFSDG

DISABLE VOLUME ACFSDGVOL1;

ALTER DISKGROUP ACFSDG DISABLE VOLUME ACFSDGVOL1

*

ERROR at line 1:

ORA-15032: not all alterations performed

ORA-15468: volume 'ACFSDGVOL1' in diskgroup 'ACFSDG' is currently being

accessed

尝试在ASMCMD中操作，同样无法删除VOLUME：

[grid@xsh-server1 ~]$ asmcmd

ASMCMD> volinfo -a

Diskgroup Name: ACFSDG

Volume Name: ACFSDGVOL1

Volume Device: /dev/asm/acfsdgvol1-57

State: ENABLED

Size (MB): 610304

Resize Unit (MB): 256

Redundancy: UNPROT

Stripe Columns: 4

Stripe Width (K): 128

Usage: ACFS

Mountpath: /backup

ASMCMD> voldelete -G ACFSDG

ACFSDGVOL1

ORA-15032: not all alterations performed

ORA-15468: volume 'ACFSDGVOL1' in diskgroup 'ACFSDG' is currently being

accessed (DBD ERROR: OCIStmtExecute)

ASMCMD> voldisable -a

ORA-15032: not all alterations performed

ORA-15468: volume 'ACFSDGVOL1' in diskgroup 'ACFSDG' is currently being

accessed (DBD ERROR: OCIStmtExecute)

ASMCMD> quit

[grid@xsh-server1 ~]$ exit

尝试各种方法，都无法以常规的方法删除ACFS文件系统和ASM中创建的VOLUME，没有办法，最终只是使用强制的方法来删除：

[grid@xsh-server1 ~]$ id

uid=1300(grid) gid=1000(oinstall) groups=1000(oinstall),1200(dba)

context=user_u:system_r:unconfined_t

[grid@xsh-server1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.2.0

Production on Thu Aug 11 12:59:35 2011

Copyright (c) 1982, 2010, Oracle.

All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

SQL> set pages 100 lines 120

SQL> SELECT GROUP_NUMBER, NAME FROM V$ASM_DISKGROUP;

GROUP_NUMBER NAME

------------ ------------------------------

1 CRSDG

2 DATADG

3 FRADG

4 ACFSDG

SQL> DROP DISKGROUP ACFSDG;

DROP DISKGROUP ACFSDG

*

ERROR at line 1:

ORA-15039: diskgroup not dropped

ORA-15053: diskgroup "ACFSDG" contains existing files

SQL> DROP DISKGROUP ACFSDG INCLUDING CONTENTS;

DROP DISKGROUP ACFSDG INCLUDING CONTENTS

*

ERROR at line 1:

ORA-15039: diskgroup not dropped

ORA-15027: active use of diskgroup "ACFSDG" precludes its dismount

SQL> DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS;

DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS

*

ERROR at line 1:

ORA-15039: diskgroup not dropped

ORA-15230: diskgroup 'ACFSDG' does not require the FORCE option

SQL> ALTER DISKGROUP ACFSDG DISMOUNT;

ALTER DISKGROUP ACFSDG DISMOUNT

*

ERROR at line 1:

ORA-15032: not all alterations performed

ORA-15027: active use of diskgroup "ACFSDG" precludes its dismount

SQL> ALTER DISKGROUP ACFSDG DISMOUNT FORCE;

Diskgroup altered.

SQL> DROP DISKGROUP ACFSDG;

DROP DISKGROUP ACFSDG

*

ERROR at line 1:

ORA-15039: diskgroup not dropped

ORA-15001: diskgroup "ACFSDG" does not exist or is not mounted

SQL> DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS;

DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS

*

ERROR at line 1:

ORA-15039: diskgroup not dropped

ORA-15073: diskgroup ACFSDG is mounted by another ASM instance

利用DISMOUNT

FORCE的选项，终于将磁盘组ACFSDG卸载，由于另外的ASM实例还加载这个磁盘组，因此这个磁盘组暂时还不能删除。

登录另外的实例，执行DISMOUNT操作：

[root@xsh-server2 dev]# su - grid

[grid@xsh-server2 ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.2.0

Production on Thu Aug 11 13:11:55 2011

Copyright (c) 1982, 2010, Oracle.

All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

SQL> set pages 100 lines 120

SQL> select group_number, name, state from v$asm_diskgroup;

GROUP_NUMBER NAME STATE

------------ ------------------------------ -----------

1 CRSDG MOUNTED

2 DATADG MOUNTED

3 FRADG MOUNTED

4 ACFSDG MOUNTED

SQL> alter diskgroup acfsdg

dismount;

Diskgroup altered.

下面会到第一个节点，再次执行删除操作：

SQL> DROP DISKGROUP ACFSDG;

DROP DISKGROUP ACFSDG

*

ERROR at line 1:

ORA-15039: diskgroup not dropped

ORA-15001: diskgroup "ACFSDG" does not exist or is not mounted

SQL> DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS;

Diskgroup dropped.

SQL> SELECT GROUP_NUMBER, NAME

FROM V$ASM_DISKGROUP;

GROUP_NUMBER NAME

------------ ------------------------------

1 CRSDG

2 DATADG

3 FRADG

SQL> EXIT

Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 -

64bit Production

With the Real Application Clusters and Automatic Storage Management options

[grid@xsh-server1 ~]$ df -k

Filesystem 1K-blocks Used Available Use% Mounted on

/dev/mapper/VolGroup00-LogVol00 435653856 192353508 220813308 47% /

/dev/sda1101086 16919 78948 18% /boot

tmpfs 65968984 19578465773200 1% /dev/shm

最后利用ORACLEASM删除对应的设备：

[grid@xsh-server1 ~]$ su -

Password:

[root@xsh-server1 ~]# oracleasm listdisks

VOL1

VOL2

VOL3

VOLACFS

[root@xsh-server1 ~]# oracleasm deletedisk VOLACFS

Clearing disk header: done

Dropping disk: done

在另外的节点执行检查ASM磁盘组和ORACLEASM设备，确认节点1上的操作在两个节点上都已经生效：

SQL> select group_number, name,

state from v$asm_diskgroup;

GROUP_NUMBER NAME STATE

------------ ------------------------------ -----------

1 CRSDG MOUNTED

2 DATADG MOUNTED

3 FRADG MOUNTED

SQL> EXIT

Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 -

64bit Production

With the Real Application Clusters and Automatic Storage Management options

[grid@xsh-server2 ~]$ exit

logout

[root@xsh-server2 dev]# oracleasm

scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks...

Cleaning disk "VOLACFS"

Scanning system for ASM disks...

[root@xsh-server2 dev]# oracleasm listdisks

VOL1

VOL2

VOL3

虽然最终通过强制的方式删除了ACFS文件系统和对应的磁盘组，但是这种强制的方式很可能在操作系统级别上还留下一下没有清除的信息。

显然ACFS这项新技术还存在很多的bug，而且在处理这个问题时也发现，即使是在metalink上，关于ACFS的信息也非常少，虽然存在一个和当前几乎完全一样的问题，但是并没有下文，Oracle也没有给出任何解决的方法。

如果打算在产品环境中使用ACFS，还是要经过大量的测试才行。