1 什么是ACFS
Oracle自动存储管理集群文件系统(Oracle ACFS)是一种新的多平台、可扩展的文件系统和存储管理设计，扩展了Oracle自动存储管理(Oracle ASM)技术，以支持所有应用数据。Oracle ACFS提供了动态文件系统大小调整，并通过跨所有可用存储的分布、平衡和条带化技术提高了性能，并通过Oracle ASM的镜像和奇偶校验保护提供了存储可靠性。
2 什么是Oracle Flex ASM
Oracle Flex ASM 是一个基于 cardinality 定义在集群环境中运行的 ASM 实例。 默认的 cardinality 是 3， 但是你可以使用” srvctl modify asm”的命令来修改它。这意味着 ASM 实例并不是需要在每个节点都运行。
在过去的版本里，ASM 实例需要在每一个节点运行，而 ASM 的客户端（Database，ACFS，ADVM）只可以访问本地的 ASM 实例。
如果使用了 Oracle Flex ASM， ASM 的客户端就可以通过网络（比如：ASM 网络）访问远程的 ASM 实例。如果一个运行 ASM 实例的节点宕掉，Oracle 集群会在另外一个节点上启动一个新的 ASM 实例以此维持它的 cardinality。 同样，如果一个 12c 数据库实例连接了某一个 ASM 实例，而这个 ASM 实例 crash 掉或者实例运行出错，这个数据库的实例会尝试重新连接在另一个节点的一个已经存在的 ASM 实例。 这些新特性统称为 Oracle Flex ASM。
从12.2开始，Flex的属性被默认启动，也不能被禁用。
[grid@rac01 ~]$ asmcmd
ASMCMD> showclustermode
ASM cluster : Flex mode enabled - Direct Storage Access
ASMCMD> showclusterstate
Normal
ASMCMD>
3 什么是Oracle proxy ASM Instance
Oracle 通过配置 proxy ASM Instance 来支持 ACFS/ADVM。Oracle proxy ASM 可以运行在 ASM instance 的相同节点，也可以运行在 Flex ASM 情况下的不同节点。
以下的图示表明，节点2的 ACFS/ADVM 和同节点的 Oracle Proxy ASM 通信， 而 Oracle Proxy ASM 又连接到节点1上的 ASM 实例。
4 OS加载ACFS模块
RAC所有节点都需要单独执行。
#加载acfs模块，-s是静默，不输出
/u01/app/19.0.0/grid/bin/acfsload start -s
#检查是否加载
lsmod |grep -i oracle
[root@rac01 ~]# acfsload start
ACFS-9391: Checking for existing ADVM/ACFS installation.
ACFS-9392: Validating ADVM/ACFS installation files for operating system.
ACFS-9393: Verifying ASM Administrator setup.
ACFS-9308: Loading installed ADVM/ACFS drivers.
ACFS-9325: Driver OS kernel version = 3.10.0-862.el7.x86_64.
ACFS-9326: Driver build number = 210707.
ACFS-9212: Driver build version = 19.0.0.0.0 (19.12.0.0.0).
ACFS-9547: Driver available build number = 210707.
ACFS-9548: Driver available build version = 19.0.0.0.0 (19.12.0.0.0).
ACFS-9549: Kernel and command versions.
Kernel:
Build version: 19.0.0.0.0
Build full version: 19.12.0.0.0
Build hash: 9256567290
Bug numbers: NoTransactionInformation
Commands:
Build version: 19.0.0.0.0
Build full version: 19.12.0.0.0
Build hash: 9256567290
Bug numbers: NoTransactionInformation
ACFS-9327: Verifying ADVM/ACFS devices.
ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
ACFS-9156: Detecting control device '/dev/ofsctl'.
ACFS-9294: updating file /etc/sysconfig/oracledrivers.conf
ACFS-9322: completed
[root@rac01 ~]#
[root@rac01 ~]# lsmod |grep oracle
oracleacfs 5184608 0
oracleadvm 1163390 0
oracleoks 757134 2 oracleacfs,oracleadvm
[root@rac01 ~]#
5 磁盘组compatibility
确保磁盘组compatibility大于或等于11.2
select name,compatibility from v$asm_diskgroup;
#修改磁盘组的compatibility 属性
su - grid
sqlplus / as sysasm
ALTER DISKGROUP STDDG SET ATTRIBUTE ‘compatible.asm’ = ‘19.0’;
6 OS开机自动加载ACFS模块
没有配置，默认开机自动加载
7 命令行创建ACFS
建议新建一个磁盘组，专门用于做acfs卷，也可使用现有磁盘组。
7.1 创建volume
#也可以使用alert命令创建
ASMCMD [+] > volcreate -G DATA1 -s 1g vol1
ASMCMD [+] > volinfo --all
#alert日志输出
2022-07-05T17:19:07.898907+08:00
SQL> /* ASMCMD */alter diskgroup DATA1 add volume 'vol1' size 1g
2022-07-05T17:19:07.908582+08:00
NOTE: Advancing AVD compatibility to 19.0.0.0.0 for grp 1
2022-07-05T17:19:07.912711+08:00
GMON querying group 1 at 9 for pid 37, osid 103924
2022-07-05T17:19:07.913673+08:00
SUCCESS: Advanced compatible.advm to 19.0.0.0.0 for grp 1
2022-07-05T17:19:27.736228+08:00
NOTE: Flex client id 0x0 [+APX1:+APX:rac-19c-cluster] attempting to connect
NOTE: registered owner id 0x10000 for +APX1:+APX:rac-19c-cluster
NOTE: Flex client +APX1:+APX:rac-19c-cluster registered, osid 124687, mbr 0x0, asmb 124591 (reg:0)
2022-07-05T17:19:27.975898+08:00
NOTE: registering VUBG [124595] for client +APX1:+APX:rac-19c-cluster; FG ospid 124703
2022-07-05T17:19:33.685999+08:00
NOTE: volume resource ora.DATA1.VOL1.advm is created
2022-07-05T17:19:33.967701+08:00
NOTE: client +APX1:+APX:rac-19c-cluster mounted group 1 (DATA1)
2022-07-05T17:19:35.197677+08:00
NOTE: volume resource ora.DATA1.VOL1.advm is online
NOTE: volume resource ora.DATA1.VOL1.advm requested to start globally
2022-07-05T17:19:35.209705+08:00
SUCCESS: /* ASMCMD */alter diskgroup DATA1 add volume 'vol1' size 1g
#验证
ls -l /dev/asm/
[grid@rac01 ~]$ ls -l /dev/asm/vol1-311
brwxrwx--- 1 root asmadmin 252, 159233 7月 5 17:19 /dev/asm/vol1-311
[grid@rac01 ~]$
ASMCMD [+] > volinfo --all
Diskgroup Name: DATA1
Volume Name: VOL1
Volume Device: /dev/asm/vol1-311
State: ENABLED
Size (MB): 1024
Resize Unit (MB): 64
Redundancy: MIRROR
Stripe Columns: 8
Stripe Width (K): 1024
Usage:
Mountpath:
7.2 创建acfs文件系统
mkfs.acfs /dev/asm/vol1-311
[grid@rac01 ~]$ mkfs.acfs /dev/asm/vol1-311
mkfs.acfs: version = 19.0.0.0.0
mkfs.acfs: on-disk version = 46.0
mkfs.acfs: volume = /dev/asm/vol1-311
mkfs.acfs: volume size = 1073741824 ( 1.00 GB )
mkfs.acfs: Format complete.
[grid@rac01 ~]$
7.3 创建挂载点
两个节点分别创建挂载点，并修改需要的权限
[root@rac01 ~]# mkdir /goldengate
[root@rac01 ~]# chown oracle:oinstall /goldengate
[root@rac01 ~]# ls -ld /goldengate
drwxr-xr-x 2 oracle oinstall 6 7月 5 17:27 /goldengate
[root@rac01 ~]#
7.4 注册acfs资源
#root用户执行：
srvctl add filesystem -device /dev/asm/vol1-311 -path /goldengate -user oracle -mountowner oracle -mountgroup oinstall -mountperm 755
srvctl start filesystem -device /dev/asm/vol1-311
[root@rac01 ~]# srvctl add filesystem -device /dev/asm/vol1-311 -path /goldengate -user oracle -mountowner oracle -mountgroup oinstall -mountperm 755
[root@rac01 ~]# srvctl start filesystem -device /dev/asm/vol1-311
7.5 检查挂载状态
df -h
crsctl stat res -t
crsctl stat res ora.proxy_advm -t
crsctl stat res ora.DATA1.VOL1.advm -t
[root@rac02 ~]# crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA1.VOL1.advm
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
ora.LISTENER_DG.lsnr
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
ora.chad
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
ora.net1.network
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
ora.ons
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
ora.proxy_advm
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE rac01 STABLE
2 ONLINE ONLINE rac02 STABLE
3 ONLINE OFFLINE STABLE
ora.DATA1.dg(ora.asmgroup)
1 ONLINE ONLINE rac01 STABLE
2 ONLINE ONLINE rac02 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac01 STABLE
ora.OCRDG.dg(ora.asmgroup)
1 ONLINE ONLINE rac01 STABLE
2 ONLINE ONLINE rac02 STABLE
3 OFFLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE rac01 Started,STABLE
2 ONLINE ONLINE rac02 Started,STABLE
3 ONLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE rac01 STABLE
2 ONLINE ONLINE rac02 STABLE
3 ONLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE rac01 STABLE
ora.newdb.db
1 ONLINE ONLINE rac01 Open,HOME=/u01/app/o
racle/product/19.0.0
/db_1,STABLE
2 ONLINE ONLINE rac02 Open,HOME=/u01/app/o
racle/product/19.0.0
/db_1,STABLE
ora.qosmserver
1 ONLINE ONLINE rac01 STABLE
ora.rac01.vip
1 ONLINE ONLINE rac01 STABLE
ora.rac02.vip
1 ONLINE ONLINE rac02 STABLE
ora.scan1.vip
1 ONLINE ONLINE rac01 STABLE
--------------------------------------------------------------------------------
[root@rac02 ~]# crsctl stat res ora.proxy_advm -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.proxy_advm
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
--------------------------------------------------------------------------------
[root@rac02 ~]# crsctl stat res ora.DATA1.VOL1.advm -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA1.VOL1.advm
ONLINE ONLINE rac01 STABLE
ONLINE ONLINE rac02 STABLE
--------------------------------------------------------------------------------
[root@rac02 ~]#
8 删除acfs文件系统
8.1 取消注册
acfsutil registry -d /dev/asm/vol1-311
[root@rac01 ~]# acfsutil registry -d /dev/asm/vol1-311
acfsutil registry: successfully removed ACFS volume /dev/asm/vol1-311 from Oracle Registry
[root@rac01 ~]#
[root@rac01 ~]# umount /goldengate/
umount: /goldengate/：未挂载
[root@rac01 ~]#
8.2 删除文件系统
acfsutil rmfs /dev/asm/vol1-311
[root@rac01 ~]# acfsutil rmfs /dev/asm/vol1-311
8.3删除ADVM volume
#也可以直接删除，不执行disable也行
ASMCMD [+] > voldisable -G DATA1 vol1
ASMCMD [+] > voldelete -G DATA1 vol1
8.4 删除挂载点
rmdir /goldengate
8.5移除proxy asm instance
srvctl stop asm -proxy
srvctl remove asm -proxy
[root@rac01 ~]# srvctl stop asm -proxy
[root@rac01 ~]# srvctl remove asm -proxy
9 常用命令
9.1 检查acfs文件系统状态
#检查asm代理实例
srvctl config asm -proxy -detail
#检查acfs文件系统状态
acfsutil info fs
ASMCMD> volinfo --all
[grid@rac01 ~]$ srvctl config asm -proxy -detail
ASM home: <CRS home>
ADVM proxy is enabled
ADVM proxy is individually enabled on nodes:
ADVM proxy is individually disabled on nodes:
Spfile:
[grid@rac01 ~]$
[root@rac02 goldengate]# acfsutil info fs
/goldengate
ACFS Version: 19.0.0.0.0
on-disk version: 49.0
compatible.advm: 19.0.0.0.0
ACFS compatibility: 19.0.0.0.0
flags: MountPoint,Available,KiloSnap
creation time: Tue Jul 5 17:25:33 2022
mount time: Tue Jul 5 17:33:59 2022
mount sequence number: 1
number of nodes: 2
allocation unit: 4096
metadata block size: 4096
volumes: 1
total size: 1073741824 ( 1.00 GB )
total free: 429023232 ( 409.15 MB )
file entry table allocation: 393216
primary volume: /dev/asm/vol1-311
label:
state: Available
major, minor: 252, 159233
logical sector size: 512
size: 1073741824 ( 1.00 GB )
free: 429023232 ( 409.15 MB )
metadata read I/O count: 3166
metadata write I/O count: 37
total metadata bytes read: 13045760 ( 12.44 MB )
total metadata bytes written: 233472 ( 228.00 KB )
ADVM diskgroup: DATA1
ADVM resize increment: 67108864
ADVM redundancy: mirror
ADVM stripe columns: 8
ADVM stripe width: 1048576
number of snapshots: 0
snapshot space usage: 0 ( 0.00 )
replication status: DISABLED
compression status: DISABLED
[root@rac02 goldengate]#
ASMCMD> volinfo --all
Diskgroup Name: DATA1
Volume Name: VOL1
Volume Device: /dev/asm/vol1-311
State: ENABLED
Size (MB): 1024
Resize Unit (MB): 64
Redundancy: MIRROR
Stripe Columns: 8
Stripe Width (K): 1024
Usage: ACFS
Mountpath: /goldengate
ASMCMD>
9.2 扩容缩容acfs
#查看最小调整大小
sqlplus / as sysasm
select VOLUME_NAME,SIZE_MB,RESIZE_UNIT_MB from v$asm_volume;
SQL> select VOLUME_NAME,SIZE_MB,RESIZE_UNIT_MB from v$asm_volume;
VOLUME_NAME SIZE_MB RESIZE_UNIT_MB
------------------------------ ---------- --------------
VOL1 1024 64
[grid@rac01 ~]$ acfsutil size +10m /goldengate
acfsutil size: new file system size: 1140850688 (1088MB)
[grid@rac01 ~]$ acfsutil size +10m /goldengate
acfsutil size: new file system size: 1207959552 (1152MB)
[grid@rac01 ~]$ acfsutil size -10m /goldengate
acfsutil size: new file system size: 1207959552 (1152MB)
acfsutil size: The volume size did not change because space is always rounded to multiples of the ASM resize increment.
[grid@rac01 ~]$ acfsutil size -64m /goldengate
acfsutil size: new file system size: 1140850688 (1088MB)
[grid@rac01 ~]$
select VOLUME_NAME,SIZE_MB,RESIZE_UNIT_MB from v$asm_volume;
10 问题
10.1 手工挂载
如果acfs模块没有开机自动加载，则手工挂载。
两个节点都需执行：
[root@db2 ~]# acfsload start -s
[grid@db2 ~]$ sqlplus / as sysasm
SQL> select INST_ID,GROUP_NUMBER,VOLUME_NAME,STATE from gv$asm_volume;
SQL> alter diskgroup datadg enable volume vol1;
[root@db2 ~]# mount -t acfs -rw /dev/asm/vol1-201 /goldengate
1474
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
