ClusterStorage-12-分层管理实验

0.实验前的环境检查与配置

[student@workstation ~]$ lab tiering-lab setup
 

1.存储信息

gluster volume info prod-vol查看存储卷的信息。注意：此时只有副本模式的2个存储条。for I in server{c,d}对两个节点进行遍历，发现可用的存储条。

[root@serverc ~]# gluster volume info prod-vol
 
Volume Name: prod-vol
Type: Replicate
Volume ID: 9b5b97c7-499e-4781-b405-20badc9042ce
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: serverc:/bricks/brick-c1/brick
Brick2: serverd:/bricks/brick-d1/brick
Options Reconfigured:
performance.readdir-ahead: on
[student@workstation ~]$ for I in server{c,d}
> do
>  ssh ${I} "mount | grep brick"
> done
Warning: Permanently added 'serverc,172.25.250.12' (ECDSA) to the list of known hosts.
/dev/mapper/vg_bricks-brick--c1 on /bricks/brick-c1 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c2 on /bricks/brick-c2 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c3 on /bricks/brick-c3 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c4 on /bricks/brick-c4 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c5 on /bricks/brick-c5 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c6 on /bricks/brick-c6 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
Warning: Permanently added 'serverd,172.25.250.13' (ECDSA) to the list of known hosts.
/dev/mapper/vg_bricks-brick--d1 on /bricks/brick-d1 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d2 on /bricks/brick-d2 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d3 on /bricks/brick-d3 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d4 on /bricks/brick-d4 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d5 on /bricks/brick-d5 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d6 on /bricks/brick-d6 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
 

2.添加存储条

gluster volume tier prod-vol attach replica 2添加c2 d2两个存储条，并且设置为副本模式。

[root@serverc ~]# gluster volume tier prod-vol attach replica 2 \
> serverc:/bricks/brick-c2/brick \
> serverd:/bricks/brick-d2/brick
volume attach-tier: success
Tiering Migration Functionality: prod-vol: success: Attach tier is successful on prod-vol. use tier status to check the status.
ID: eeb17f63-83a8-4941-a5a9-1297e4a5923b
 

3.存储信息

gluster volume info prod-vol查看存储信息。注意：此时已有了热区分层，即刚添加的两个存储条，而之前已经存在的两个存储条则变为冷区分层。

[root@serverc ~]# gluster volume info prod-vol
 
Volume Name: prod-vol
Type: Tier
Volume ID: 9b5b97c7-499e-4781-b405-20badc9042ce
Status: Started
Number of Bricks: 4
Transport-type: tcp
Hot Tier :
Hot Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick1: serverd:/bricks/brick-d2/brick
Brick2: serverc:/bricks/brick-c2/brick
Cold Tier:
Cold Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick3: serverc:/bricks/brick-c1/brick
Brick4: serverd:/bricks/brick-d1/brick
Options Reconfigured:
cluster.tier-mode: cache
features.ctr-enabled: on
performance.readdir-ahead: on
 

4.分层状态

gluster volume tier prod-vol status查看分层状态信息。

[root@serverc ~]# gluster volume tier prod-vol status
Node                 Promoted files       Demoted files        Status              
---------            ---------            ---------            ---------           
localhost            0                    0                    in progress         
serverd.lab.example.com 0                    0                    in progress         
Tiering Migration Functionality: prod-vol: success
 

5.存储信息

gluster volume info dev-vol查看存储信息。注意：此时有6个存储条，其中4个用于热区分层，模式为分布副本模式，2个用于冷区分层，模式为副本模式。

[root@serverc ~]# gluster volume info dev-vol
 
Volume Name: dev-vol
Type: Tier
Volume ID: 86419ff5-3593-42e7-865b-71cb3742b1fb
Status: Started
Number of Bricks: 6
Transport-type: tcp
Hot Tier :
Hot Tier Type : Distributed-Replicate
Number of Bricks: 2 x 2 = 4
Brick1: serverd:/bricks/brick-d6/brick
Brick2: serverc:/bricks/brick-c6/brick
Brick3: serverd:/bricks/brick-d5/brick
Brick4: serverc:/bricks/brick-c5/brick
Cold Tier:
Cold Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick5: serverc:/bricks/brick-c4/brick
Brick6: serverd:/bricks/brick-d4/brick
Options Reconfigured:
cluster.tier-mode: cache
features.ctr-enabled: on
performance.readdir-ahead: on
 

6.配置拓展

gluster volume tier dev-vol detach start开启存储分区调整。gluster volume tier dev-vol detach status查看状态信息。 gluster volume tier dev-vol detach commit确认调整开始。rm -rf /bricks/brick-c6/brick删除原有存储条。mkdir /bricks/brick-c6/brick新建存储条。serverd参照serverc进行操作。gluster volume tier dev-vol attach replica 2 添加存储条并设置副本模式参数为2。

[root@serverc ~]# gluster volume tier dev-vol detach start
volume detach-tier start: success
ID: 62482dd0-e0c3-46bd-b81a-8be348f657fc
[root@serverc ~]# gluster volume tier dev-vol detach status
                                    Node Rebalanced-files          size       scanned      failures       skipped               status   run time in secs
                               ---------      -----------   -----------   -----------   -----------   -----------         ------------     --------------
                               localhost                0        0Bytes             0             0             0            completed               1.00
                 serverd.lab.example.com                0        0Bytes             0             0             0            completed               2.00
[root@serverc ~]# gluster volume tier dev-vol detach commit
Removing tier can result in data loss. Do you want to Continue? (y/n) y
volume detach-tier commit: success
Check the detached bricks to ensure all files are migrated.
If files with data are found on the brick path, copy them via a gluster mount point before re-purposing the removed brick. 
[root@serverc ~]# rm -rf /bricks/brick-c6/brick
[root@serverc ~]# mkdir /bricks/brick-c6/brick
[root@serverd ~]# rm -rf /bricks/brick-d6/brick
[root@serverd ~]# mkdir /bricks/brick-d6/brick
[root@serverc ~]# gluster volume tier dev-vol attach replica 2 \
> serverc:/bricks/brick-c6/brick \
> serverd:/bricks/brick-d6/brick
volume attach-tier: success
Tiering Migration Functionality: dev-vol: success: Attach tier is successful on dev-vol. use tier status to check the status.
ID: a4e4d4c9-37cc-4704-bc61-ee18196c5179
 

7.存储信息

gluster volume info dev-vol查看存储卷的信息。注意：此时只有4个存储条。其中c6 d6即刚添加的新存储条为热区分层，而原来的冷区分层并未发生改变。

[root@serverc ~]# gluster volume info dev-vol
 
Volume Name: dev-vol
Type: Tier
Volume ID: 86419ff5-3593-42e7-865b-71cb3742b1fb
Status: Started
Number of Bricks: 4
Transport-type: tcp
Hot Tier :
Hot Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick1: serverd:/bricks/brick-d6/brick
Brick2: serverc:/bricks/brick-c6/brick
Cold Tier:
Cold Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick3: serverc:/bricks/brick-c4/brick
Brick4: serverd:/bricks/brick-d4/brick
Options Reconfigured:
cluster.tier-mode: cache
features.ctr-enabled: on
performance.readdir-ahead: on
 

8.任务测评

lab tiering-lab grade进行任务测评。主要包括：热区分层的启用，热区分层存储条的使用等。

[student@workstation ~]$ lab tiering-lab grade

Grading the student's work:

 · Checking hot tier enabled for prod-vol......................  PASS
 · Checking hot tier enabled for dev-vol.......................  PASS
 · Checking hot tier bricks for prod-vol.......................  PASS
 · Checking hot tier bricks for dev-vol........................  PASS

Overall lab grade..............................................  PASS