linux 的RHCS实现共享储存

一、共享存储的iscsi

实验环境：

server1   172.25.37.1   

server2   172.25.37.2

server3   172.25.37.3      iscsi共享机

1.在server3上添加一块虚拟硬盘，大小为20G，并且在server1、server2上安装上iscsi服务。

[root@server1 html]# yum install iscsi-* -y

[root@server2 html]# yum install iscsi-* -y

[root@server3 ~]# yum install scsi-* -y

server3:

[root@server3 ~]# vim /etc/tgt/targets.conf

 38 <target iqn.2019-01.com.example:server.target1>
 39     backing-store /dev/vda
 40     initiator-address 172.25.37.1
 41     initiator-address 172.25.37.2
 42 </target>

[root@server3 ~]# tgt-admin -s

2.server1、server2登陆iscsi服务

server1:

[root@server1 ~]# iscsiadm -m discovery -t st -p 172.25.37.3
Starting iscsid:                                           [  OK  ]
172.25.37.3:3260,1 iqn.2019-01.com.example:server.target1
[root@server1 ~]#
[root@server1 ~]# iscsiadm -m node -l
Logging in to [iface: default, target: iqn.2019-01.com.example:server.target1, portal: 172.25.37.3,3260] (multiple)
Login to [iface: default, target: iqn.2019-01.com.example:server.target1, portal: 172.25.37.3,3260] successful.
[root@server1 ~]# fdisk -l

server2:

[root@server2 html]#  iscsiadm -m discovery -t st -p 172.25.37.3
Starting iscsid:                                           [  OK  ]
172.25.37.3:3260,1 iqn.2019-01.com.example:server.target1
[root@server2 html]#
[root@server2 html]#  iscsiadm -m node -l
Logging in to [iface: default, target: iqn.2019-01.com.example:server.target1, portal: 172.25.37.3,3260] (multiple)
Login to [iface: default, target: iqn.2019-01.com.example:server.target1, portal: 172.25.37.3,3260] successful.
[root@server2 html]# fdisk -l

3.创建LVM

server1:

[root@server1 ~]# fdisk /dev/sdb
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
Building a new DOS disklabel with disk identifier 0xbef61118.
Changes will remain in memory only, until you decide to write them.
After that, of course, the previous content won't be recoverable.

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
         switch off the mode (command 'c') and change display units to
         sectors (command 'u').

Command (m for help): n
Command action
   e   extended
   p   primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-20480, default 1): 1
Last cylinder, +cylinders or +size{K,M,G} (1-20480, default 20480): +8G

Command (m for help): t
Hex code (type L to list codes): l

 86  NTFS volume set da  Non-FS data    
 6  FAT16           4d  QNX4.x          87  NTFS volume set db  CP/M / CTOS / .
 7  HPFS/NTFS       4e  QNX4.x 2nd part 88  Linux plaintext de  Dell Utility   
 8  AIX             4f  QNX4.x 3rd part 8e  Linux LVM       df  BootIt         

Hex code (type L to list codes): 8e
Changed system type of partition 1 to 8e (Linux LVM)

Command (m for help): p

Disk /dev/sdb: 21.5 GB, 21474836480 bytes
64 heads, 32 sectors/track, 20480 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xbef61118

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1        8193     8389616   8e  Linux LVM

Command (m for help): wq
The partition table has been altered!

Calling ioctl() to re-read partition table.
Syncing disks.
[root@server1 ~]# partprobe 
Warning: WARNING: the kernel failed to re-read the partition table on /dev/sda (Device or resource busy).  As a result, it may not reflect all of your changes until after reboot.
[root@server1 ~]# fdisk -l
Disk /dev/sdb: 21.5 GB, 21474836480 bytes
64 heads, 32 sectors/track, 20480 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xbef61118

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1        8193     8389616   8e  Linux LVM
[root@server1 ~]# 

[root@server1 ~]# pvcreate /dev/sdb1
  dev_is_mpath: failed to get device for 8:17
  Physical volume "/dev/sdb1" successfully created
[root@server1 ~]# vgcreate vg0 /dev/sdb1 
  Clustered volume group "vg0" successfully created
[root@server1 ~]# lvcreate -L 5G -n lv0 vg0
Logical volume "lv_qq" created

4.格式化、挂载：

[root@server1 ~]# mkfs.ext4 /dev/vg0/lv_qq 
[root@server1 ~]# mount /dev/vg0/lv_qq /mnt/
[root@server1 ~]# cd /mnt 
[root@server1 ~]# ls
[root@server1 ~]#  lost+found
[root@server1 ~]#  vim index.html
www.westos.org

5.设置集群

6.添加资源：（先添加ip、文件系统、脚本）

[root@server1 ~]# clustat

 测试：

先手动关掉server1、集群自动启动server2。

 

7.设置共享磁盘为gfs2格式

1.创建一个新的LVM 并格式化

[root@server1 ~]#  clusvcadm -d apache
Local machine disabling service:apache...Success
[root@server1 ~]# 
[root@server1 ~]# mkfs.gfs2 -p lock_dlm -j 3 -t westos_dd:mygfs2 /dev/vg_dang/node 
This will destroy any data on /dev/vg_dang/node.
It appears to contain: symbolic link to `../dm-3'

Are you sure you want to proceed? [y/n] y

Device:                    /dev/vg_dang/node
Blocksize:                 4096
Device Size                10.00 GB (2621440 blocks)
Filesystem Size:           10.00 GB (2621438 blocks)
Journals:                  3
Resource Groups:           40
Locking Protocol:          "lock_dlm"
Lock Table:                "westos_dd:mygfs2"
UUID:                      66a89fed-c6d4-cfe8-38e8-4bd6b9118945

 

2.开机自动挂在

[root@server1 ~]# vim /etc/fstab

/dev/vg_dang/node       /var/www/html           gfs2    _netdev         0 0

[root@server1 ~]# mount -a
[root@server1 ~]# 

测试：

[root@server1 ~]#  cd /var/www/html/
[root@server1 html]# vim index.html

qweqwe

[root@foundation37 ~]# curl 172.25.37.100