dell EqualLogic测试过程

2009年第一篇。

测试设备信息：
dell 2900
dell EqualLogic PS5000 系列

ip地址配置信息：
dell 2900
eth0: 192.168.1.1
eth1: 192.168.1.2

EqulLogic 三个网卡的信息：
eth0: 192.168.1.11
eth1: 192.168.1.12
eth2: 192.168.1.13

EqualLogic group 信息:
ip: 192.168.1.10
name: grpadmin
passwd: grpadmin

[@more@]

因为是一个测试的EqulLogic阵列柜，所以送过来的时候里面都已经有配置信息了，为了重头开始学习这个阵列柜，所以重新初始化阵列柜。

一,用com口连接阵列柜，速率9600
遇到的第一个问题就比较怪异，在连接阵列柜的时候，可以显示阵列柜的启动过程，但是在login:的地方不能输入用户名和密码.(这个问题后来通过另外一跟dell提供的com口线就可以登录了。估计刚开始用的com口线有问题，但是还是不明白的是为什么可以显示呢？）

继续，因为知道ip地址，通过telnet登录测试，172.25.1.10是这台阵列柜的一个ip,运行reset清除阵列柜配置。
[root@test ~]# telnet 172.25.1.10
test> reset
Reset this array to factory defaults? [n/DeleteAllMyDataNow] DeleteAllMyDataNow
Resetting system, this will take a few minutes.
Deleting backup password files
Deleting agent.cnf
Zeroing drives, nvram and rebooting the system

阵列重新启动，此时可以通过EqulLogic Remote Setup Wizard初始化阵列。

二,安装EqulLogic Remote Setup Wizard。初始化阵列柜，初始化阵列柜和配置阵列都很简单，简单描述一下。初始化信息：

Group
Group name: test
Group IP address: 192.168.1.10

Member
member name: member01
eth0: 192.168.1.11

配置其他的信息：
1，设置时间：
Group Configuration----General----设置时间

2，新增一个guest用户：
Group Configuration----Administration-----新增一个guest用户

3，新增两个卷，配置权限信息：
Group test----Create volume-----vol01 800G
Group test----Create volume-----test 100G

4, 设置eth1,eth2 ip地址信息：
eth1: 192.168.1.12
eth2: 192.168.1.13

5，在ie界面中选择tools----Run as application.把它做为一个程序直接登录，省略中间的ie过程。

三，RedHat下的iSCSI-initiator的安装与配置
1,检查软件包：
[root@test ~]# yum list | grep iscsi
This system is not registered with RHN.
RHN support will be disabled.
iscsi-initiator-utils.x86_64 6.2.0.868-0.7.el5 base
[root@test ~]# yum install -y iscsi-initiator-utils.x86_64

2，检查服务：
[root@test ~]# chkconfig --list | grep iscsi
iscsi 0:off 1:off 2:off 3:on 4:on 5:on 6:off
iscsid 0:off 1:off 2:off 3:on 4:on 5:on 6:off
[root@test ~]#

3，启动服务：
[root@test ~]# service iscsid start
Turning off network shutdown. Starting iSCSI daemon: [ OK ]
[ OK ]
[root@test ~]# ps -ef | grep iscsid
root 1935 1 0 13:59 ? 00:00:00 iscsid
root 1936 1 0 13:59 ? 00:00:00 iscsid
root 1944 1648 0 13:59 pts/1 00:00:00 grep iscsid
[root@test ~]#

4，发现iscsi target设备：
[root@test ~]# iscsiadm -m discovery -t st -p 192.168.1.10
192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01
192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-f765cea02-3ec00000337493f4-vss-control

[root@test ~]# iscsiadm -m node
192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01
192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-f765cea02-3ec00000337493f4-vss-control
[root@test ~]#

5,登录至iscsi target设备
[root@test ~]# iscsiadm -m node -l
Logging in to [iface: default, target: iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01, portal: 192.168.1.10,3260]
Logging in to [iface: default, target: iqn.2001-05.com.equallogic:0-8a0906-f765cea02-3ec00000337493f4-vss-control, portal: 192.168.1.10,3260]
Login to [iface: default, target: iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01, portal: 192.168.1.10,3260]: successful
iscsiadm: Could not login to [iface: default, target: iqn.2001-05.com.equallogic:0-8a0906-f765cea02-3ec00000337493f4-vss-control, portal: 192.168.1.10,3260]:
iscsiadm: initiator reported error (5 - encountered iSCSI login failure)
[root@test ~]# fdisk -l

Disk /dev/sda: 146.1 GB, 146163105792 bytes
255 heads, 63 sectors/track, 17769 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 5235 41945715 8e Linux LVM
/dev/sda3 5236 5757 4192965 82 Linux swap / Solaris

Disk /dev/sdb: 859.0 GB, 859003944960 bytes
255 heads, 63 sectors/track, 104434 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table
[root@test ~]#

[root@test ~]# iscsiadm -m session
tcp: [3] 192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01
[root@test ~]#

6,取消登录iscsi target设备
[root@test ~]# iscsiadm -m node -u
Logging out of session [sid: 1, target: iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01, portal: 192.168.1.10,3260]
Logout of [sid: 1, target: iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01, portal: 192.168.1.10,3260]: successful
[root@test ~]#

7，初始化阵列后有一个vss-control的信息，这个信息就是配置vss产生的。把vss-control赋权，让test服务器的两个ip可以登录。
[root@test ~]# iscsiadm -m node -l
Logging in to [iface: default, target: iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01, portal: 192.168.1.10,3260]
Logging in to [iface: default, target: iqn.2001-05.com.equallogic:0-8a0906-f765cea02-3ec00000337493f4-vss-control, portal: 192.168.1.10,3260]
Login to [iface: default, target: iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01, portal: 192.168.1.10,3260]: successful
Login to [iface: default, target: iqn.2001-05.com.equallogic:0-8a0906-f765cea02-3ec00000337493f4-vss-control, portal: 192.168.1.10,3260]: successful
[root@test ~]# fdisk -l

Disk /dev/sda: 146.1 GB, 146163105792 bytes
255 heads, 63 sectors/track, 17769 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 5235 41945715 8e Linux LVM
/dev/sda3 5236 5757 4192965 82 Linux swap / Solaris

Disk /dev/sdb: 859.0 GB, 859003944960 bytes
255 heads, 63 sectors/track, 104434 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table

Unable to read /dev/sdc
[root@test ~]#

8，从上面可以看到vss-control不是一个硬盘设备，从阵列管理软件中取消vss的信息，取消vss-control赋权，重新发现iscsi设备:
[root@test ifaces]# iscsiadm -m discovery -t st -p 192.168.1.10
192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01
192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01
[root@test ifaces]#

9，修改自动登录选项，redhat5.2系统启动的时候是自动登录的，如果需要修改用下面的命令：
[root@test ~]# iscsiadm -m node -T iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01 -o update -n node.conn[0].startup -v automatic

四，Multipath配置：
1. 检查multipathd软件包：
[root@test ~]# rpm -aq | grep mul
device-mapper-multipath-0.4.7-17.el5
[root@test ~]#

2. 启动Multipathd：
[root@test ~]# /etc/init.d/multipathd start
Starting multipathd daemon: [ OK ]
[root@test ~]# chkconfig multipathd --list
multipathd 0:off 1:off 2:off 3:off 4:off 5:off 6:off
[root@test ~]# chkconfig multipathd on
[root@test ~]# chkconfig multipathd --list
multipathd 0:off 1:off 2:on 3:on 4:on 5:on 6:off
[root@test ~]#

3. 增加iface.eth0 iface.eth1文件
增加/var/lib/iscsi/ifaces下文件及其内容：
iface.eth0:
iface.hwaddress = 00:22:19:97:0A:CE
iface.eth1:
iface.hwaddress = 00:22:19:97:0A:D0

4，重新发现iscsi设备，需要注意的是需要先logout 原有的iscsitarget:
[root@test ~]# iscsiadm –m node -u

[root@test ifaces]# iscsiadm -m discovery -t st -p 192.168.1.10
192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01
192.168.1.10:3260,1 iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01
[root@test ifaces]#

5，修改自动登录选项，redhat5.2系统启动的时候是自动登录的，如果需要修改用下面的命令：
[root@test ~]# iscsiadm -m node -T iqn.2001-05.com.equallogic:0-8a0906-5a25cea02-b3200000339493f5-vol01 -o update -n node.conn[0].startup -v automatic

7. 修改/etc/multipath.conf 文件：
注释掉以下几行：
blacklist {
devnode "*"
}

8. 重启/etc/multipathd 服务
[root@test ~]# service multipathd restart
Stopping multipathd daemon: [ OK ]
Starting multipathd daemon: [ OK ]

10，查看multipath的状态，没有发现multipath的信息，只发现了一个本地盘的信息：
[root@test ~]# multipath -v2 -d
create: mpath0 (360022190934b1f0010b154a7049b4a25) DELL,PERC 6/i
[size=136G][features=0][hwhandler=0]
_ round-robin 0 [prio=1][undef]
_ 0:2:0:0 sda 8:0 [undef][ready]
[root@test ~]# fdisk -l

Disk /dev/sda: 146.1 GB, 146163105792 bytes
255 heads, 63 sectors/track, 17769 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 5235 41945715 8e Linux LVM
/dev/sda3 5236 5757 4192965 82 Linux swap / Solaris

Disk /dev/sdc: 859.0 GB, 859003944960 bytes
255 heads, 63 sectors/track, 104434 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdc doesn't contain a valid partition table

Disk /dev/sdb: 859.0 GB, 859003944960 bytes
255 heads, 63 sectors/track, 104434 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table

Disk /dev/dm-1: 859.0 GB, 859003944960 bytes
255 heads, 63 sectors/track, 104434 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/dm-1 doesn't contain a valid partition table
[root@test ~]#

11，查看错误日志信息：
[root@test ~]# date
Wed Dec 10 19:59:24 CST 2008
[root@test ~]# /etc/init.d/multipathd restart
Stopping multipathd daemon: [ OK ]
Starting multipathd daemon: [ OK ]
[root@test ~]# tail -n 20 /var/log/messages
Dec 10 19:59:01 test multipathd: [copy.c] cannot open /sbin/dasd_id
Dec 10 19:59:01 test multipathd: cannot copy /sbin/dasd_id in ramfs : No such file or directory
Dec 10 19:59:01 test multipathd: [copy.c] cannot open /sbin/gnbd_import
Dec 10 19:59:01 test multipathd: cannot copy /sbin/gnbd_import in ramfs : No such file or directory
Dec 10 19:59:01 test kernel: device-mapper: table: 253:3: multipath: error getting device
Dec 10 19:59:01 test kernel: device-mapper: ioctl: error adding target to table
Dec 10 19:59:01 test multipathd: mpath1: event checker started
Dec 10 19:59:01 test multipathd: path checkers start up
Dec 10 19:59:27 test multipathd: mpath1: stop event checker thread
Dec 10 19:59:27 test multipathd: --------shut down-------
Dec 10 19:59:28 test multipathd: cannot open /sbin/dasd_id : No such file or directory
Dec 10 19:59:28 test multipathd: cannot open /sbin/gnbd_import : No such file or directory
Dec 10 19:59:28 test multipathd: [copy.c] cannot open /sbin/dasd_id
Dec 10 19:59:28 test multipathd: cannot copy /sbin/dasd_id in ramfs : No such file or directory
Dec 10 19:59:28 test multipathd: [copy.c] cannot open /sbin/gnbd_import
Dec 10 19:59:28 test multipathd: cannot copy /sbin/gnbd_import in ramfs : No such file or directory
Dec 10 19:59:28 test kernel: device-mapper: table: 253:3: multipath: error getting device
Dec 10 19:59:28 test kernel: device-mapper: ioctl: error adding target to table
Dec 10 19:59:28 test multipathd: mpath1: event checker started
Dec 10 19:59:28 test multipathd: path checkers start up
[root@test ~]#

查找这个/sbin/dasd_id 文件，在rpm仓库中没有发现：
[root@test ~]# yum whatprovides /sbin/dasd_id
Loading "security" plugin
Loading "rhnplugin" plugin
This system is not registered with RHN.
RHN support will be disabled.
No Matches found
[root@test ~]#

12，上面的问题的解决方法,让配置文件重新生效。
重启服务，让配置文件生效的方法：
1，Stop the multipathd service.
2，Clear old multipath bindings by entering
/sbin/multipath -F
3，Create new multipath bindings by entering
/sbin/multipath -v2 -l
4，Start the multipathd service. //更改配置文件后需要做上面的操作才可以让配置文件的更改生效。

几个比较有用的命令
1.start/stop multipathd process "service multipathd start/stop"
2.display the multipath topology "multipath -ll" //非常有用的命令。
3.display the multipath debug info "multipath -v3"
4.Scan the HD "fdisk -l"
5.view the FC wwn " cat /sys/class/fc_host/host1/node_name "

13，检查状态：
[root@test ~]# service multipathd restart
Stopping multipathd daemon: [ OK ]
Starting multipathd daemon: [ OK ]
[root@test ~]# multipath -ll
mpath1 (36090a028a0ce255af5939433000020b3) dm-1 EQLOGIC,100E-00
[size=800G][features=0][hwhandler=0]
_ round-robin 0 [prio=1][active]
_ 3:0:0:0 sdb 8:16 [active][ready]
_ round-robin 0 [prio=1][enabled]
_ 4:0:0:0 sdc 8:32 [active][ready]
[root@test ~]#

14，修改对应配置multipath.conf 文件。wwwid就是通过multipath -ll显示的id号码，alias名字可以起一个自己好记的名字：
multipaths {
multipath {
wwid 36090a028a0ce255af5939433000020b3
alias vol1
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
failback immediate
rr_weight priorities
no_path_retry 5
}

15，多路径磁盘的分区及使用：
1, 用fdisk 分区 /dev/dm-1
2, create all device node on this device
kpartx -a /dev/dm-1
3，lists all partitions on this device
kpartx -l /dev/dm-1
4，重新启动操作系统

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/312079/viewspace-1016054/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/312079/viewspace-1016054/