linux中的iscsi和网卡绑定

 

一.         服务器接口说明

1.1              服务器背面接口示意图如下:

 

1.2              接口说明如下:

Eth4:Eth5:Eth6:Eth7:绑定为网卡bond0

IP地址: 10.77.10.2

子网掩码:255.255.255.0

二.         详细配置

2.1              主机名设置:

2.1.1设置方法:

Vi /etc/sysconfig/network

修改hostname选项为如下内容:

HOSTNAME= shenzhenbak

2.1.2验证方法:

重新启动系统后,执行如下命令

Hostname

得到如下结果

shenzhenbak

2.2              单网卡设置

2.2.1设置方法:

vi /etc/sysconfig/network-script/ifcfg-eth1

确认文件存在如下内容:

DEVICE=eth1

BOOTPROTO=static

ONBOOT=yes

TYPE=Ethernet

USERCTL=yes

IPV6INIT=no

PEERDNS=yes

NETMASK=255.255.255.0

IPADDR= 192.168.112.60

其它网卡配置文件相同,IP地址不同而已

 

2.2.2验证方法:

Service network restart后能够用ifconfig看到配置过的网卡的IP地址信息

2.3              网卡绑定设置

2.3.1设置方法:

l  生成绑定网卡配置文件:

cd /etc/sysconfig/network-script

cp ifcfg-eth7 ifcfg-bond0

l  修改绑定网卡配置文件

Vi  /etc/sysconfig/network-script/ifcfg-bond0

确认此文件内容如下:

DEVICE=bond0

BOOTPROTO=none

ONBOOT=yes

TYPE=Ethernet

USERCTL=yes

IPV6INIT=no

PEERDNS=yes

NETMASK=255.255.255.0

IPADDR=10.77.100.20

l  编辑第一块需要绑定的网卡配置文件

vi /etc/sysconfig/network-script/ifcfg-eth4

确认此文件内容如下:

DEVICE=eth4

BOOTPROTO=none

ONBOOT=yes

TYPE=Ethernet

USERCTL=yes

IPV6INIT=no

PEERDNS=yes

MASTER=bond0

SLAVER=yes

 

l  编辑第二块需要绑定的网卡配置文件

vi /etc/sysconfig/network-script/ifcfg-eth5

确认此文件内容如下:

DEVICE=eth5

BOOTPROTO=none

ONBOOT=yes

TYPE=Ethernet

USERCTL=yes

IPV6INIT=no

PEERDNS=yes

MASTER=bond0

SLAVER=yes

 

l  编辑第三块需要绑定的网卡配置文件

vi /etc/sysconfig/network-script/ifcfg-eth6

确认此文件内容如下:

DEVICE=eth6

BOOTPROTO=none

ONBOOT=yes

TYPE=Ethernet

USERCTL=yes

IPV6INIT=no

PEERDNS=yes

MASTER=bond0

SLAVER=yes

 

l  编辑第二块需要绑定的网卡配置文件

vi /etc/sysconfig/network-script/ifcfg-eth7

确认此文件内容如下:

DEVICE=eth7

BOOTPROTO=none

ONBOOT=yes

TYPE=Ethernet

USERCTL=yes

IPV6INIT=no

PEERDNS=yes

MASTER=bond0

SLAVER=yes

l  确认/etc/sysconfig/networking/文件夹下存在同样的文件,且内容相同.没有则需要拷贝缺失的文件过去

l  重新启动网络

Service network restrt

l  启用网卡绑定

ifenslave bond0 eth4 eth5 eht6 eht7

l  修改初始化文件,使得网卡绑定自动启用

Vi /etc/rc.local

向文件中增加一下内容:

ifenslave bond0 eth4 eth5 eht6 eht7

l  编辑 /etc/modules.conf 文件,以使系统在启动时加载bonding模块

vi /etc/modules.conf

加入以下内容:

alias bond0 bonding 

options bond0 miimon=100 mode=1

 

2.3.2验证方法:

ifconfig

bond0     Link encap:Ethernet  HWaddr 00:10:18:5B:AA:A0 

          inet addr:10.77.100.20  Bcast:10.77.100.255  Mask:255.255.255.0

          inet6 addr: fe80::210:18ff:fe5b:aaa0/64 Scope:Link

          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1

          RX packets:2400908 errors:0 dropped:0 overruns:0 frame:0

          TX packets:4399095 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0

          RX bytes:174422796 (166.3 MiB)  TX bytes:6669516078 (6.2 GiB)

 

eth0      Link encap:Ethernet  HWaddr 00:26:B9:54:F7:3B 

          inet addr:192.168.112.60  Bcast:192.168.112.255 Mask:255.255.255.0

          inet6 addr: fe80::226:b9ff:fe54:f73b/64 Scope:Link

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:421 errors:0 dropped:0 overruns:0 frame:0

          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:32954 (32.1 KiB)  TX bytes:718 (718.0 b)

          Interrupt:58 Memory:ce000000-ce012100

 

eth1      Link encap:Ethernet  HWaddr 00:26:B9:54:F7:3D 

          inet addr:192.168.112.61  Bcast:192.168.112.255 Mask:255.255.255.0

          UP BROADCAST MULTICAST  MTU:1500  Metric:1

          RX packets:0 errors:0 dropped:0 overruns:0 frame:0

          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

          Interrupt:66 Memory:d0000000-d0012100

 

eth2      Link encap:Ethernet  HWaddr 00:26:B9:54:F7:3F 

          inet addr:192.168.112.62  Bcast:192.168.112.255 Mask:255.255.255.0

          UP BROADCAST MULTICAST  MTU:1500  Metric:1

          RX packets:0 errors:0 dropped:0 overruns:0 frame:0

          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

          Interrupt:74 Memory:d2000000-d2012100

 

eth3      Link encap:Ethernet  HWaddr 00:26:B9:54:F7:41 

          inet addr:192.168.1.1  Bcast:192.168.1.255  Mask:255.255.255.0

          inet6 addr: fe80::226:b9ff:fe54:f741/64 Scope:Link

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:3207 errors:0 dropped:0 overruns:0 frame:0

          TX packets:4327 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:266293 (260.0 KiB)  TX bytes:590833 (576.9 KiB)

          Interrupt:82 Memory:d4000000-d4012100

 

eth4      Link encap:Ethernet  HWaddr 00:10:18:5B:AA:A0 

          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1

          RX packets:33470 errors:0 dropped:0 overruns:0 frame:0

          TX packets:1099774 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:2493522 (2.3 MiB)  TX bytes:1667392160 (1.5 GiB)

          Interrupt:98 Memory:d6000000-d6012100

 

eth5      Link encap:Ethernet  HWaddr 00:10:18:5B:AA:A0 

          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1

          RX packets:860634 errors:0 dropped:0 overruns:0 frame:0

          TX packets:1099774 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:62653646 (59.7 MiB)  TX bytes:1667354002 (1.5 GiB)

          Interrupt:106 Memory:d8000000-d8012100

 

eth6      Link encap:Ethernet  HWaddr 00:10:18:5B:AA:A0 

          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1

          RX packets:1473000 errors:0 dropped:0 overruns:0 frame:0

          TX packets:1099774 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:106763614 (101.8 MiB)  TX bytes:1667391990 (1.5 GiB)

          Interrupt:114 Memory:da000000-da012100

 

eth7      Link encap:Ethernet  HWaddr 00:10:18:5B:AA:A0 

          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1

          RX packets:33804 errors:0 dropped:0 overruns:0 frame:0

          TX packets:1099773 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:2512014 (2.3 MiB)  TX bytes:1667377926 (1.5 GiB)

          Interrupt:122 Memory:dc000000-dc012100

 

2.4              ISCSI设置

2.4.1设置方法:

l  检查软件包是否存在

运行命令

rpm -qa|grep iscsi

得到如下结果

iscsi-initiator-utils-4.0.3.0-7

l  配置iscsi自动启动

运行如下命令

Chkconfig –level 2345 iscsi  on

l  修改iscsi配置文件

vi /etc/iscsi.conf

DiscoveryAddress=10.4.100.1:3260

SendAsyncText=yes

Continuous=yes

l  启动iscsi服务

运行如下命令:

Service iscsi restart

2.4.2验证方法:

l  检查iscsi服务是否设置为自动启动

chkconfig --list iscsi

iscsi           0:关闭  1:关闭  2:启用  3:启用  4:启用  5:启用  6:关闭

l  检查iscsi服务已经启动

运行如下命令

service iscsi status

得到如下结果:

iscsid (pid 12330 12328) 正在运行...

l  检查存储设备是否被发现:

运行如下命令:

iscsi-ls -l

得到如下结果:

***************************************************************************

SFNet iSCSI Driver Version ...4:0.1.11-7(14-Apr-2008)

***************************************************************************

TARGET NAME             : iqn.2001-05.com.equallogic:0-8a0906-19ed8fb05-cf992d358094b449-linux4u7

TARGET ALIAS            : Linux4u7

HOST ID                 : 3

BUS ID                  : 0

TARGET ID               : 0

TARGET ADDRESS          : 10.77.100.62:3260,1

SESSION STATUS          : ESTABLISHED AT 四  1月  7 00:21:24 CST 2010

SESSION ID              : ISID 00023d000001 TSIH 26

 

DEVICE DETAILS:

---------------

LUN ID : 0

  Vendor: EQLOGIC  Model: 100E-00          Rev: 4.3

  Type:   Direct-Access                    ANSI SCSI revision: 05

  page83 type3: 6090a058b08fed1949b49480352d99cf

  page80: 36303930413035384230384645443139

34394234393438303335324439394346

0a

  Device: /dev/sdb

**************************************************************************

 

2.5              磁盘分区和挂载

2.5.1设置方法:

检查是否有没有分区的磁盘存在:

l  运行如下命令:

fdisk -l

得到如下结果:

Disk /dev/sda: 146.1 GB, 146163105792 bytes

255 heads, 63 sectors/track, 17769 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1          25      200781   83  Linux

/dev/sda2              26       10223    81915435   83  Linux

/dev/sda3           10224       11752    12281692+  82  Linux swap

 

Disk /dev/sdb: 859.0 GB, 859003944960 bytes

255 heads, 63 sectors/track, 104434 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

   Device Boot      Start         End      Blocks   Id  System

/dev/sdb               1        104434    29302528+

 

 

l  创建磁盘分区

运行如下命令:

fdisk /dev/sdb

在交互模式下输入如下参数

The number of cylinders for this disk is set to 104434.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

1) software that runs at boot time (e.g., old versions of LILO)

2) booting and partitioning software from other OSs

   (e.g., DOS FDISK, OS/2 FDISK)

 

Command (m for help): p

 

Disk /dev/sdb: 859.0 GB, 859003944960 bytes

255 heads, 63 sectors/track, 104434 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

   Device Boot      Start         End      Blocks   Id  System

/dev/sdb1               1        3648    29302528+  83  Linux

 

Command (m for help): n

Command action

   e   extended

   p   primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-104434, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (3649-104434, default 104434): +30000M

 

Command (m for help): n

Command action

   e   extended

   p   primary partition (1-4)

p

Partition number (1-4): 2

First cylinder (3649-104434, default 3649):

Using default value 3649

Last cylinder or +size or +sizeM or +sizeK (3649-104434, default 104434): +100000M

 

Command (m for help): n

Command action

   e   extended

   p   primary partition (1-4)

p

Partition number (1-4): 3

First cylinder (15808-104434, default 15808):

Using default value 15808

Last cylinder or +size or +sizeM or +sizeK (15808-104434, default 104434): +300000M

 

Command (m for help): w

The partition table has been altered!

 

Calling ioctl() to re-read partition table.

Syncing disks.

 

l  创建挂载文件夹

Mkdir /App /Local /Oradata

 

l  系统启动后自动挂载

Vi /etc/rc.local

添加如下内容:

Mount /dev/sdb1 /App

Mount /dev/sdb2 /Local

Mount /dev/sdb3 /Oradata

 

2.5.2验证方法:

l  检查磁盘分区是否已经分出

运行如下命令:

fdisk -l

的到如下结果:

Disk /dev/sda: 146.1 GB, 146163105792 bytes

255 heads, 63 sectors/track, 17769 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1          25      200781   83  Linux

/dev/sda2              26       10223    81915435   83  Linux

/dev/sda3           10224       11752    12281692+  82  Linux swap

 

Disk /dev/sdb: 859.0 GB, 859003944960 bytes

255 heads, 63 sectors/track, 104434 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

   Device Boot      Start         End      Blocks   Id  System

/dev/sdb1               1        3648    29302528+  83  Linux

/dev/sdb2            3649       15807    97667167+  83  Linux

/dev/sdb3           15808       52281   292977405   83  Linux

l  检查磁盘是否自动挂载

系统重新启动过后,运行如下命令:

Mount

检查是否有sdb1 sdb2 sdb3出现,如果有则表示已经成功挂载

 

2.6              Iscsi及bonding的验证方法

拷贝大量数据到存储上,在拷贝过程中,依次拔掉一根、两根、三根网线数据复制不会停止,插回一根网线,拔掉另一根网线,数据复制依然不会停止,把所有网线插回去数据复制依然继续,表示成功.

拷贝文件的命令如下:

Mount /dev/cdron /mnt

Cp –r –v /mnt/* /App

测试完成后请注意删除测试数据