|||||||||||||||||||||||||||||||||
在AIX 5L上使用绑定网卡(etherchannel)
在AIX操作系统中,用户可以配置多个EtherChannel(网卡绑定)。在AIX 5.2之前,我们要么只能选择active/active EtherChannel模式,要么,只能选择active/standby EtherChannel模式的绑定网卡。所以,AIX 5.2中引入了新的网卡后备模式,用户可以为整个EtherChannel指定一块备份网卡,当整个EtherChannel失效时,这块网卡会自动顶替EtherChannel的功能。这与AIX 5.2之前的EtherChannel网卡备份模式有很大区别,因此,在5.2以后可以出现更为复杂的复合网卡绑定模式。
一个EtherChannel中可以有2到8块网卡,一个AIX操作系统中可以配置多个EtherChannel。但要记住每个EtherChannel都是一个新的以太网接口,用户也许需要通过no命令调整ifsize参数的值来保证以太网卡和EtherChannel的总数不超过ifsize,ifsize的默认值是8。
您可以使用任何AIX系统支持的网卡来组建EtherChannel。但EtherChannel的同一个通道成员网卡必须连接到支持EtherChannel的交换机上,备用通道可以接入到另外一个交换机,用于主通道的失败接管。EtherChannel的所有成员网卡都应该设置成同样的速度和工作模式,如1000兆全双工。要用作EtherChannel成员的网卡不能配置IP地址,如果已经配置了,必须要在开始配置EtherChannel前删除这些配置。
在Aix5.2以后,我们看看三种典型的配置方式
1、双通道或者多通道的共同active模式,这个模式下,所有的网卡都处于active状态,也就是每个网卡都处于工作状态,他们共有一个IP地址与MAC地址,但是,所有网卡的目标必须在同一个交换机上,并且交换机的对应端口也要绑定。
这样做最大的好处就是,当其中一个网卡失效,或者一根网线失效的时候,不影响整个网络的工作,只有当所有的网卡通道失效的时候,网络才失效。而且,多个网卡的同时工作,可以增加网络带宽,不过,要注意,默认的分配方式是根据目标机器的Ip来分配使用哪个网卡,如果目标机器只有一台,不适合使用默认设置。这种模式下,最大的问题就是所有的网卡目标必须在同一个交换机上,并且绑定在一起,不能防止目标交换机故障。
2、active/standby模式,这样的模式下,一个网卡接到主交换机,一个网卡接到备用交换机,当active通道失效的时候,自动切换到standby通道,当主通道恢复正常的时候,再自动切换到主通道(这里是否切换回去,是可以配置的)。这种方式最大的好处就是可以防止交换机的故障。
3、复合式配置,在这种配置中,结合以上2种方式的优点。如一个3块网卡的环境中,我们可以把其中2片网卡配置成双active模式,以增加网络带宽以及网络的可靠性,另外一块网卡作为后备模式,接在另外一个交换机上,当前面2个网卡都失效,或者前面2个网卡接的交换机失效的时候,切换到后备网卡上。如图:
下面,我们介绍一下详细的步骤:
如果想绑定或者取消绑定,可以用smit etherchannel完成,如要绑定ent1与ent2则:。
#chdev -l en1 -a netaddr=” -a netmask=”
#chdev -l en2 -a netaddr=” -a netmask=”
#chdev -l en1 -a state=’detach’
#chdev -l en2 -a state=’detach’
注意:以上命令是必要的,子网卡先取消现有的IP地址,以及一定要处于detach状态,注意,如果通过en1或者en2连接到主机,操作以上的命令,你的网络可能马上就被中断了,所以,以上的操作建议通过其它网卡完成,或者在HMC上完成。然后,我们开始绑定
#smit etherchannel
选择
Add An EtherChannel / Link Aggregation
在这里选择网卡
EtherChannel / Link Aggregation Adapters ent1,ent2
回车执行:
Command: OK stdout: yes stderr: no
Before command completion, additional instructions may appear below.
ent4 Available
最后会提示新的网卡的生成,这个网卡就是可用的绑定过之后的网卡。可用lsattr查看其属性或者是lsdev -Cc adapter看所有网卡属性。
#lsattr -El ent4
adapter_names ent1,ent2 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter NONE Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
mode standard EtherChannel mode of operation True
netaddr Address to ping True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame no Enable Gigabit Ethernet Jumbo Frames True
这样绑定的网卡是双通路的,就是说两个网卡都是处于活动状态,注意,这里还需要交换机配合才可以最终接通2块网卡,网络交换机的设置,可以联系你们的系统管理员。
我们也可以设置备用网卡,平常并不活动,处于备用接管状态,如果主通道发生问题,则切换到备用通道,这样的话,则可以接到两个不同的交换机上用于交换机冗余。
备用网卡就是上面的backup_adapter,可以通过
#smit chgethch
或者是
#smit etherchannel
选择
Change / Show Characteristics of an EtherChannel / Link Aggregation
再选择
Add Backup Adapter来完成。增加过后备网卡的绑定网卡,对比以上,将有如下的差别:
#lsattr -El ent4
adapter_names ent1,ent2 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter ent3 Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
mode standard EtherChannel mode of operation True
netaddr Address to ping True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame no Enable Gigabit Ethernet Jumbo Frames True
至于网卡的工作状态,还可以通过netstat -v来查看,如:
#netstat -v ent4
ETHERNET STATISTICS (ent4) :
Device Type: EtherChannel
Hardware Address: 00:14:5e:b7:26:88
......
Number of adapters: 3
Active channel: primary channel
Operating mode: Standard mode
Hash mode: Destination IP address
......
ETHERNET STATISTICS (ent1) :
Link Status : Up
Media Speed Selected: Auto negotiation
Media Speed Running: 1000 Mbps Full Duplex
......
ETHERNET STATISTICS (ent2) :
Link Status : Up
Media Speed Selected: Auto negotiation
Media Speed Running: 1000 Mbps Full Duplex
......
Backup adapter - ent3:
======================
Link Status : Up
Media Speed Selected: Auto negotiation
Media Speed Running: 1000 Mbps Full Duplex
如果想取消绑定,则同样执行
#smit etherchannel
选择
Remove An EtherChannel / Link Aggregation
选择你需要取消的网卡,如上面的ent4,回车执行
Command: OK stdout: yes stderr: no
Before command completion, additional instructions may appear below.
ent4 deleted
如果得到以上的结果,表示绑定取消成功。成功的结果,可以通过lsdev -Cc adapter前后对比获得。
||||||||||||||||||||||||
实际操作后验证
# errpt -dH
IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION
F3931284 1229151609 I H ent4 ETHERNET NETWORK RECOVERY MODE
8650BE3F 1229151609 I H ent6 ETHERCHANNEL RECOVERY
F3931284 1229151609 I H ent0 ETHERNET NETWORK RECOVERY MODE
AA8D7232 1229151009 I H ent6 TOTAL ETHERCHANNEL FAILURE
EC0BCCD4 1229151009 T H ent4 ETHERNET DOWN
F3846E13 1229150909 P H ent6 ETHERCHANNEL FAILOVER
EC0BCCD4 1229150909 T H ent0 ETHERNET DOWN
8650BE3F 1229150009 I H ent6 ETHERCHANNEL RECOVERY
F3931284 1229145909 I H ent0 ETHERNET NETWORK RECOVERY MODE
F3846E13 1229145909 P H ent6 ETHERCHANNEL FAILOVER
EC0BCCD4 1229145909 T H ent0 ETHERNET DOWN
AA8D7232 1229143009 I H ent6 TOTAL ETHERCHANNEL FAILURE
EC0BCCD4 1229143009 T H ent4 ETHERNET DOWN
F3846E13 1229143009 P H ent6 ETHERCHANNEL FAILOVER
EC0BCCD4 1229143009 T H ent0 ETHERNET DOWN
ent6是聚合端口,ent0和ent4是什么呢,查下他们的属性
# ifconfig -a
en1: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
inet 10.1.1.2 netmask 0xffffff00 broadcast 10.1.1.255
tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
en6: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
inet 192.168.168.102 netmask 0xffffff00 broadcast 192.168.168.255
inet 192.168.200.2 netmask 0xffffff00 broadcast 192.168.200.255
tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
lo0: flags=e08084b<UP,BROADCAST,LOOPBACK,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT>
inet 127.0.0.1 netmask 0xff000000 broadcast 127.255.255.255
inet6 ::1/0
# lsattr -El ent6
adapter_names ent0 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter ent4 Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
mode standard EtherChannel mode of operation True
netaddr 0 Address to ping True
noloss_failover yes Enable lossless failover after ping failure True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame no Enable Gigabit Ethernet Jumbo Frames True
可见ent0 ent6聚合端口的主口,ent4是辅口,如果ent0挂了,网络ip 会接管到ent4上去。
用如下命令可以查看详细信息(关键信息为红字)
# netstat -v ent6
-------------------------------------------------------------
ETHERNET STATISTICS (ent6) :
Device Type: EtherChannel
Hardware Address: 00:14:5e:c8:20:d4
Elapsed Time: 0 days 19 hours 17 minutes 21 seconds
Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 573353 Packets: 763977
Bytes: 82887809 Bytes: 152026709
Interrupts: 0 Interrupts: 726784
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 0 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 16
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 1
Elapsed Time: 0 days 0 hours 0 minutes 0 seconds
Broadcast Packets: 470 Broadcast Packets: 181229
Multicast Packets: 1 Multicast Packets: 0
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 1
General Statistics:
-------------------
No mbuf Errors: 0
Adapter Reset Count: 2
Adapter Data Rate: 2000
Driver Flags: Up Broadcast Running
Simplex 64BitSupport ChecksumOffload
PrivateSegment LargeSend DataRateSet
=============================================================
=============================================================
Statistics for every adapter in the EtherChannel:
-------------------------------------------------
Number of adapters: 2
Active channel: primary channel
Operating mode: Network interface backup mode
-------------------------------------------------------------
ETHERNET STATISTICS (ent0) :
Device Type: 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
Hardware Address: 00:14:5e:c8:20:d4
Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 572652 Packets: 672530
Bytes: 82820781 Bytes: 135221262
Interrupts: 0 Interrupts: 642577
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 0 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 13
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 2
Broadcast Packets: 450 Broadcast Packets: 90472
Multicast Packets: 1 Multicast Packets: 0
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 2
General Statistics:
-------------------
No mbuf Errors: 0
Adapter Reset Count: 1
Adapter Data Rate: 2000
Driver Flags: Up Broadcast Running
Simplex 64BitSupport ChecksumOffload
PrivateSegment LargeSend DataRateSet
2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902) Specific Statistics:
------------------------------------------------------------------------
Link Status : Up
Media Speed Selected: Auto negotiation
Media Speed Running: 1000 Mbps Full Duplex
PCI Mode: PCI-X (100-133)
PCI Bus Width: 64-bit
Latency Timer: 144
Cache Line Size: 128
Jumbo Frames: Disabled
TCP Segmentation Offload: Enabled
TCP Segmentation Offload Packets Transmitted: 2434
TCP Segmentation Offload Packet Errors: 0
Transmit and Receive Flow Control Status: Enabled
XON Flow Control Packets Transmitted: 0
XON Flow Control Packets Received: 0
XOFF Flow Control Packets Transmitted: 0
XOFF Flow Control Packets Received: 0
Transmit and Receive Flow Control Threshold (High): 45056
Transmit and Receive Flow Control Threshold (Low): 24576
Transmit and Receive Storage Allocation (TX/RX): 16/48
-------------------------------------------------------------
Backup adapter - ent4:
======================
ETHERNET STATISTICS (ent4) :
Device Type: 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
Hardware Address: 00:14:5e:c8:20:d4
Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 702 Packets: 91447
Bytes: 67088 Bytes: 16805447
Interrupts: 0 Interrupts: 84207
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 0 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 3
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 0
Broadcast Packets: 20 Broadcast Packets: 90757
Multicast Packets: 0 Multicast Packets: 0
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 0
General Statistics:
-------------------
No mbuf Errors: 0
Adapter Reset Count: 1
Adapter Data Rate: 2000
Driver Flags: Up Broadcast Running
Simplex 64BitSupport ChecksumOffload
PrivateSegment LargeSend DataRateSet
2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902) Specific Statistics:
------------------------------------------------------------------------
Link Status : Up
Media Speed Selected: Auto negotiation
Media Speed Running: 1000 Mbps Full Duplex
PCI Mode: PCI-X (50-66)
PCI Bus Width: 32-bit
Latency Timer: 144
Cache Line Size: 128
Jumbo Frames: Disabled
TCP Segmentation Offload: Enabled
TCP Segmentation Offload Packets Transmitted: 0
TCP Segmentation Offload Packet Errors: 0
Transmit and Receive Flow Control Status: Enabled
XON Flow Control Packets Transmitted: 0
XON Flow Control Packets Received: 0
XOFF Flow Control Packets Transmitted: 0
XOFF Flow Control Packets Received: 0
Transmit and Receive Flow Control Threshold (High): 45056
Transmit and Receive Flow Control Threshold (Low): 24576
Transmit and Receive Storage Allocation (TX/RX): 16/48