利用LVS+Keepalived 实现高性能高可用负载均衡

   背景:

       随着你的网站业务量的增长你网站的服务器压力越来越大？需要负载均衡方案！商业的硬件如F5又太贵，你们又是创业型互联公司如何有效节约成本，节省不必要的浪费？同时实现商业硬件一样的高性能高可用的功能？有什么好的负载均衡可伸张可扩展的方案吗？答案是肯定的！有！我们利用LVS+Keepalived基于完整开源软件的架构可以为你提供一个负载均衡及高可用的服务器。

 

一．            LVS+Keepalived 介绍

1.      LVS

LVS是Linux Virtual Server的简写，意即Linux虚拟服务器，是一个虚拟的服务器集群系统。本项目在1998年5月由章文嵩博士成立，是中国国内最早出现的自由软件项目之一。目前有三种IP负载均衡技术（VS/NAT、VS/TUN和VS/DR）；

八种调度算法（rr,wrr,lc,wlc,lblc,lblcr,dh,sh）。

 

2.      Keepalvied

       Keepalived在这里主要用作RealServer的健康状态检查以及LoadBalance主机和BackUP主机之间failover的实现

 

二. 网站负载均衡拓 

三、配置IP

LVS（master）增加一片网卡：

eth0:172.24.100.6

eth1:202.168.128.101

LVS（backup）增加一片网卡：

eh0:172.24.100.7

eh1:202.168.128.111

对外虚拟IP：202.168.128.202

对内虚拟IP：172.24.100.70

 

四. 安装LVS和Keepalvied软件包

 

     #lsmod | rep ip_vs

#uname -r

显示2.6.18-53.el5PAE

#ln -s/usr/src/kernels/2.6.18-53.el5PAE-i686/  /usr/src/linux

 

#tar zxvfipvsadm-1.24.tar.gz

#cd ipvsadm-1.24

#make all && make install(安装相关包：gcc*)

#find / -name ipvsadm  # 查看ipvsadm的位置

 

#tar zxvf keepalived-1.1.15.tar.gz

#cd keepalived-1.1.15

#./configure (提示安装openssl*)

# make && make install

#find / -name keepalived  # 查看keepalived位置         

   

#cp /usr/local/etc/rc.d/init.d/keepalived/etc/rc.d/init.d/

#cp /usr/local/etc/sysconfig/keepalived/etc/sysconfig/

#mkdir /etc/keepalived

#cp/usr/local/etc/keepalived/keepalived.conf /etc/keepalived/

#cp /usr/local/sbin/keepalived /usr/sbin/

#chkconfig —addkeepalived

#chkconfig keepalived on

 

五. 配置LVS

在LVS机上配置（两台都要配置）

    ＃vim /usr/local/sbin/lvsdr.sh

#!/bin/bash

VIP=202.168.128.202

RIP1=172.24.100.4

RIP2=172.24.100.5

/etc/rc.d/init.d/functions

case "$1" in

start)

      echo "start LVS of DirectorServer"

      /sbin/ipvsadm -C

      /sbin/ipvsadm -A -t $VIP:80 -s rr

      /sbin/ipvsadm -a -t $VIP:80 -r $RIP1:80 -m -w 1

      /sbin/ipvsadm -a -t $VIP:80 -r $RIP2:80 -m -w 1

      /sbin/ipvsadm

;;

stop)

echo "Close LVS Directorserver"

/sbin/ifconfig eth0:1 down

/sbin/ipvsadm -C

;;

*)

echo "Usage0{start|stop}"

exit 1

esac

 

六. 利用Keepalvied实现负载均衡和和高可用性

1．主LVS上：172.24.100.6

global_defs {

  router_id LVS_DEVEL

}

vrrp_sync_group lvs_1 {

          group {

                 VI_1

                 VI_GATEWAY

                   }

}

vrrp_instance VI_1 {

   state MASTER

   interface eth1

   virtual_router_id 51

   priority 100

   advert_int 1

   authentication {

       auth_type PASS

       auth_pass 1111

   }

   virtual_ipaddress {

       202.168.128.202         #要指定子网掩码

   }

}

vrrp_instance VI_GATEWAY {

   state MASTER

   interface eth0

   virtual_router_id 52

   priority 100

   advert_int 1

   authentication {

       auth_type PASS

       auth_pass 1111

    }

    virtual_ipaddress {

         172.24.100.70

     }

}

virtual_server 202.168.128.202 80 {

    delay_loop 6

    lb_algo rr

    lb_kind NAT

    nat_mask 255.255.0.0

   persistence_timeout 50

   protocol TCP

      real_server 172.24.100.4 80 {

              weight 1

                TCP_CHECK {

                   connect_timeout 3

                   nb_get_retry 3

                   delay_before_retry 3

              }

        }

        real_server 172.24.100.5 80 {

              weight 1

                TCP_CHECK {

                   connect_timeout 3

                   nb_get_retry 3

                   delay_before_retry 3

              }

    }

}

     

2．从LVS：172.24.100.7

global_defs {

   router_id LVS_DEVEL

}

vrrp_sync_grouplvs_1 {

           group {

                 VI_1

                 VI_GATEWAY

                   }

}

vrrp_instanceVI_1 {

    state BACKUP

    interface eth1

    virtual_router_id 51

    priority 90

    advert_int 1

    authentication {

        auth_type PASS

        auth_pass 1111

    }

    virtual_ipaddress {

        202.168.128.202

    }

}

vrrp_instanceVI_GATEWAY {

    state BACKUP

    interface eth0

    virtual_router_id 52

    priority 90

    advert_int 1

    authentication {

        auth_type PASS

        auth_pass 1111

    }

    virtual_ipaddress {

        172.24.100.70

    }

}

virtual_server202.168.128.202 80 {

    delay_loop 6

    lb_algo rr

    lb_kind NAT

    nat_mask 255.255.0.0

    persistence_timeout 50

    protocol TCP

    real_server 172.24.100.4 80 {

        weight 1

          TCP_CHECK {

             connect_timeout 3

             nb_get_retry 3

             delay_before_retry 3

        }

    }

    real_server 172.24.100.5 80 {

        weight 1

          TCP_CHECK {

             connect_timeout 3

             nb_get_retry 3

             delay_before_retry 3

        }

  }

}

 

3.开启IP转发

    net.ipv4.ip_forward=1

 

七、配置WEB端（172.24.100.4和172.24.100.5）

1.      配置IP转发功能

＃vim/etc/sysctl.conf

    net.ipv4.ip_forward=1

    net.ipv4.conf.lo.arp_ignore= 1
net.ipv4.conf.lo.arp_announce = 2
net.ipv4.conf.all.arp_ignore = 1
net.ipv4.conf.all.arp_announce = 2

2.  配置网关

＃vim/etc/sysconfig/network-scripts/ifcfg-eth0添加

    GATEWAY＝172.24.100.70

＃servicenetwork restart

 

八、启动服务

＃ /usr/local/sbin/lvsdr.shstart （把这条语句写到/etc/rc.local中，开机启动）

＃/etc/init.d/keepalivedstart  启动keepalived 服务，keepalived就能利用keepalived.conf 配置文件，实现负载均衡和高可用.

 

九、测试

1.      ＃ ip addr show

eth0: <BROADCAST,MULTICAST,UP,LOWER_UP>    mtu  1500  qdisc pfifo_fast qlen 1000

       link/ether 00:0c:29:9d:db:59 brd ff:ff:ff:ff:ff:ff

       inet 172.24.100.6/24 brd 172.24.0.255 scopeglobal eth0

       inet 172.24.100.70/32 scope global eth0

       inet6 fe80::20c:29ff:fe9d:db59/64 scope link

          valid_lft forever preferred_lft forever

 eth1: <BROADCAST,MULTICAST,UP,LOWER_UP>    mtu  1500  qdisc pfifo_fast qlen 1000

        link/ether 00:0c:29:9d:db:63 brdff:ff:ff:ff:ff:ff

       inet 202.168.128.101/24 brd202.168.128.255 scope global eth1

       inet 202.168.128.202/32 scope global eth1

       inet6 fe80::20c:29ff:fe9d:db63/64 scope link

          valid_lft forever preferred_lft forever

   ………

最后把主机宕机，到从机上使用ipaddr show 查看，同上则OK。同时还需要用浏览器来测试。

 

2. 查看lvs服务是否正常

 #watch ipvsadm –ln

IP VirtualServer version 1.2.1 (size=4096)

Prot LocalAddress:Port Scheduler Flags

  -> RemoteAddress:Port           Forward Weight ActiveConn InActConn

TCP  202.168.128.202:80 wrrpersistent 60

  -> 172.24.100.5:80             Route   3     0          0

  -> 172.24.100.4:80             Route   3     0          0

 

 #tail –f /var/log/message  监听日志，查看状态。

 

3．将一台web 服务器关闭，然后在LVS 上用ipvsadm 命令查看，关闭的服务器应该从

lvs集群中剔除了，再将关闭的服务器启动起来，用ipvsadm查看，又回来了。