keepalived配合nginx反向代理

最新推荐文章于 2023-11-23 17:46:59 发布

staightChen

最新推荐文章于 2023-11-23 17:46:59 发布

阅读量633

点赞数

分类专栏： linux 学习总结

本文链接：https://blog.csdn.net/eddie_cm/article/details/79681836

版权

学习总结同时被 2 个专栏收录

14 篇文章 0 订阅

订阅专栏

linux

13 篇文章 0 订阅

订阅专栏

前言

keepalived的负载均衡功能默认是通过lvs实现的.实际上,也可以配合其他的负载均衡软件一起工作,例如nginx

准备

node1:192.168.10.201
node2:192.168.10.202
node3:192.168.10.203
node4:192.168.10.204
vip:192.168.10.200
其中node1和node2作为director,需事先安装keepalived和nginx软件包;node3和node4作为real server,只需开启web服务
确保所有服务器关闭selinux和防火墙或做好相关的配置,时间同步;node1和node2做好时间同步,并进行公私钥认证,以及确认主机名无误

实验

主从模型

1.配置nginx反向代理(node1,node2)

]# vim /etc/nginx/nginx.conf
http {
    ...
    upstream webservers {//定义反向代理规则
        server 192.168.10.203:80 weight=1;
        server 192.168.10.204:80 weight=1;
    }
    ...
    server {
        ...
                location / {//应用已有规则
            proxy_pass http://webservers/;
        }
        ...
    }
}
...
]# systemctl start nginx

2.配置keepalived(node1,node2)

]# vim /etc/keepalived/keepalived.conf
! Configuration File for keepalived

global_defs {
   notification_email {
     root@localhost
   }
   notification_email_from kaadmin@localhost
   smtp_server 172.0.0.1
   smtp_connect_timeout 30
   router_id node1//node2修改为node2
   vrrp_skip_check_adv_addr
   vrrp_garp_interval 0
   vrrp_gna_interval 0
}

vrrp_instance VI_1 {
    state MASTER//node2修改为BACKUP
    interface ens33
    virtual_router_id 51
    priority 100//node2修改为99
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.10.200/24
    }
}
]# systemctl start keepalived

这样事实上就已经完成了简单的主从模型,但仍有较多缺陷:keepalived尚未完善日志信息;keepalived无从得知nginx服务是否启动,并依据nginx是否启动切换主备;nginx在切换web服务器时无法保存用户session等等…
下面开始一步步解决.首先是keepalived的日志信息:

]# vim /usr/lib/systemd/system/keepalived.service
[Unit]
Description=LVS and VRRP High Availability Monitor
After=syslog.target network-online.target

[Service]
Type=forking
PIDFile=/var/run/keepalived.pid
KillMode=process
EnvironmentFile=-/etc/sysconfig/keepalived//keepalived环境文件的位置
ExecStart=/usr/sbin/keepalived $KEEPALIVED_OPTIONS
ExecReload=/bin/kill -HUP $MAINPID

[Install]
WantedBy=multi-user.target

]# vim /etc/sysconfig/keepalived
# Options for keepalived. See `keepalived --help' output and keepalived(8) and
# keepalived.conf(5) man pages for a list of all options. Here are the most
# common ones :
#
# --vrrp               -P    Only run with VRRP subsystem.
# --check              -C    Only run with Health-checker subsystem.
# --dont-release-vrrp  -V    Dont remove VRRP VIPs & VROUTEs on daemon stop.
# --dont-release-ipvs  -I    Dont remove IPVS topology on daemon stop.
# --dump-conf          -d    Dump the configuration data.
# --log-detail         -D    Detailed log messages.
# --log-facility       -S    0-7 Set local syslog facility (default=LOG_DAEMON)
#

KEEPALIVED_OPTIONS="-D -S 3 -D -S 0"//添加日志,日志级别为0

]# vim /etc/rsyslog.conf
local0.*                                                /var/log/keepalived.log
]# systemctl restart rsyslog
]# systemctl restart keepalived

这样,keepalived日志文件就保存在/var/log/keepalived.log中.接下来需要修改keepalived配置文件以监控nginx

]# vim /etc/keepalived/keepalived.conf
vrrp_script chk_nginx {
        script "/usr/bin/killall -0 nginx &> /dev/null"
        interval 1
        weight -10
}

vrrp_instance VI_1 {
    ...
    track_script {
        chk_nginx
    }
}

修改后,当nginx不在运行时,keepalived就会检测到,降低自己的优先级而成为BACKUP状态.但这样的话,nginx进程必须通过管理员手动开启,可以再次修改keepalived配置文件使其启动开启nginx服务

]# vim /etc/keepalived/keepalived.conf
vrrp_instance VI_1 {
    ...
    notify_master "/etc/keepalived/notify.sh master"
    notify_backup "/etc/keepalived/notify.sh backup"
    notify_fault "/etc/keepalived/notify.sh fault"
}
]# vim /etc/keepalived/notify.sh
#!/bin/bash

vip=192.168.10.200
contact='root@localhost'

notify() {
    mailsubject="`hostname` to be $1: $vip floating"
    mailbody="`date '+%F %H:%M:%S'`: vrrp transition, `hostname` changed to be $1"
    echo $mailbody | mail -s "$mailsubject" $contact
}

case "$1" in
    master)
        notify master
        systemctl restart nginx
        exit 0
    ;;
    backup)
        notify backup
        systemctl restart nginx
        exit 0
    ;;
    fault)
        notify fault
        exit 0
    ;;
    *)
        echo 'Usage: `basename $0` {master|backup|fault}'
        exit 1
    ;;
esac

这样,即使我们手动关闭nginx,keepalived也会通过调用脚本的方式再次开启nginx进程.但倘若通过其它方式(比如关闭nginx的同时立刻开启httpd占用80端口)使nginx无法开启,那样keepalived也无能为力

双主模型
双主模型中的director各自都是主节点和备节点.即两个节点用另一个vip运行第二个vrrp实例,这样可以充分利用资源,也可以减轻单台vrrp服务器的压力

]# vim /etc/keepalived/keepalived.conf
vrrp_instance VI_2 {//新的vrrp实例
    state BACKUP
    interface ens33
    virtual_router_id 60
    priority 99
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass 2222
    }
    virtual_ipaddress {
        192.168.10.100/24
    }
    track_script {
        chk_nginx
    }

    notify_master "/etc/keepalived/notify.sh master"
    notify_backup "/etc/keepalived/notify.sh backup"
    notify_fault "/etc/keepalived/notify.sh fault"
}