目录
haproxy的基本配置信息
HAProxy 的配置文件haproxy.cfg由两大部分组成,分别是:
global:全局配置段
-
进程及安全配置相关的参数
-
性能调整相关参数
-
Debug参数
proxies:代理配置段
-
defaults:为frontend, backend, listen提供默认配置
-
frontend:前端,相当于nginx中的server {}
-
backend:后端,相当于nginx中的upstream {}
-
listen:同时拥有前端和后端配置,配置简单,生产推荐使用
[root@haproxy ~]# dnf install haproxy -y
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
frontend webcluster
bind *:80
mode http
use_backend webcluster-host
backend webcluster-host
balance roundrobin
server web1 172.25.254.10:80
server web2 172.25.254.20:80
[root@haproxy ~]# systemctl restart haproxy.service
[root@haproxy ~]# systemctl enable haproxy.service
Created symlink /etc/systemd/system/multi-user.target.wants/haproxy.service → /usr/lib/systemd/system/haproxy.service.
#测试
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 25 100 25 0 0 9211 0 --:--:-- --:--:-- --:--:-- 12500
webserver1:172.25.254.10
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 25 100 25 0 0 10660 0 --:--:-- --:--:-- --:--:-- 12500
webserver2:172.25.254.20
#将之前写的注释掉
#frontend webcluster
# bind *:80
# mode http
# use_backend webcluster-host
#backend webcluster-host
# balance roundrobin
# server web1 172.25.254.10:80
# server web2 172.25.254.20:80
listen webcluster
bind *:80
mode http
balance roundrobin
server web1 172.25.254.10:80
server web2 172.25.254.20:80
[root@haproxy ~]# systemctl restart haproxy.service
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 25 100 25 0 0 10084 0 --:--:-- --:--:-- --:--:-- 12500
webserver1:172.25.254.10
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 25 100 25 0 0 11876 0 --:--:-- --:--:-- --:--:-- 12500
webserver2:172.25.254.20
global配置
global 配置参数说明
参数 | 类型 | 作用 |
---|---|---|
chroot | 全局 | 锁定运行目录 |
deamon | 全局 | 以守护进程运行 |
user, group, uid, gid | 全局 | 运行haproxy的用户身份 |
stats socket | 全局 | 套接字文件 |
nbproc N | 全局 | 开启的haproxy worker 进程数,默认进程数是一个 |
nbthread 1 (和nbproc 互斥) | 全局 | 指定每个haproxy进程开启的线程数,默认为每个进程一个 线程 |
cpu-map 1 0 | 全局 | 绑定haproxy worker 进程至指定CPU,将第1个work进程绑 定至0号CPU |
cpu-map 2 1 | 全局 | 绑定haproxy worker 进程至指定CPU,将第2个work进程绑 定至1号CPU |
maxconn N | 全局 | 每个haproxy进程的最大并发连接数 |
maxsslconn N | 全局 | 每个haproxy进程ssl最大连接数,用于haproxy配置了证书的 场景下 |
maxconnrate N | 全局 | 每个进程每秒创建的最大连接数量 |
spread-checks N | 全局 | 后端server状态check随机提前或延迟百分比时间,建议2- 5(20%-50%)之间,默认值0 |
pidfile | 全局 | 指定pid文件路径 |
log 127.0.0.1 local2 info | 全局 | 定义全局的syslog服务器;日志服务器需要开启UDP协议, 最多可以定义两个 |
多进程和线程
多进程和socket文件配置如下:
[haproxy ~]# vim /etc/haproxy/haproxy.cfg
log 127.0.0.1 local2
chroot /var/lib/haproxy
pidfile /var/run/haproxy.pid
maxconn 100000
user haproxy
group haproxy
daemon
# turn on stats unix socket
stats socket /var/lib/haproxy/stats mode 600 level admin process 1 #
启用多个sock文件
stats socket /var/lib/haproxy/stats mode 600 level admin process 2
nbproc 2 #启用多进程
cpu-map 1 0 #进程和cpu核心绑定防止cpu抖动从而减少系统资源消耗
cpu-map 2 1 #2 表示第二个进程,1表示第二个cpu核心
查看多进程信息
[haproxy ~]# pstree -p | grep haproxy
|-haproxy(9826)-+-haproxy(9830)
| `-haproxy(9831)
启用多线程
[haproxy ~]# vim /etc/haproxy/haproxy.cfg
log 127.0.0.1 local2
chroot /var/lib/haproxy
pidfile /var/run/haproxy.pid
maxconn 100000
user haproxy
group haproxy
daemon
# turn on stats unix socket
stats socket /var/lib/haproxy/stats mode 600 level admin process 1 #
启用多个sock文件
stats socket /var/lib/haproxy/stats mode 600 level admin process 2
#nbproc 2
#cpu-map 1 0
#cpu-map 2 1
nbthread 2 #启用多线程
[root@haproxy~]# pstree -p grep haproxy
I-haproxy(9947)---haproxy(9948)---fhaproxy}(9949)
定向haproxy日志
[root@haproxy ~]# vim /etc/rsyslog.conf
。。。。。。。。。。
module(load="imudp") # needs to be done just once
input(type="imudp" port="514")
。。。。。。。。。。
# Log cron stuff
cron.* /var/log/cron
# Everybody gets emergency messages
*.emerg :omusrmsg:*
# Save news errors of level crit and higher in a special file.
uucp,news.crit /var/log/spooler
# Save boot messages also to boot.log
local7.* /var/log/boot.log
local2.* /var/log/haproxy.log
[root@haproxy ~]# systemctl restart rsyslog.service
haproxy的状态界面监控
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
listen stats
mode http
bind *:1111
stats enable
stats refresh 3
stats uri /status
stats auth Sons1:123
[root@haproxy ~]# systemctl restart haproxy.service
浏览器测试访问
socat工具
对服务器动态权重和其它状态可以利用socat工具进行调整,Socat是Linux下的一个多功能的网络工具,名字来由是Socket CAT,相当于netCAT的增强版.Socat的主要特点就是在两个数据流之间建立双向通道,且支持众多协议和链接方式。如IP、TCP、UDP、IPv6、Socket文件等
范例:利用工具socat对服务器动态权重调整
dnf install socat -y
socat -h
echo "show servers state" | socat stdio /var/lib/haproxy/stats
disable server (DEPRECATED) : disable a server for maintenance (use 'set server' instead)
[root@haproxy ~]# cat /etc/haproxy/haproxy.cfg
# turn on stats unix socket
stats socket /var/lib/haproxy/stats mode 600 level admin 启用统计信息的`套接字(socket)功能,指定了套接字`文件的路径`,给了`读写权限`,访问这个套接字获取统计信息需要`管理员级别的权限`.
#stats socket /var/lib/haproxy/stats2 mode 600 level admin process 2
# utilize system-wide crypto-policies
ssl-default-bind-ciphers PROFILE=SYSTEM
ssl-default-server-ciphers PROFILE=SYSTEM
#nbproc 2
#cpu-map 1 0
#cpu-map 2 1
# nbthread 2
echo "set weight webcluster/web1 2" | socat stdio /var/lib/haproxy/stats #修改权重为2
echo "set weight webcluster/web1 1" | socat stdio /var/lib/haproxy/stats #修改权重为1
vim /etc/haproxy/haproxy.cfg
echo "get servers state webcluster/web1" | socat stdio /var/lib/haproxy/stats
echo "show servers state webcluster/web1" | socat stdio /var/lib/haproxy/stats
echo "show servers state " | socat stdio /var/lib/haproxy/stats
echo "disable server webcluster/web1" | socat stdio /var/lib/haproxy/stats #暂停web1服务
echo "enable server webcluster/web1" | socat stdio /var/lib/haproxy/stats #开启web1服务
#查看haproxy状态
[root@haproxy ~]# echo "show info" | socat stdio /var/lib/haproxy/stats
Name: HAProxy
Version: 2.4.22-f8e3218
Release_date: 2023/02/14
Nbthread: 1
Nbproc: 1
Process_num: 1
Pid: 33542
Uptime: 0d 0h03m43s
Uptime_sec: 223
Memmax_MB: 0
PoolAlloc_MB: 0
#查看集群状态
[root@haproxy ~]# echo "show servers state" | socat stdio /var/lib/haproxy/stats
1
# be_id be_name srv_id srv_name srv_addr srv_op_state srv_admin_state srv_uweight
srv_iweight srv_time_since_last_change srv_check_status srv_check_result
srv_check_health srv_check_state srv_agent_state bk_f_forced_id srv_f_forced_id
srv_fqdn srv_port srvrecord srv_use_ssl srv_check_port srv_check_addr
srv_agent_addr srv_agent_port
2 webcluster 1 web1 172.25.254.20 2 0 2 2 188 6 3 7 6 0 0 0 - 80 - 0 0 - - 0
2 webcluster 2 web2 172.25.254.30 2 0 1 1 188 6 3 7 6 0 0 0 - 80 - 0 0 - - 0
4 static 1 static 127.0.0.1 0 0 1 1 187 8 2 0 6 0 0 0 - 4331 - 0 0 - - 0
5 app 1 app1 127.0.0.1 0 0 1 1 187 8 2 0 6 0 0 0 - 5001 - 0 0 - - 0
5 app 2 app2 127.0.0.1 0 0 1 1 187 8 2 0 6 0 0 0 - 5002 - 0 0 - - 0
5 app 3 app3 127.0.0.1 0 0 1 1 186 8 2 0 6 0 0 0 - 5003 - 0 0 - - 0
5 app 4 app4 127.0.0.1 0 0 1 1 186 8 2 0 6 0 0 0 - 5004 - 0 0 - - 0
#查看集群权重
[root@haproxy ~]# echo get weight webcluster/web1 | socat stdio
/var/lib/haproxy/stats
2 (initial 2)
[root@haproxy ~]# echo get weight webcluster/web2 | socat stdio
/var/lib/haproxy/stats
1 (initial 1)
#设置权重
[root@haproxy ~]# echo "set weight webcluster/web1 1 " | socat stdio
/var/lib/haproxy/stats
[root@haproxy ~]# echo "set weight webcluster/web1 2 " | socat stdio
/var/lib/haproxy/stats
#下线后端服务器
[root@haproxy ~]# echo "disable server webcluster/web1 " | socat stdio
/var/lib/haproxy/stats
#上线后端服务器
[root@haproxy ~]# echo "enable server webcluster/web1 " | socat stdio
/var/lib/haproxy/stats
## 针对多进程处理方法
#如果开启多进程那么我们在对进程的sock文件进行操作时其对进程的操作时随机的
#如果需要指定操作进程那么需要用多soct文件方式来完成
haproxy ~]# vim /etc/haproxy/haproxy.cfg
stats socket /var/lib/haproxy/stats1 mode 600 level admin process 1
stats socket /var/lib/haproxy/stats2 mode 600 level admin process 2
nbproc 2
cpu-map 1 0
cpu-map 2 1
#每个进程就会有单独的sock文件来进行单独管理
[root@haproxy ~]# ll /var/lib/haproxy/
总用量 0
srw------- 1 root root 0 8月 8 13:43 stats
srw------- 1 root root 0 8月 8 13:46 stats1
srw------- 1 root root 0 8月 8 13:46 stats2
haproxy的算法
HAProxy通过固定参数balance指明对后端服务器的调度算法balance参数可以配置在listen或backend选项中
balance参数可以配置在listen或backend选项中。
HAProxy的调度算法分为静态和动态调度算法
有些算法可以根据参数在静态和动态算法中相互转换
静态算法
静态算法:按照事先定义好的规则轮询公平调度,不关心后端服务器的当前负载、连接数和响应速度等,且无法实时修改权重(只能为0和1,不支持其它值),只能靠重启HAProxy生效。
static-rr:基于权重的轮询调度
-
不支持运行时利用socat进行权重的动态调整(只支持0和1,不支持其它值)
-
不支持端服务器慢启动
-
其后端主机数量没有限制,相当于LVS中的 wrr
Note
慢启动是指在服务器刚刚启动上不会把他所应该承担的访问压力全部给它,而是先给一部分,当没问题后在给一部分
示例:
[root@haproxy ~]# cat /etc/haproxy/haproxy.cfg
listen webcluster
bind *:80
mode http
balance static-rr
server web1 172.25.254.10:80 check inter 2 fall 3 rise 5 weight 2
server web2 172.25.254.20:80 check inter 2 fall 3 rise 5 weight 1
[root@haproxy ~]# systemctl restart haproxy
测试效果:
#在两台主机上分别执行此循环,可以观察是否102被调度到
while true;curl 172.25.254.100;sleep 0.1;done
动态算法
动态算法
-
基于后端服务器状态进行调度适当调整
-
新请求将优先调度至当前负载较低的服务器
-
权重可以在haproxy运行时动态调整无需重启
roundrobin
-
基于权重的轮询动态调度算法;
-
支持权重的运行时调整,不同于Ivs中的rr轮训模式;
-
HAProxy中的roundrobin支持慢启动(新加的服务器会逐渐增加转发数);
-
其每个后端backend中最多支持4095个real server;
-
支持对real server权重动态调整;
-
roundrobin为默认调度算法,此算法使用广泛。
示例:
[root@haproxy ~]# cat /etc/haproxy/haproxy.cfg
listen webcluster
bind *:80
mode http
balance roundrobin
server web1 172.25.254.10:80 check inter 2 fall 3 rise 5 weight 2
server web2 172.25.254.20:80 check inter 2 fall 3 rise 5 weight 1
[root@haproxy ~]# systemctl restart haproxy
动态调整权重:
echo "set weight webcluster/web1 2" | socat stdio /var/lib/haproxy/stats
echo "set weight webcluster/web1 1" | socat stdio /var/lib/haproxy/stats
leastconn
-
leastconn加权的最少连接的动态;
-
支持权重的运行时调整和慢启动
,即:根据当前连接最少的后端服务器而非权重进行优先调度(新客 户端连接); -
比较适合长连接的场景使用,比如:MySQL等场景。
示例:
[root@haproxy ~]# cat /etc/haproxy/haproxy.cfg
listen webcluster
bind *:80
mode http
balance leastconn
server web1 172.25.254.10:80 check inter 2 fall 3 rise 5 weight 2
server web2 172.25.254.20:80 check inter 2 fall 3 rise 5 weight 1
[root@haproxy ~]# systemctl restart haproxy
其他算法
source
源地址hash,基于用户源地址hash并将请求转发到后端服务器,后续同一个源地址请求将被转发至同一个后端web服务器。此方式当后端服务器数据量发生变化时,会导致很多用户的请求转发至新的后端服务器,默认为静态方式,但是可以通过hash-type支持的选项更改这个算法一般是在不插入Cookie的TCP模式下使用,也可给拒绝会话cookie的客户提供最好的会话粘性,适用于session会话保持但不支持cookie和缓存的场景源地址有两种转发客户端请求到后端服务器的服务器选取计算方式,分别是取模法和一致性hash。
示例:
[root@haproxy ~]# cat /etc/haproxy/haproxy.cfg
listen webcluster
bind *:80
mode http
balance source
server web1 172.25.254.10:80 check inter 2 fall 3 rise 5 weight 2
server web2 172.25.254.20:80 check inter 2 fall 3 rise 5 weight 1
测试:
[root@haproxy ~]# for Nin {1..6};do cur1 172.25.254.100; done
Rsl server - 172.25.254.10
RSl server - 172.25.254.10
Rsl server - 172.25.254.10
Rsl server - 172.25.254.10
Rsl server - 172.25.254.10
RS1 server - 172.25.254.10
Note
如果访问客户端时一个家庭,那么所有的家庭的访问流量都会被定向到一台服务器,这时source算法的缺陷。
map-base 取模法
map-based:取模法,对source地址进行hash计算,再基于服务器总权重的取模,最终结果决定将此请求转发至对应的后端服务器。
此方法是静态的,即不支持在线调整权重,不支持慢启动,可实现对后端服务器均衡调度。
缺点是当服务器的总权重发生变化时,即有服务器上线或下线,都会因总权重发生变化而导致调度结果整体改变,hash-type 指定的默认值为此算法。
Note
-
所谓取模运算,就是计算两个数相除之后的余数,10%7-3,7%4=3;
-
map-based算法:基于权重取模,hash(source_ip)%所有后端服务器相加的总权重。
-
比如当源hash值时1111,1112,1113,三台服务器abc的权重均为1;
-
即abc的调度标签分别会被设定为012(1111%3=1,1112%3=2,1113%3=0);
-
假设a 为 0,1113主机会被调度到a上,如果a下线后,权重数量发生变化;
-
1111%2=1,1112%62=0,1113%62=1;
-
1112和1113被调度到的主机都发生变化,这样会导致会话丢失。
取模法配置示例:
[root@haproxy ~]# cat /etc/haproxy/haproxy.cfg
。。。。。。。。。。。。。。。。
listen webcluster
bind *:80
mode http
balance source
server web1 172.25.254.10:80 check inter 2 fall 3 rise 5 weight 2
server web2 172.25.254.20:80 check inter 2 fall 3 rise 5 weight 1
。。。。。。
#不支持动态调整权重值
[root@haproxy ~]# echo "set weight webcluster/web1 2"|socat stdio/var/lib/haproxy/stats
Backend is using a static LB algorithm and only accepts weights '0%' and '100%'
#只能动态上线和下线
[root@haproxy ~]# echo "set weight webcluster/web1 0" | socat stdio/var/lib/haproxy/stats
[root@haproxy ~]# echo "get weight webcluster/web1" | socat stdio/var/lib/haproxy/stats
0(initia1 1)
一致性hash
一致性哈希,当服务器的总权重发生变化时,对调度结果影响是局部的,不会引起大的变动hash(o)mod n
该hash算法是动态的,支持使用 socat等工具进行在线权重调整,支持慢启动
算法:
1、后端服务器哈希环点keyA=hash(后端服务器虚拟ip)%(2^32);
2、客户机哈希环点key1=hash(client_ip)%(2^32)得到的值在[0---4294967295]之间;
3、将keyA和key1都放在hash环上,将用户请求调度到离key1最近的keyA对应的后端服务器。
hash环偏斜问题
增加虚拟服务器IP数量,比如:一个后端服务器根据权重为1生成1000个虚拟IP,再hash。而后端服务器权
重为2则生成2000的虚拟IP,再bash,最终在hash环上生成3000个节点,从而解决hash环偏斜问题。
hash对象
Hash对象到后端服务器的映射关系:
一致性hash示意图
后端服务器在线与离线的调度方式
高级功能及配置
基于cookie的会话保持
cookie value:为当前server指定cookie值,实现基于cookie的会话黏性,相对于基于 source 地址hash 调度算法对客户端的粒度更精准,但同时也加大了haproxy负载,目前此模式使用较少, 已经被session 共享服务器代替。
Note
-
注意:不支持tcp mode,使用http mode
配置选项
ookie name [ rewrite | insert | prefix ][ indirect ] [ nocache ][ postonly ] [
preserve ][ httponly ] [ secure ][ domain ]* [ maxidle <idle> ][ maxlife ]
name: #cookie 的 key名称,用于实现持久连接
insert: #插入新的cookie,默认不插入cookie
indirect: #如果客户端已经有cookie,则不会再发送cookie信息
nocache: #当client和hapoxy之间有缓存服务器(如:CDN)时,不允许中间缓存器缓存cookie,
#因为这会导致很多经过同一个CDN的请求都发送到同一台后端服务器
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
listen webcluster
bind *:80
mode http
balance roundrobin
cookie WEBCOOKIE insert nocache indirect
server web1 172.25.254.10:80 cookie Sons1 check inter 2 fall 3 rise 5 weight 1
server web2 172.25.254.20:80 cookie Sons2 check inter 2 fall 3 rise 5 weight 1
[root@haproxy ~]# systemctl restart haproxy.service
测试:
[C:\~]$ curl -b WEBCOOKIE=Sons1 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 24 100 24 0 0 12226 0 --:--:-- --:--:-- --:--:-- 24000
server1 - 172.25.254.10
[C:\~]$ curl -b WEBCOOKIE=Sons2 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 24 100 24 0 0 8174 0 --:--:-- --:--:-- --:--:-- 12000
server2 - 172.25.254.20
IP透传
IP 透传(IP Transparency)指的是在代理服务器处理请求和响应的过程中,能够将客户端的真实 IP 地址传递到后端服务器,使得后端服务器能够获取到客户端的原始 IP 而不是代理服务器的 IP 地址。
web服务器中需要记录客户端的真实IP地址,用于做访问统计、安全防护、行为分析、区域排行等场景。
七层IP透传
实验环境
webserver1为Apache,webserver2为nginx
Apache默认情况下没有设定IP透传,如果要有需要在/etc/httpd/conf/httpd.conf
配置文件中添加参数。
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
listen webcluster
bind *:80
mode http
balance roundrobin
server web1 172.25.254.10:80 check inter 2 fall 3 rise 5 weight 1
server web2 172.25.254.20:80 send-proxy check inter 2 fall 3 rise 5 weight 1
[root@haproxy ~]# systemctl restart haproxy.service
[root@webserver1 ~]# dnf install httpd -y
[root@webserver1 ~]# echo webserver1 - 172.25.254.10 > /var/www/html/index.html
[root@webserver1 ~]# systemctl start httpd
[root@webserver1 ~]# vi /etc/httpd/conf/httpd.conf
LogFormat "%{X-Forwarded-For}i %h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined
LogFormat "%h %l %u %t \"%r\" %>s %b" common
<IfModule logio_module>
# You need to enable mod_logio.c to use %I and %O
LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\" %I %O" combinedio
</IfModule
[root@webserver1 ~]# systemctl restart httpd
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 25 100 25 0 0 10794 0 --:--:-- --:--:-- --:--:-- 12500
webserver2 - 172.25.254.20
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 21 100 21 0 0 6231 0 --:--:-- --:--:-- --:--:-- 7000
webserver1 - 172.25.254.10
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 21 100 21 0 0 7996 0 --:--:-- --:--:-- --:--:-- 10500
webserver1 - 172.25.254.10
# 加上参数之后就可以在日志中查看真实的IP
[root@webserver1 ~]# tail -3 /etc/httpd/logs/access_log
172.25.254.1 172.25.254.100 - - [10/Aug/2024:22:39:31 +0800] "GET / HTTP/1.1" 200 27 "-" "curl/8.7.1"
172.25.254.1 172.25.254.100 - - [10/Aug/2024:22:41:33 +0800] "GET / HTTP/1.1" 200 27 "-" "curl/8.7.1"
172.25.254.1 172.25.254.100 - - [10/Aug/2024:22:41:34 +0800] "GET / HTTP/1.1" 200 27 "-" "curl/8.7.1"
CL访问控制列表
访问控制列表ACL,Access Control Lists)
是一种基于包过滤的访问控制技术
它可以根据设定的条件对经过服务器传输的数据包进行过滤(条件匹配)即对接收到的报文进行匹配和过滤,基于请求报文头部中的源地址、源端口、目标地址、目标端口、请求方法、URL、文件后缀等信息内容进行匹配并执行进一步操作,比如允许其通过或丢弃。
frontend webcluster
bind *:80
mode http
acl test hdr_dom(host) -i www.sons1.org
use_backend webcluster-host if test
default_backend default-host
backend webcluster-host
mode http
server web1 172.25.254.10:80 check inter 2 fall 2 rise 5
backend default-host
mode http
server web2 172.25.254.20:80 check inter 2 fall 2 rise 5
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
[root@haproxy ~]# systemctl restart haproxy.service
#在Windows上面也要做本地解析 C:\Windows\System32\drivers\etc hosts文件里写上172.25.254.100 www.sons1.org
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 25 100 25 0 0 12130 0 --:--:-- --:--:-- --:--:-- 12500
webserver2 - 172.25.254.20
[C:\~]$ curl www.sons1.org
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 21 100 21 0 0 2300 0 --:--:-- --:--:-- --:--:-- 3000
webserver1 - 172.25.254.10
利用ACL做动静分离访问控制
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
frontend webcluster
bind *:80
mode http
acl domain hdr_dom(host) -i www.sons1.org
#####################################################
use_backend webcluster-host if domain
default_backend default-host
backend webcluster-host
mode http
server web1 172.25.254.10:80 check inter 2 fall 2 rise 5
backend default-host
mode http
server web2 172.25.254.20:80 check inter 2 fall 2 rise 5
# 只有访问www.sosn1.org域名的时候才会去访问webserver1,否则访问webserver2
[C:\~]$ curl www.sons1.org
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 21 100 21 0 0 3558 0 --:--:-- --:--:-- --:--:-- 7000
webserver1 - 172.25.254.10
[C:\~]$ curl www.sons1.com
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 25 100 25 0 0 2763 0 --:--:-- --:--:-- --:--:-- 3571
webserver2 - 172.25.254.20
# 基于IP的访问控制
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
frontend webcluster
bind *:80
mode http
acl ctrl_ip src 172.25.254.1 172.25.254.20 192.168.0.0/24 # 写具体的IP地址也可以写网段
#####################################################
use_backend webcluster-host if ctrl_ip
default_backend default-host
backend webcluster-host
mode http
server web1 172.25.254.10:80 check inter 2 fall 2 rise 5
backend default-host
mode http
server web2 172.25.254.20:80 check inter 2 fall 2 rise 5
# 符合条件的访问webserver1,不符合的访问webserver2
[C:\~]$ curl www.sons1.com #本机的IP为172.25.254.1
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 21 100 21 0 0 2151 0 --:--:-- --:--:-- --:--:-- 3000
webserver1 - 172.25.254.10
[root@webserver2 ~]# curl 172.25.254.100
webserver1 - 172.25.254.10
[root@test ~]# curl 172.25.254.100
webserver2 - 172.25.254.20
# 拒绝IP访问
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
frontend webcluster
bind *:80
mode http
acl ctrl_ip src 172.25.254.1 172.25.254.20 192.168.0.0/24
#####################################################
http-request deny if ctrl_ip
default_backend default-host
backend webcluster-host
mode http
server web1 172.25.254.10:80 check inter 2 fall 2 rise 5
backend default-host
mode http
server web2 172.25.254.20:80 check inter 2 fall 2 rise 5
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 93 100 93 0 0 64898 0 --:--:-- --:--:-- --:--:-- 93000
<html><body><h1>403 Forbidden</h1>
Request forbidden by administrative rules.
</body></html>
[root@test ~]# curl 172.25.254.100
webserver2:172.25.254.20
# 基于浏览器类型的访问控制
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
frontend webcluster
bind *:80
mode http
acl badwebbrowers hdr_sub(User-Agent) -i curl wget
#####################################################
http-request deny if badwebbrowers
default_backend default-host
backend webcluster-host
mode http
server web1 172.25.254.10:80 check inter 2 fall 2 rise 5
backend default-host
mode http
server web2 172.25.254.20:80 check inter 2 fall 2 rise 5
[C:\~]$ curl 172.25.254.100
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 93 100 93 0 0 62207 0 --:--:-- --:--:-- --:--:-- 93000
<html><body><h1>403 Forbidden</h1>
Request forbidden by administrative rules.
</body></html>
基于访问路径实现动静分离
[root@webserver2 ~]# mkdir /usr/share/nginx/html/static -p
[root@webserver2 ~]# echo static - 172.25.254.20 > /usr/share/nginx/html/static/index.html
[root@webserver2 ~]#
[root@webserver2 ~]# curl 172.25.254.20/static/
static - 172.25.254.20
[root@webserver1 ~]# mkdir -p /var/www/html/php
[root@webserver1 ~]# cp /var/www/html/index.php /var/www/html/php/
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
frontend webcluster
bind *:80
mode http
acl static path_sub -m sub static
acl php path_sub -m sub php
#####################################################
use_backend webcluster-host if php
default_backend default-host
backend webcluster-host
mode http
server web1 172.25.254.10:80 check inter 2 fall 2 rise 5
backend default-host
mode http
server web2 172.25.254.20:80 check inter 2 fall 2 rise 5
依靠ACL访问控制去访问,不同的路径访问不同的页面
自定义HAProxy 错误界面
对指定的报错进行重定向,进行优雅的显示错误页面
使用errorfile和errorloc指令的两种方法,可以实现自定义各种错误页面
[root@haproxy ~]# mkdir /etc/haproxy/errorpage -p
[root@haproxy ~]# vim /etc/haproxy/errorpage/503.http
HTTP/1.0 503 Service Unavailable
Cache-Control: no-cache
Connection: close
Content-Type: text/html;charset=UTF-8
<html><body><h1>ju jue fang wen </h1>
da sha b!!!
</body></html>
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
defaults
mode http
log global
option httplog
option dontlognull
option http-server-close
option forwardfor except 127.0.0.0/8
option redispatch
retries 3
timeout http-request 10s
timeout queue 1m
timeout connect 10s
timeout client 1m
timeout server 1m
timeout http-keep-alive 10s
timeout check 10s
maxconn 3000
errorfile 503 /etc/haproxy/errorpage/503.http
#基于http重定向错误页面
#errorloc 503 https://www.bilibili.com 浏览器访问172.25.254.100 自动跳转到哔哩哔哩
[root@haproxy ~]# systemctl restart haproxy.service
haproxy四层负载
[root@webserver1 ~]# dnf install mariadb-server -y
[root@webserver2 ~]# dnf install mariadb-server -y
[root@webserver1 ~]# vim /etc/my.cnf.d/mariadb-server.cnf
[mysqld]
server-id=1 # 数据库id为1 区分实现实验效果
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
log-error=/var/log/mariadb/mariadb.log
pid-file=/run/mariadb/mariadb.pid
[root@webserver1 ~]# systemctl start mariadb
[root@webserver1 ~]# mysql
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 3
Server version: 10.5.22-MariaDB MariaDB Server
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]> SELECT @@server_id;
+-------------+
| @@server_id |
+-------------+
| 1 |
+-------------+
1 row in set (0.000 sec)
MariaDB [(none)]> create user sons1@'%' identified by '123';
Query OK, 0 rows affected (0.001 sec)
MariaDB [(none)]> grant all on *.* to sons1@'%';
Query OK, 0 rows affected (0.001 sec)
[root@webserver2 ~]# vim /etc/my.cnf.d/mariadb-server.cnf
[mysqld]
server-id=2
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
log-error=/var/log/mariadb/mariadb.log
pid-file=/run/mariadb/mariadb.pid
[root@webserver2 ~]# systemctl start mariadb
[root@webserver2 ~]# mysql
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 3
Server version: 10.5.22-MariaDB MariaDB Server
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]> SELECT @@server_id;
+-------------+
| @@server_id |
+-------------+
| 2 |
+-------------+
1 row in set (0.000 sec)
MariaDB [(none)]> create user sons1@'%' identified by '123';
Query OK, 0 rows affected (0.001 sec)
MariaDB [(none)]> grant all on *.* to sons1@'%';
Query OK, 0 rows affected (0.001 sec)
[root@test ~]# dnf install mariadb -y
[root@test ~]# mysql -usons1 -p -h 172.25.254.10
Enter password:
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 4
Server version: 10.5.22-MariaDB MariaDB Server
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]>
# 做负载
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
listen dbserver
bind *:3306
mode tcp
balance roundrobin
server db1 172.25.254.10:3306 check inter 2 fall 2 rise 5
server db2 172.25.254.20:3306 check inter 2 fall 2 rise 5
[root@haproxy ~]# systemctl restart haproxy.service
# Sons1为测试机
[root@Sons1 ~]# mysql -usons1 -pson1 -h 172.25.254.100
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 5
Server version: 10.5.22-MariaDB MariaDB Server
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]> select @@server_id;
+-------------+
| @@server_id |
+-------------+
| 1 |
+-------------+
1 row in set (0.001 sec)
MariaDB [(none)]> exit
Bye
[root@test ~]# mysql -usons1 -pson1 -h 172.25.254.100
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 4
Server version: 10.5.22-MariaDB MariaDB Server
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]> select @@server_id;
+-------------+
| @@server_id |
+-------------+
| 2 |
+-------------+
1 row in set (0.001 sec)
haproxy的基于https的加密访问
[root@haproxy ~]# mkdir -p /etc/haproxy/certs
[root@haproxy ~]# openssl req -newkey rsa:2048 -nodes -sha256 -keyout /etc/haproxy/certs/Sons1.key -x509 -days 365 -out /etc/haproxy/certs/Sons1.crt
.+..........+...........+..........+.....+...+.......+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+.......+......+.........+...+.........+..............+.+...+...+...+......+......+........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.+..............+...+...+...+.......+..............+..........+.........+..+....+...+...+...+.....+.+...+......+......+.....+......+...+...............+....+...+.....+..........+.................+.+.....+....+.....+............+...+.............+..+...+...+....+...+..+...+.........+.........+.......+.................+.+.....+....+...............+..+.+........+.+...........+....+...........+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
....+...+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+...+...+.....+...+......+....+..+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+..+...+.........+....+......+.....+....+..+...+......+...+..........+......+............+.....+.......+.....+.+......+...+...+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----
You are about to be asked to enter information that will be incorporated
into your certificate request.
What you are about to enter is what is called a Distinguished Name or a DN.
There are quite a few fields but you can leave some blank
For some fields there will be a default value,
If you enter '.', the field will be left blank.
-----
Country Name (2 letter code) [XX]:CN
State or Province Name (full name) []:ShanXi
Locality Name (eg, city) [Default City]:XiAn
Organization Name (eg, company) [Default Company Ltd]:Sons1
Organizational Unit Name (eg, section) []:web
Common Name (eg, your name or your server's hostname) []:www.sons1.com
Email Address []:admin@sons1.com
[root@haproxy ~]# ls /etc/haproxy/certs/
Sons1.crt Sons1.key
[root@haproxy certs]# cat /etc/haproxy/certs/Sons1.key /etc/haproxy/certs/Sons1.crt > /etc/haproxy/certs/Sons1.pem
[root@haproxy certs]# cat /etc/haproxy/certs/Sons1.pem
-----BEGIN PRIVATE KEY-----
MIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQD0FQQiCrP53QVc
kEdwKgHQdy/TrPGQHno5udF1eebmasHAoXfoKwvNxaoCBnJ3a1uiAtQmhLexaUIw
s/AYYWX5N8R7RlvQMhf8gd+W38/m2XveqoNubgc0+Lb1abVmgHDqZoij8wPphNmL
jvrat8uOTTLVO5g/tflOA7QdGT4AGNAKqguQGE4c+BbwpDiMj5ZQeoyTrnnCGQdM
z51f1bo5eLn0sRmQd9THmLRhwZqBllR5AzqVGE/sUMB7vRoUhCK8MLBFGOfgPyyN
sBWeAyTUJY6cwM5uNfzdOPpG5o+POawzflY+U1HjRvFlPenmcW9DeEMxaldcLL3z
AWeNiwhBAgMBAAECggEAAJGEdhJVjzdILgohenXElZBTfpAUa3Agu33u6pG/O4nj
29+cZIBmKYNkdRcAAP5xYxAT36eXOGzs9ClVHa9rYgBS3zEfoV1egC5qv4KTrL9U
qiT2Q6Vys5lBLtLhUuTpbmhQ+OXF3G88ZPZvJ9999D3CiKvX+80AEMISMy+l/PDQ
sBR6WUHo7Lro8IXYYKAvt94qeLAV+vEKirG0ReXyLzYVHAgIAO+qWNxhtBT+aUkl
4qkrQYdKVz/KW7JkEhr9e2M00U5YRioLMqrEFD5faZ8YtEKQOuRmY6XVKdl9sbcg
68yFjPBvtUOCxdjUot54S5VpnQm+1wP46QmTIliMmQKBgQD0VZEp5O6WZDjCBk0p
l/xArxQjluRCeS3LxCVzEYuoPe+auBswgZTX4XXh1y/8UAWDE7Yu8Dq72EFWtf5z
VC20PXtSE05XV6sPgnMbj/fCV8xIYx9Zid6ft56nNrsAGGX2XcXtvFLwQCEBV95J
yesGjdsrW21Zpn4jd1WLGLAqWQKBgQD/vF37D/9FAp3rkSyp8imBkaju/6EMrU/m
OaDJDzt2/I4+tHyxIeRmUOQGY6jm5ccLKhWfwU1Wyj90sj9bEZXQMafQpoLvSVsb
OQFwShbdJilYE9yZPQVVGX1Jve6vMlq3ATeB8VrrQsE80XIao8pGPBRFanUfqCjA
oC2QsO5AKQKBgQCG/2gPT7ALZCCAA19K5fC4BIQKDercV3vYI+3VIBKbyGzEfYh4
SoBkruuk9nJK5CPHgnKciJrLAvdG45NNQWtnNLkYZhZY59VZ4mebCPaJaF00eZ/u
puBcOuXr2a+Eo/ZiIvmjGvRwTd5ukY/+ERRMMMCxufg3GmiDTAH1spRTMQKBgAcu
ErVpzZDycdybRtW+psuse0G6i5r/gq7ED2+VreW5UYURLC8M9Iyq2LwVMDjLWrtF
gzXpB3LYWs+78WttIvelbUC+bA6r0JMDFrdAXUP4PlDqvdbPj8bD4HChlIH2t/VL
Y3OSgyr3xNUgTEPTNWqjZS5NvtwUrJA77wuQ7B+BAoGAXwV3GV63QQ/uee6e2IdQ
pcUkYrczIzhnsqDKAylyWDMO4b4+cH0n4JBElWUfk/kp2sd1f3GaofiU33oTH9LW
9seIXMBa/xy+5IyxHySwB8HQgXlLo65NLFmMu3Ft+uA3zd+I8Wr1JeJ0ksYTiLlW
wwN+g/48uQS11lePNeQ9kZE=
-----END PRIVATE KEY-----
-----BEGIN CERTIFICATE-----
MIID6TCCAtGgAwIBAgIUF/NDlp3PXUERJog7FyCbRuoEJqMwDQYJKoZIhvcNAQEL
BQAwgYMxCzAJBgNVBAYTAkNOMQ8wDQYDVQQIDAZTaGFuWGkxDTALBgNVBAcMBFhp
QW4xDjAMBgNVBAoMBVNvbnMxMQwwCgYDVQQLDAN3ZWIxFjAUBgNVBAMMDXd3dy5z
b25zMS5jb20xHjAcBgkqhkiG9w0BCQEWD2FkbWluQHNvbnMxLmNvbTAeFw0yNDA4
MTEwNzAyMDBaFw0yNTA4MTEwNzAyMDBaMIGDMQswCQYDVQQGEwJDTjEPMA0GA1UE
CAwGU2hhblhpMQ0wCwYDVQQHDARYaUFuMQ4wDAYDVQQKDAVTb25zMTEMMAoGA1UE
CwwDd2ViMRYwFAYDVQQDDA13d3cuc29uczEuY29tMR4wHAYJKoZIhvcNAQkBFg9h
ZG1pbkBzb25zMS5jb20wggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQD0
FQQiCrP53QVckEdwKgHQdy/TrPGQHno5udF1eebmasHAoXfoKwvNxaoCBnJ3a1ui
AtQmhLexaUIws/AYYWX5N8R7RlvQMhf8gd+W38/m2XveqoNubgc0+Lb1abVmgHDq
Zoij8wPphNmLjvrat8uOTTLVO5g/tflOA7QdGT4AGNAKqguQGE4c+BbwpDiMj5ZQ
eoyTrnnCGQdMz51f1bo5eLn0sRmQd9THmLRhwZqBllR5AzqVGE/sUMB7vRoUhCK8
MLBFGOfgPyyNsBWeAyTUJY6cwM5uNfzdOPpG5o+POawzflY+U1HjRvFlPenmcW9D
eEMxaldcLL3zAWeNiwhBAgMBAAGjUzBRMB0GA1UdDgQWBBTO+qersnR6XU7GBVGo
uP2xRxTkpTAfBgNVHSMEGDAWgBTO+qersnR6XU7GBVGouP2xRxTkpTAPBgNVHRMB
Af8EBTADAQH/MA0GCSqGSIb3DQEBCwUAA4IBAQAGfOZXna/SZD0gU3ib0rdaRmnr
9hXGvnIDvbxpLsAJQ3PdDguRIw2gZyR7ATvIsg13XEdEcTrBicSGlLo/70zjokAe
hh7ixGVnSkkV60LqIqV/xwBK8OrmdFKV5A4SrFpaqBVktjHEHGz78zwQR/aLHiwv
KquQwjDZfBNf6NzznrYej1Vm8Xm+p7mLksopos1l/lUVkG8HZib0jSW2KuSc9E5d
rJQDknp9Cn5crFM+R6IMcTyo+t4eTeo5+iA4IXa40bfb8anJ0XvQlmIXiop7hrTO
8QJ6XfMajsSqiT8UC+AsFRGs4ADj0ch2CywwigAuYghwoLYmkr1TEYL+r/xz
-----END CERTIFICATE-----
[root@haproxy ~]# vim /etc/haproxy/haproxy.cfg
frontend webserver
bind *:80
mode http
redirect scheme https if !{ ssl_fc } #全站加密 加这一条自动将80端口的请求重定向到443
listen web-https
bind *:443 ssl crt /etc/haproxy/certs/Sons1.pem
mode http
balance roundrobin
server web1 172.25.254.10:443 check inter 2 fall 2 rise 5
server web2 172.25.254.20:443 check inter 2 fall 2 rise 5