笔记-单台虚拟机使用docker-compose搭建nginx(三节点)+keepalived(三节点)+Haproxy（单节点）

已于 2023-01-19 16:41:11 修改
阅读量802 收藏 4
点赞数 3
文章标签： docker nginx Powered by 金山文档
于 2023-01-19 16:39:06 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_42461794/article/details/128734019
版权

文章简介

记录自己如何使用Docker-compose在单台宿主机的情况下搭建Nginx（三节点)+keepalived(三节点)+Haproxy(单节点),希望对大家有帮助，如配置有问题或有可优化的地方请发评论，各位大佬们多多指教

目录结构

目录中stream配置文件为备用，以后想用再说。

[root@localhost nginx]# tree
.
├── check_nginx.sh
├── conf.d
│   ├── haproxy
│   │   └── haproxy.cfg
│   ├── nginx
│   │   └── nginx.conf
│   └── stream
│       └── server.conf
├── docker-compose.yml
├── init
│   └── nginx_index
│       ├── master
│       │   └── index-master.html
│       └── slave
│           ├── index-slave-1.html
│           └── index-slave-2.html
└── keepalive
    ├── master
    │   └── keepalived-master.conf
    └── slave
        ├── keepalived-slave-1.conf
        └── keepalived-slave-2.conf

11 directories, 11 files

镜像制作

制作nginx+keepalived镜像

编写Dockerfile

这里根据nginx官方提供的镜像来制作nginx+keepalived的镜像

FROM nginx

ARG TZ="Asia/Shanghai"

ENV TZ ${TZ}

COPY docker-entrypoint.sh /

RUN sed -i s@/deb.debian.org/@/mirrors.aliyun.com/@g /etc/apt/sources.list && apt-get clean && apt-get update && apt-get install --no-install-recommends -y keepalived && apt-get install --no-install-recommends -y net-tools && apt-get install --no-install-recommends -y && apt-get install --no-install-recommends -y curl && apt-get install --no-install-recommends -y procps && apt-get install --no-install-recommends -y wget && apt-get install && apt-get clean &&rm -rf /var/lib/apt/lists/* && chmod +x /docker-entrypoint.sh

ENTRYPOINT ["/docker-entrypoint.sh"]

CMD ["nginx" , "-g" , "daemon off;"]

docker-entrypoint.sh

#!/bin/sh
# vim:sw=4:ts=4:et
set -e

echo "keepalived start"
keepalived -f /etc/keepalived/keepalived.conf
echo "keepalived success"

if [ -z "${NGINX_ENTRYPOINT_QUIET_LOGS:-}" ]; then
    exec 3>&1
else
    exec 3>/dev/null
fi

if [ "$1" = "nginx" -o "$1" = "nginx-debug" ]; then
    if /usr/bin/find "/docker-entrypoint.d/" -mindepth 1 -maxdepth 1 -type f -print -quit 2>/dev/null | read v; then
        echo >&3 "$0: /docker-entrypoint.d/ is not empty, will attempt to perform configuration"

        echo >&3 "$0: Looking for shell scripts in /docker-entrypoint.d/"
        find "/docker-entrypoint.d/" -follow -type f -print | sort -n | while read -r f; do
            case "$f" in
                *.sh)
                    if [ -x "$f" ]; then
                        echo >&3 "$0: Launching $f";
                        "$f"
                    else
                        # warn on shell scripts without exec bit
                        echo >&3 "$0: Ignoring $f, not executable";
                    fi
                    ;;
                *) echo >&3 "$0: Ignoring $f";;
            esac
        done

        echo >&3 "$0: Configuration complete; ready for start up"
    else
        echo >&3 "$0: No files found in /docker-entrypoint.d/, skipping configuration"
    fi
fi

exec "$@"

使用docker build构建镜像

docker build -t nginx-keepalived:0.0.2 .

拉取Haproxy镜像

docker pull haproxy

使用docker-compose部署

编写docker-compose.yml文件

version: "3"
services:
  nginx_master:
     image: nginx-keepalived:0.0.2
     container_name: nginx-master
     restart: always
     privileged: true
     volumes:
     - ./conf.d/stream:/opt/nginx/stream/conf.d
     - ./conf.d/nginx/nginx.conf:/etc/nginx/nginx.conf
     - ./init/nginx_index/master/index-master.html:/usr/share/nginx/html/index.html
     - ./keepalive/master/keepalived-master.conf:/etc/keepalived/keepalived.conf
     - ./check_nginx.sh:/etc/keepalived/check_nginx.sh
     networks:
        nginx:
          ipv4_address: "20.20.20.10"
     cap_add:
     - NET_ADMIN
  nginx_slave1:
     image: nginx-keepalived:0.0.2
     container_name: nginx-slave1
     restart: always
     privileged: true
     volumes:
     - ./conf.d/stream:/opt/nginx/stream/conf.d
     - ./conf.d/nginx/nginx.conf:/etc/nginx/nginx.conf
     - ./init/nginx_index/slave/index-slave-1.html:/usr/share/nginx/html/index.html
     - ./keepalive/slave/keepalived-slave-1.conf:/etc/keepalived/keepalived.conf
     - ./check_nginx.sh:/etc/keepalived/check_nginx.sh
     networks:
        nginx:
          ipv4_address: "20.20.20.20"
     cap_add:
     - NET_ADMIN
  nginx_slave2:
     image: nginx-keepalived:0.0.2
     container_name: nginx-slave2
     restart: always
     privileged: true
     volumes:
     - ./conf.d/stream:/opt/nginx/stream/conf.d
     - ./conf.d/nginx/nginx.conf:/etc/nginx/nginx.conf
     - ./init/nginx_index/slave/index-slave-2.html:/usr/share/nginx/html/index.html
     - ./keepalive/slave/keepalived-slave-2.conf:/etc/keepalived/keepalived.conf
     - ./check_nginx.sh:/etc/keepalived/check_nginx.sh
     networks:
        nginx:
          ipv4_address: "20.20.20.30"
     cap_add:
     - NET_ADMIN
  proxy:
     image: haproxy:latest
     container_name: nginx-proxy
     restart: always
     ports:
     - 80:6301
     volumes:
     - ./conf.d/haproxy/haproxy.cfg:/usr/local/etc/haproxy/haproxy.cfg
     networks:
     - nginx
     cap_add:
     - NET_ADMIN
     depends_on:
     - nginx_master
     - nginx_slave1
     - nginx_slave2
networks:
 nginx:
    driver: bridge
    ipam:
      driver: default
      config:
      - subnet: "20.20.0.0/16"

编辑keepalived配置文件

keepalived-master.conf

global_defs {
   router_id LVS_DEVEL
}

vrrp_script chk_nginx {
    script "/etc/keepalived/check_nginx.sh"
    interval 2
    weight -20
}

vrrp_instance VI_1 {
    state MASTER
    interface eth0
    virtual_router_id 70
    priority 200
    preempt
    advert_int 1
    unicast_src_ip 20.20.20.10
    unicast_peer {
        20.20.20.20
        20.20.20.30
    }

    authentication {
        auth_type PASS
        auth_pass Password@123
    }

    virtual_ipaddress {
        20.20.20.40/24 dev eth0
    }

    track_script {
        chk_nginx
    }
}

keepalived-slave-1.conf

global_defs {
   router_id LVS_DEVEL
}

vrrp_script chk_nginx {
    script "/etc/keepalived/check_nginx.sh"
    interval 2
    weight -20
}

vrrp_instance VI_1 {
    state BACKUP
    interface eth0
    virtual_router_id 70
    priority 150
    nopreempt
    advert_int 1
    unicast_src_ip 20.20.20.20
    unicast_peer {
        20.20.20.10
        20.20.20.30
    }

    authentication {
        auth_type PASS
        auth_pass Password@123
    }

    virtual_ipaddress {
        20.20.20.40/24 dev eth0
    }

    track_script {
        chk_nginx
    }
}

keepalived-slave-2.conf

global_defs {
   router_id LVS_DEVEL
}

vrrp_script chk_nginx {
    script "/etc/keepalived/check_nginx.sh"
    interval 2
    weight -20
}

vrrp_instance VI_1 {
    state BACKUP
    interface eth0
    virtual_router_id 70
    priority 100
    nopreempt
    advert_int 1
    unicast_src_ip 20.20.20.30
    unicast_peer {
        20.20.20.20
        20.20.20.10
    }

    authentication {
        auth_type PASS
        auth_pass Password@123
    }

    virtual_ipaddress {
        20.20.20.40/24 dev eth0
    }

    track_script {
        chk_nginx
    }
}

编写nginx监测脚本

#!/bin/bash
A=`ps -C nginx --no-header | wc -l`
if [ $A -eq 0 ];then
 /usr/local/nginx/sbin/nginx
 sleep 2
 if [ `ps -C nginx --no-header | wc -l` -eq 0 ];then
 killall keepalived
 fi
fi

编辑nginx配置文件

user nginx;
worker_processes auto;

error_log /var/log/nginx/error.log warn;
pid       /var/run/nginx.pid;

events {
    worker_connections 1024;
}

http{
server {
   listen       80;
   server_name localhost;


   charset utf-8;

   location / {
        root  /usr/share/nginx/html;
        index index.php index.html index.htm;
   }
 }
}

编辑Haproxy配置文件

此处监听地址keepalived配置文件中配置的vip地址

global
   log 127.0.0.1 local0
   maxconn 4096
   daemon

defaults
    log 127.0.0.1 local3
    mode http
    option dontlognull
    option redispatch
    retries 2
    maxconn 2000
    balance roundrobin
    timeout connect 5000ms
    timeout client 5000ms
    timeout server 5000ms

frontend main
    bind *:6301
    default_backend webserver

backend webserver
    server nginx_master 20.20.20.40:80 check inter 2000 rise 2 fall 5

编写测试页面

编辑测试用index-master.html

<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
html { color-scheme: light dark; }
body { width: 35em; margin: 0 auto;
font-family: Tahoma, Verdana, Arial, sans-serif; }
</style>
</head>
<body>
<h1>Welcome to nginx!</h1>
<h1><strong>MASTER</strong></h1>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>

<p>For online documentation and support please refer to
<a href="http://nginx.org/">nginx.org</a>.<br/>
Commercial support is available at
<a href="http://nginx.com/">nginx.com</a>.</p>

<p><em>Thank you for using nginx.</em></p>
</body>
</html>

编辑测试用index-slave-1.html

<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
html { color-scheme: light dark; }
body { width: 35em; margin: 0 auto;
font-family: Tahoma, Verdana, Arial, sans-serif; }
</style>
</head>
<body>
<h1>Welcome to nginx!</h1>
<h1><strong>SLAVE-1</strong></h1>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>

<p>For online documentation and support please refer to
<a href="http://nginx.org/">nginx.org</a>.<br/>
Commercial support is available at
<a href="http://nginx.com/">nginx.com</a>.</p>

<p><em>Thank you for using nginx.</em></p>
</body>
</html>

编辑测试用index-slave-2.html

<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
html { color-scheme: light dark; }
body { width: 35em; margin: 0 auto;
font-family: Tahoma, Verdana, Arial, sans-serif; }
</style>
</head>
<body>
<h1>Welcome to nginx!</h1>
<h1><strong>SLAVE-2</strong></h1>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>

<p>For online documentation and support please refer to
<a href="http://nginx.org/">nginx.org</a>.<br/>
Commercial support is available at
<a href="http://nginx.com/">nginx.com</a>.</p>

<p><em>Thank you for using nginx.</em></p>
</body>
</html>

运行docker-compose

docker-compose up -d

运行情况如下

[root@localhost nginx]# docker-compose up -d
[+] Running 5/5
 ⠿ Network nginx_nginx     Created                                                                                                                                                0.1s
 ⠿ Container nginx-slave2  Started                                                                                                                                                1.4s
 ⠿ Container nginx-master  Started                                                                                                                                                1.3s
 ⠿ Container nginx-slave1  Started                                                                                                                                                1.5s
 ⠿ Container nginx-proxy   Started                                                                                                                                                2.3s
[root@localhost nginx]# docker ps -a
CONTAINER ID   IMAGE                           COMMAND                  CREATED         STATUS         PORTS                                                           NAMES
14d6fbcd0db3   haproxy:latest                  "docker-entrypoint.s…"   5 seconds ago   Up 2 seconds   0.0.0.0:80->6301/tcp, :::80->6301/tcp                           nginx-proxy
cd5c033ea077   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   6 seconds ago   Up 3 seconds   80/tcp                                                          nginx-slave2
5a9a24a58169   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   6 seconds ago   Up 3 seconds   80/tcp                                                          nginx-slave1
d168f89a8f51   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   6 seconds ago   Up 3 seconds   80/tcp                                                          nginx-master

测试

使用浏览器访问

关闭master节点

docker stop nginx-master

运行结果如下：

[root@localhost nginx]# docker stop nginx-master
nginx-master
[root@localhost nginx]# docker ps -a
CONTAINER ID   IMAGE                           COMMAND                  CREATED         STATUS                     PORTS                                                           NAMES
14d6fbcd0db3   haproxy:latest                  "docker-entrypoint.s…"   6 minutes ago   Up 6 minutes               0.0.0.0:80->6301/tcp, :::80->6301/tcp                           nginx-proxy
cd5c033ea077   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   6 minutes ago   Up 6 minutes               80/tcp                                                          nginx-slave2
5a9a24a58169   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   6 minutes ago   Up 6 minutes               80/tcp                                                          nginx-slave1
d168f89a8f51   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   6 minutes ago   Exited (0) 2 seconds ago                                                                   nginx-master

可以看到nginx-master节点已经处于退出状态

关闭nginx-master后刷新网页

关闭slave1节点

docker stop nginx-slave1

运行结果如下：

[root@localhost nginx]# docker stop nginx-slave1
nginx-slave1
[root@localhost nginx]# docker ps -a
CONTAINER ID   IMAGE                           COMMAND                  CREATED          STATUS                     PORTS                                                           NAMES
14d6fbcd0db3   haproxy:latest                  "docker-entrypoint.s…"   11 minutes ago   Up 11 minutes              0.0.0.0:80->6301/tcp, :::80->6301/tcp                           nginx-proxy
cd5c033ea077   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   11 minutes ago   Up 11 minutes              80/tcp                                                          nginx-slave2
5a9a24a58169   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   11 minutes ago   Exited (0) 2 seconds ago                                                                   nginx-slave1
d168f89a8f51   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   11 minutes ago   Exited (0) 4 minutes ago                                                                   nginx-master

可以看到master节点和slave1节点都处于了退出状态

关闭slave1节点后刷新网页

可以看到切换非常的顺畅

打开master节点测试是否会进行一个抢占

docker start nginx-master

运行效果如下:

[root@localhost nginx]# docker start nginx-master
nginx-master
[root@localhost nginx]# docker ps -a
CONTAINER ID   IMAGE                           COMMAND                  CREATED          STATUS                     PORTS                                                           NAMES
14d6fbcd0db3   haproxy:latest                  "docker-entrypoint.s…"   14 minutes ago   Up 14 minutes              0.0.0.0:80->6301/tcp, :::80->6301/tcp                           nginx-proxy
cd5c033ea077   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   14 minutes ago   Up 14 minutes              80/tcp                                                          nginx-slave2
5a9a24a58169   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   14 minutes ago   Exited (0) 3 minutes ago                                                                   nginx-slave1
d168f89a8f51   nginx-keepalived:0.0.2          "/docker-entrypoint.…"   14 minutes ago   Up 1 second                80/tcp                                                          nginx-master

打开master节点后刷新网页

结尾

感谢大家的耐心观看，第一次发文章排版及顺序会不太好还望大家海涵，如果大家发现什么问题及优化的建议，可以发在评论，祝大家新年快乐，工作顺利

ps:这玩意咋生成目录

小甜甜
关注
  • 3
    点赞
  • 踩
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
基于docker-compose实现haproxy+keepalived+teleport的负载均衡和高可用1
08-04
主机名IP地址操作系统组件备注环境说明架构图目录结构配置文件docker-compose配置文件keepalived配置文件keepalived检测脚本hapr
docker-compose php7.3.4-fpm+nginx+mysql配置
09-07
docker-compose php7.3.4-fpm+nginx+mysql配置
通过 docker-compose 搭建高可用 nginx + keepalived 集群
henulmh的博客
04-01 2279
Keepalived 是一种高性能的服务器高可用或热备解决方案， Keepalived 可以用来防止服务器单点故障的发生，通过配合 Nginx 可以实现 web 前端服务的高可用。Keepalived 以 VRRP 协议为实现基础。
Docker Compose--安装Nginx--方法/实例
最新发布
IT利刃出鞘的博客
06-24 607
本文介绍Docker Compose如何安装Nginx。
Nginx 教程- 基于Docker keepalived 搭高可用
lly576403061的博客
04-05 1781
Nginx 教程- 基于Docker keepalived 搭高可用
Centos 7部署docker+nginx+keepalived实现高可用web集群
weixin_34345560的博客
09-26 714
一．体系架构 在Keepalived + Nginx高可用负载均衡架构中，keepalived负责实现High-availability (HA) 功能控制前端机VIP（虚拟网络地址），当有设备发生故障时，热备服务器可以瞬间将VIP自动切换过来，实际运行中体验只有2秒钟切换时间，DNS服务可以负责前端VIP的负载均衡。nginx负责控制后端web服务器的负载均衡，将客户端的请求按照一定的算法转发给...
构建nginx + keepalived docker镜像
qq_39709575的博客
04-25 750
构建nginx + keepalived docker镜像
docker-compose-flask：docker-compose部署nginx + gunicorn + flask + redis（或db）
02-05
码头工人组成烧瓶 +-------------+ +------------+ +--------------+ +-----------+ | | | | | | | | | nginx +-------+ gunicorn +---------+ flask app +-----+ redis | | | | | |
wordpress-nginx-docker-compose：使用Docker Compose与nginx一起运行WordPress
02-02
Docker Compose和WordPress 使用在Docker本地使用WordPress 内容 一个Dockerfile用于扩展基本映像并自定义 PHP 7.4 自定义域，例如myapp.local ./nginx自定义./nginx配置 ./config自定义PHP php.ini配置 nginx ，...
docker-compose:带有Docker + Docker Compose的容器-适用于CI
05-15
该泊坞窗映像将docker-compose安装在docker映像之上。 这对于使用“ Docker in Docker”的CI管道非常有用。 支持的Docker版本 有基于不同的泊坞窗版本的版本，例如latest ， 20.10 ， 19.03和19 。 docker-compose...
在DOCKER 环境下使用keepalived+Nginx实现高可用
zwwang2014的博客
09-08 1699
在DOCKER 环境下使用keepalived+Nginx实现高可用准备安装制作keepalived+Nginx 的image编制并启动基础版本的centos下载测试工具安装测试 准备 安装 安装docker-desktop 制作keepalived+Nginx 的image 编制并启动基础版本的centos docker-compose.yml 文件如下： ‘’’ version: ‘3.9’ services: keepalivebase: image: ‘centos:8’ container_na
高可用Web群集架构(Keepalived，Nginx，Tomcat，Docker-Compose，Elk，Consul)
Shadow__Flow的博客
12-06 771
本文介绍了如何搭建一个高可用Web群集架构。 该架构具有高可用、负载均衡、动静分离、高灵活性、弹性收缩、日志可视化等特点。
docker搭建nginx+keepalived集群
hcyxsh的博客
09-21 1389
使用docker搭建nginx+keepalived集群
docker+nginx+keepalived部署实现nginx高可用
qq_39507330的博客
07-17 2896
一．架构 在Keepalived + Nginx高可用负载均衡架构中，keepalived负责实现High-availability (HA) 功能控制前端机VIP（虚拟网络地址），当有设备发生故障时，热备服务器可以瞬间将VIP自动切换过来，实际运行中体验只有2秒钟切换时间，DNS服务可以负责前端VIP的负载均衡。 nginx负责后端web服务器的负载均衡，将客户...
Docker+Nginx+Keepalived实现架构高可用
我的博客
07-05 210
修改/etc/keepalived/keepalived.conf文件/etc/keepalived/check_nginx.sh文件keepalived是通过检测keepalived进程是否存在判断服务器是否宕机，如果keepalived进程在但是nginx进程不在了那么keepalived是不会做主备切换，所以我们需要写个脚本来监控nginx进程是否存在，如果nginx不存在就将keepalived进程杀掉。
docker-部署Keepalived实现Nginx高可用
孟孟的博客
10-13 5180
Keepalived是一款基于VRRP协议的高可用集群软件，通过虚拟IP（VIP）对外提供服务，能够实时监控集群中服务器的运行状态并自动进行故障隔离，这些服务器都启动着相同的服务，当主服务器发生故障时，会自动将虚拟IP漂移到备份服务器，从而实现业务高可用。
Docker+Nginx+KeepaLived实现Nginx一主一从高可用
u010797364的博客
02-14 1177
Docker+Nginx+Keepalived实现架构高可用。
docker创建keepalived镜像实现高可用
weixin_60748184的博客
11-01 1235
注：keepalived是通过检测keepalived进程是否存在判断服务器是否宕机，如果keepalived进程在但是nginx进程不在了那么keepalived是不会做主备切换，所以我们需要写个脚本来监控nginx进程是否存在，如果nginx不存在就将keepalived进程杀掉。在主nginx上需要编写nginx进程检测脚本（check_nginx.sh），判断nginx进程是否存在，如果nginx不存在就将keepalived进程杀掉，并将vip漂移到备份机器上。
docker-compose一键搭建 mysql+redis+nginx+keepalived+springboot
qq_41424909的博客
12-13 237
docker-compose一键搭建 mysql+redis+nginx+keepalived+springboot
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值