MySQL高可用架构之MHA&&ProxySQL搭建

一、搭建背景

1.平台

centos7
VMvare
Xshell

2.软件

mysql5.7.26
MHA
ProxySQL

3.节点设计

	IP		    主机名		安装软件
192.168.0.51	db01	mysql5.7、mha-node
192.168.0.52	db02	mysql5.7、mha-node
192.168.0.53	db03	mysql5.7、mha-node、mha-manager、ProxySQSL
注：db01（主）、db02(从)、db03（从）

二、主从搭建

1.快速搭建基础环境和数据库

自行配置host文件和ip地址。
需要网络安装依赖包，具体搭建数据库如下的链接：
https://blog.csdn.net/qq_41405678/article/details/109702872

2.修改内容

A.修改db01配置文件为：

[root@db01 ~]# vim /data//mysql/3306/my.cnf
[mysqld]
user=mysql
basedir=/application/mysql
datadir=/data/mysql/3306
server_id=16
log-error=/data/mysql/3306/log.err
log_bin=/data/mysql/3306/binlog/mysql-bin
secure-file-priv=/tmp
binlog_format=row
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
port=3306
socket=/tmp/mysql3306.sock
[mysql]
prompt=db01 [\\d]>

B.修改db02配置文件为：

[root@db02 ~]# vim /data//mysql/3306/my.cnf
[mysqld]
user=mysql
basedir=/application/mysql
datadir=/data/mysql/3306
server_id=26
log-error=/data/mysql/3306/log.err
log_bin=/data/mysql/3306/binlog/mysql-bin
secure-file-priv=/tmp
binlog_format=row
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
port=3306
socket=/tmp/mysql3306.sock
[mysql]
prompt=db02 [\\d]>

C.修改db03配置文件为：

[root@db03 ~]# vim /data//mysql/3306/my.cnf
[mysqld]
user=mysql
basedir=/application/mysql
datadir=/data/mysql/3306
server_id=36
log-error=/data/mysql/3306/log.err
log_bin=/data/mysql/3306/binlog/mysql-bin
secure-file-priv=/tmp
binlog_format=row
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
port=3306
socket=/tmp/mysql3306.sock
[mysql]
prompt=db02 [\\d]>

3.重启

[root@db01 ~]# systemctl restart mysqld3306.service
[root@db02 ~]# systemctl restart mysqld3306.service
[root@db03 ~]# systemctl restart mysqld3306.service

4.构建主从

A.主库创建复制账号

[root@db01 ~]# mysql -S /tmp/mysql3306.sock
mysql> grant replication slave on *.* to repl@'192.168.0.%' identified by '123'; 
mysql> select user,host from mysql.user;

B.db02开启复制，db03同理。

[root@db02 ~]# mysql -S /tmp/mysql3306.sock
mysql> CHANGE MASTER TO 
  MASTER_HOST='192.168.0.51',
  MASTER_USER='repl', 
  MASTER_PASSWORD='123', 
  MASTER_PORT=3306, 
  MASTER_AUTO_POSITION=1;
mysql> start slave;
mysql> show slave status \G;
             Slave_IO_Running: Yes
            Slave_SQL_Running: Yes

三、MHA搭建

1.配置互信

[root@db01 ~] rm -rf /root/.ssh 
[root@db01 ~] ssh-keygen
[root@db01 ~] cd /root/.ssh 
[root@db01 ~] mv id_rsa.pub authorized_keys
[root@db01 ~] scp  -r  /root/.ssh  192.168.0.53:/root  
[root@db01 ~] scp  -r  /root/.ssh  192.168.0.53:/root 
各节点验证：
db01:
[root@db01 ~] ssh 192.168.0.51 date
[root@db01 ~] ssh 192.168.0.52 date
[root@db01 ~] ssh 192.168.0.53 date
db02:
[root@db02 ~] ssh 192.168.0.51 date
[root@db02 ~] ssh 192.168.0.52 date
[root@db02 ~] ssh 192.168.0.53 date
db03:
[root@db03 ~] ssh 192.168.0.51 date
[root@db03 ~] ssh 192.168.0.52 date
[root@db03 ~] ssh 192.168.0.53 date

2.安装软件

A.所有节点安装依赖：

yum install perl-DBD-MySQL

B.db03安装依赖：

   yum install -y epel-release  
   yum install perl-Config-Tiny
   yum install perl-Parallel-ForkManager
   yum install perl-Log-Dispatch

C.安装node软件在db01、db02、db3

rpm -ivh mha4mysql-node-0.58-0.el7.centos.noarch.rpm

D.安装manager软件在db03

yum localinstall -y mha4mysql-manager-0.58-0.el7.centos.noarch.rpm

3.配置文件（db03）

[root@db03 ~]# mkdir -p /etc/mha
[root@db03 ~]# mkdir -p /var/log/mha/app1
[root@db03 ~]# vi /etc/mha/app1.cnf
[server default]
manager_log=/var/log/mha/app1/manager.log
manager_workdir=/var/log/mha/app1
master_binlog_dir=/data/mysql/3306/binlog/
password=mha
ping_interval=2
repl_password=123
repl_user=repl
ssh_user=root
user=mha

[server1]
hostname=192.168.0.51
port=3306

[server2]
hostname=192.168.0.52
port=3306

[server3]
hostname=192.168.0.53
no_master=1
port=3306

4.db01上配置mha用户

mysql> grant all privileges on *.* to mha@'192.168.0.%' identified by 'mha'; 
mysql> select user,host from mysql.user;

5.启动MHA-manager

互信检查：
[root@db03 ~] masterha_check_ssh  --conf=/etc/mha/app1.cnf
主从检查：
[root@db03 ~] masterha_check_repl  --conf=/etc/mha/app1.cnf
开启MHA：
[root@db03 ~] nohup masterha_manager --conf=/etc/mha/app1.cnf --remove_dead_master_conf --ignore_last_failover < /dev/null > /var/log/mha/app1/manager.log 2>&1 &
测试MHA
[root@db03 ~] mysql -umha -pmha -h 192.168.0.51 -e "show variables like 'server_id'

6.配置failover文件

A.创建 master_ip_failover 文件

[root@db03 ~] vim /usr/local/bin/master_ip_failover
#!/usr/bin/env perl

use strict;
use warnings FATAL => 'all';

use Getopt::Long;

my (
    $command,          $ssh_user,        $orig_master_host, $orig_master_ip,
    $orig_master_port, $new_master_host, $new_master_ip,    $new_master_port
);

my $vip = '192.168.0.55/24';
my $key = '1';
my $ssh_start_vip = "/sbin/ifconfig ens33:$key $vip";
my $ssh_stop_vip = "/sbin/ifconfig ens33:$key down";
my $ssh_Bcast_arp= "/sbin/arping -I ens33 -c 3 -A 192.168.0.55";
GetOptions(
    'command=s'          => \$command,
    'ssh_user=s'         => \$ssh_user,
    'orig_master_host=s' => \$orig_master_host,
    'orig_master_ip=s'   => \$orig_master_ip,
    'orig_master_port=i' => \$orig_master_port,
    'new_master_host=s'  => \$new_master_host,
    'new_master_ip=s'    => \$new_master_ip,
    'new_master_port=i'  => \$new_master_port,
);

exit &main();

sub main {

    print "\n\nIN SCRIPT TEST====$ssh_stop_vip==$ssh_start_vip===\n\n";

    if ( $command eq "stop" || $command eq "stopssh" ) {

        my $exit_code = 1;
        eval {
            print "Disabling the VIP on old master: $orig_master_host \n";
            &stop_vip();
            $exit_code = 0;
        };
        if ($@) {
            warn "Got Error: $@\n";
            exit $exit_code;
        }
        exit $exit_code;
    }
    elsif ( $command eq "start" ) {
        eval {
            print "Enabling the VIP - $vip on the new master - $new_master_host \n";
            &start_vip();
            $exit_code = 0;
        };
        if ($@) {
            warn $@;
            exit $exit_code;
        }
        exit $exit_code;
    }
    elsif ( $command eq "status" ) {
        print "Checking the Status of the script.. OK \n";
        exit 0;
    }
    else {
        &usage();
        exit 1;
    }
}

sub start_vip() {
    `ssh $ssh_user\@$new_master_host \" $ssh_start_vip \"`;
}
sub stop_vip() {
     return 0  unless  ($ssh_user);
    `ssh $ssh_user\@$orig_master_host \" $ssh_stop_vip \"`;
}

sub usage {
    print
    "Usage: master_ip_failover --command=start|stop|stopssh|status --orig_master_host=host --orig_master_ip=ip --orig_master_port=port --new_master_host=host --new_master_ip=ip --new_master_port=port\n";
}

B.在MHA配置文件中加入参数

[root@db03 ~]# vi /etc/mha/app1.cnf
master_ip_failover_script=/usr/local/bin/master_ip_failover

C.db01上加入VIP

[root@db01 ~]# ifconfig ens33:1 192.168.0.55/24

7.配置自动切换邮件发送

A.创建配置脚本

#!/usr/bin/perl
#  Copyright (C) 2011 DeNA Co.,Ltd.
#
#  This program is free software; you can redistribute it and/or modify
#  it under the terms of the GNU General Public License as published by
#  the Free Software Foundation; either version 2 of the License, or
#  (at your option) any later version.
#
#  This program is distributed in the hope that it will be useful,
#  but WITHOUT ANY WARRANTY; without even the implied warranty of
#  MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
#  GNU General Public License for more details.
#
#  You should have received a copy of the GNU General Public License
#   along with this program; if not, write to the Free Software
#  Foundation, Inc.,
#  51 Franklin Street, Fifth Floor, Boston, MA  02110-1301  USA

## Note: This is a sample script and is not complete. Modify the script based on your environment.

use strict;
use warnings FATAL => 'all';
use Mail::Sender;
use Getopt::Long;

#new_master_host and new_slave_hosts are set only when recovering master succeeded
my ( $dead_master_host, $new_master_host, $new_slave_hosts, $subject, $body );
my $smtp='smtp.qq.com';
my $mail_from='';
my $mail_user='';
my $mail_pass='';
#my $mail_to=['to1@qq.com','to2@qq.com'];
my $mail_to='';

GetOptions(
  'orig_master_host=s' => \$dead_master_host,
  'new_master_host=s'  => \$new_master_host,
  'new_slave_hosts=s'  => \$new_slave_hosts,
  'subject=s'          => \$subject,
  'body=s'             => \$body,
);

# Do whatever you want here
mailToContacts($smtp,$mail_from,$mail_user,$mail_pass,$mail_to,$subject,$body);

sub mailToContacts {
        my ($smtp, $mail_from, $mail_user, $mail_pass, $mail_to, $subject, $msg ) = @_;
        open my $DEBUG, ">/tmp/mail.log"
                or die "Can't open the debug    file:$!\n";
        my $sender = new Mail::Sender {
                ctype           => 'text/plain;charset=utf-8',
                encoding        => 'utf-8',
                smtp            => $smtp,
                from            => $mail_from,
                auth            => 'LOGIN',
                TLS_allowed     => '0',
                authid          => $mail_user,
                authpwd         => $mail_pass,
                to              => $mail_to,
                subject         => $subject,
                debug           => $DEBUG
        };
        $sender->MailMsg(
                {
                        msg => $msg,
                        debug => $DEBUG
                }
        ) or print $Mail::Sender::Error;
        return 1;
}

exit 0;

注意：

my $mail_from=''; //发送邮箱全地址
my $mail_user='';//发送名
my $mail_pass='';//邮箱校验码，可以百度
#my $mail_to=['to1@qq.com','to2@qq.com'];
my $mail_to='';//接收方的邮箱

B.参数加入MHA的配置文件

[root@db03 ~]# vi /etc/mha/app1.cnf
report_script=/usr/local/bin/send_report

8、重启MHA、配置完成

[root@db03 ~]# masterha_stop --conf=/etc/mha/app1.cnf 
[root@db03 ~]# nohup masterha_manager --conf=/etc/mha/app1.cnf --remove_dead_master_conf --ignore_last_failover < /dev/null > /var/log/mha/app1/manager.log 2>&1 &

四、ProxySQL 搭建

1.安装proxySQL（db03）

[root@db03 ~]# rpm -ivh proxysql-2.0.10-1-centos7.x86_64.rpm 
[root@db03 ~]# systemctl start proxysql
[root@db03 ~]# netstat -tulnp
tcp        0      0 0.0.0.0:6032            0.0.0.0:*               LISTEN      2115/proxysql       
tcp        0      0 0.0.0.0:6033            0.0.0.0:*               LISTEN      2115/proxysql    
[root@db03 ~]# mysql -uadmin -padmin -h127.0.0.1 -P6032

2.配置读写分离

A.配置读写组编号

mysql> insert into mysql_replication_hostgroups (writer_hostgroup, reader_hostgroup, comment) values (10,20,'proxy');
mysql> load mysql servers to runtime;
mysql> save mysql servers to disk;
mysql> select * from mysql_replication_hostgroups\G
*************************** 1. row ***************************
writer_hostgroup: 10
reader_hostgroup: 20
      check_type: read_only
         comment: proxy

B.添加主机到ProxySQL

mysql> insert into mysql_servers(hostgroup_id,hostname,port) values (10,'192.168.0.51',3306);
mysql> insert into mysql_servers(hostgroup_id,hostname,port) values (20,'192.168.0.52',3306);
mysql> insert into mysql_servers(hostgroup_id,hostname,port) values (20,'192.168.0.53',3306);
mysql> load mysql servers to runtime;
mysql> save mysql servers to disk;

3.创建监控用户，并开启监控

A.主库创建监控用户和应用用户(db01)

mysql> grant replication client on *.* to monitor@'192.168.0.%' identified by '123'; 
mysql> grant replication client on *.* to root@'%' identified by '123';
mysql> select user,host from mysql.user;

B proxySQL修改variables表和加入配置用户(db03)

mysql> set mysql-monitor_username='monitor';
mysql> set mysql-monitor_password='123';
mysql> load mysql variables to runtime;
mysql> save mysql variables to disk;

mysql> insert into mysql_users(username,password,default_hostgroup) values('root','123',10);
mysql> load mysql users to runtime;
mysql> save mysql users to disk;

4.开启事务持续化（db03）

mysql> update mysql_users set transaction_persistent=1 where username='root';
mysql> load mysql users to runtime;
mysql> save mysql users to disk;

5.配置读写规则，测试读写分离

A.配置读写规则

mysql> insert into mysql_query_rules(rule_id,active,match_pattern,destination_hostgroup,apply) values (1,1,'^select.*for update$',10,1);
mysql> insert into mysql_query_rules(rule_id,active,match_pattern,destination_hostgroup,apply) values (2,1,'^select',20,1);
mysql> load mysql query rules to runtime;
mysql> save mysql query rules to disk;

B.测试读写分离

[root@db03 ~]#  mysql -uroot -p123  -P 6033 -h 127.0.0.1 -e "begin;select @@server_id;commit"
[root@db03 ~]#  mysql -uroot -p123  -P 6033 -h 127.0.0.1 -e "select @@server_id;"