一、工作原理
MHA
MHA是一款专为MySQL设计的开源高可用解决方案,主要用于实现MySQL数据库的故障转移和主从复制管理,从而提高数据库服务的可靠性与可用性。
MHA集群原理
MHA Manager(管理节点)和MHA Node(数据节点)。在主从复制的MySQL集群中,MHA Manager负责监控主节点的健康状况,当主节点出现故障时,MHA Manager会自动选举出一个从节点升级为主节点,并协调其余从节点重新连接至新的主节点,实现无缝的故障转移。
二、环境准备
IP | 主机名 | 角色 | OS |
192.168.252.147 | mysql-master | mysql master、MHA manager、MHA node | Centos7 |
192.168.252.148 | mysql-slave1 | mysql slave1、MHA node | Centos7 |
192.168.252.149 | mysql-slave2 | mysql slave2、MHA node | Centos7 |
配置hosts
vim /etc/hosts
192.168.252.147 mysql-master
192.168.252.148 mysql-slave1
192.168.252.149 mysql-slave2
关闭防火墙和内核防火墙
systemctl stop firewalld
systemctl disabled firewalld
sed -i 's/SELINUX=enforcing/SELINUX=disabled/' /etc/selinux/config
关闭swap
swapoff -a 临时关闭
配置相互通信
全部主机
ssh-keygen
ssh-copy-id 192.168.252.147
ssh-copy-id 192.168.252.148
ssh-copy-id 192.168.252.149
三、MySQL主从复制
master节点
vim /etc/my.cnf
[mysqld]
server-id=1
log-bin=mysql-bin
binlog_format=mixed
log-slave-updates=true
slave1节点
vim /etc/my.cnf
[mysqld]
server-id=2
log_bin=mysql-bin
relay-log=relay-log-bin
relay-log-index=slave-relay-bin.index
slave2节点
[mysqld]
server-id=3
log_bin=mysql-bin
relay-log=relay-log-bin
relay-log-index=slave-relay-bin.index
一主两从
所有主机节点都添加:
mysql> grant replication slave on *.* to 'slave'@'192.168.252.%' identified by '@Syh2025659';
mysql> grant all on *.* to 'mha'@'192.168.252.%' identified by '@Syh2025659';
mysql> grant all on *.* to 'mha'@'%' identified by '@Syh2025659';
mysql> flush privileges;
从节点:
mysql> change master to
master_host='192.168.252.147',
master_user='slave',
master_password='@Syh2025659',
master_log_file='[master的binlog日志]',
master_log_pos=[位置];
从库设置为只读模式
mysql> set global read_only=1;
mysql> show global variables like 'read_only';
mysql> \q
三、安装MHA
准备(所有节点)
1.创建目录
mkdir -p /opt/mysql-mha
cd /opt/mysql-mha
2.安装node
yum install perl-DBD-MySQL -y
wget https://github.com/yoshinorim/mha4mysql-node/releases/download/v0.58/mha4mysql-node-0.58-0.el7.centos.noarch.rpm
yum install -y mha4mysql-node-0.58-0.el7.centos.noarch.rpm
安装manager
安装依赖:
yum -y install epel-release
yum -y install perl-Config-Tiny perl-Time-HiRes perl-Parallel-ForkManager perl-Log-Dispatch perl-DBD-MySQL ncftp
安装manager:
wget https://github.com/yoshinorim/mha4mysql-manager/releases/download/v0.58/mha4mysql-manager-0.58-0.el7.centos.noarch.rpm
rpm -ivh mha4mysql-manager-0.58-0.el7.centos.noarch.rpm
编写脚本
vim /opt/mysql-mha/master_ip_failover
#!/usr/bin/env perl
use strict;
use warnings FATAL => 'all';
use Getopt::Long;
my (
$command, $orig_master_host, $orig_master_ip,$ssh_user,
$orig_master_port, $new_master_host, $new_master_ip,$new_master_port,
$orig_master_ssh_port,$new_master_ssh_port,$new_master_user,$new_master_password
);
# 这里定义的虚拟IP配置要注意,这个ip必须要与你自己的集群在同一个网段,否则无效
my $vip = '192.168.252.200/24';
my $key = '1';
# 这里的网卡名称 “ens33” 需要根据你机器的网卡名称进行修改
# 如果多台机器直接的网卡名称不统一,有两种方式,一个是改脚本,二是把网卡名称修改成统一
# 我这边实际情况是修改成统一的网卡名称
my $ssh_start_vip = "sudo /sbin/ifconfig ens33:$key $vip";
my $ssh_stop_vip = "sudo /sbin/ifconfig ens33:$key down";
my $ssh_Bcast_arp= "sudo /sbin/arping -I bond0 -c 3 -A $vip";
GetOptions(
'command=s' => \$command,
'ssh_user=s' => \$ssh_user,
'orig_master_host=s' => \$orig_master_host,
'orig_master_ip=s' => \$orig_master_ip,
'orig_master_port=i' => \$orig_master_port,
'orig_master_ssh_port=i' => \$orig_master_ssh_port,
'new_master_host=s' => \$new_master_host,
'new_master_ip=s' => \$new_master_ip,
'new_master_port=i' => \$new_master_port,
'new_master_ssh_port' => \$new_master_ssh_port,
'new_master_user' => \$new_master_user,
'new_master_password' => \$new_master_password
);
exit &main();
sub main {
$ssh_user = defined $ssh_user ? $ssh_user : 'root';
print "\n\nIN SCRIPT TEST====$ssh_user|$ssh_stop_vip==$ssh_user|$ssh_start_vip===\n\n";
if ( $command eq "stop" || $command eq "stopssh" ) {
my $exit_code = 1;
eval {
print "Disabling the VIP on old master: $orig_master_host \n";
&stop_vip();
$exit_code = 0;
};
if ($@) {
warn "Got Error: $@\n";
exit $exit_code;
}
exit $exit_code;
}
elsif ( $command eq "start" ) {
my $exit_code = 10;
eval {
print "Enabling the VIP - $vip on the new master - $new_master_host \n";
&start_vip();
&start_arp();
$exit_code = 0;
};
if ($@) {
warn $@;
exit $exit_code;
}
exit $exit_code;
}
elsif ( $command eq "status" ) {
print "Checking the Status of the script.. OK \n";
exit 0;
}
else {
&usage();
exit 1;
}
}
sub start_vip() {
`ssh $ssh_user\@$new_master_host \" $ssh_start_vip \"`;
}
sub stop_vip() {
`ssh $ssh_user\@$orig_master_host \" $ssh_stop_vip \"`;
}
sub start_arp() {
`ssh $ssh_user\@$new_master_host \" $ssh_Bcast_arp \"`;
}
sub usage {
print
"Usage: master_ip_failover --command=start|stop|stopssh|status --ssh_user=user --orig_master_host=host --orig_master_ip=ip --orig_master_port=port --new_master_host=host --new_master_ip=ip --new_master_port=port\n";
}
添加执行权限:
chmod a+x /opt/mysql-mha/master_ip_failover
编写配置文件
vim /opt/mysql-mha/mysql_mha.cnf
文件内容:
[server default]
#mha访问数据库的账号与密码
user=mha
password=@Syh2025659
port=3306
#指定mha的工作目录
manager_workdir=/opt/mysql-mha/mha
#指定管理日志路径
manager_log=/opt/mysql-mha/manager.log
#指定master节点存放binlog的日志文件的目录 log_bin=mysql_bin默认是在/var/lib/mysql
master_binlog_dir=/var/lib/mysql
#指定mha在远程节点上的工作目录
remote_workdir=/opt/mysql-mha/mha-node
#指定主从复制的mysq用户和密码
repl_user=slave
repl_password=@Syh2025659
#指定检测间隔时间
ping_interval=1
#指定一个脚本,该脚本实现了在主从切换之后,将虚拟ip漂移到新的master上
master_ip_failover_script=/opt/mysql-mha/master_ip_failover
#指定检查的从服务器IP地址.有几个,就用-s选项加几个
secondary_check_script=/usr/bin/masterha_secondary_check -s 192.168.252.148 -s 192.168.252.149
#用于故障切换的时候发送邮件提醒
#report_script=/data1/mysql-mha/send_mail
[server1]
hostname=192.168.252.147
port=3306
ssh_user=root
candidate_master=1
check_repl_delay=0
[server2]
hostname=192.168.252.148
port=3306
ssh_user=root
candidate_master=1
check_repl_delay=0
[server3]
hostname=192.168.252.149
port=3306
ssh_user=root
candidate_master=1
check_repl_delay=0
启用虚拟ip并测试ssh无密连接
配置虚拟节点要与master_ip_faioverl配置文件中的虚拟ip一致
文件中:
my $vip = '192.168.252.200/24';
my $key = '1';
配置虚拟ip
/sbin/ifconfig ens33:1 192.168.252.200/24
测试:
masterha_check_ssh -conf=/opt/mysql-mha/mysql_mha.cnf 测试ssh无密码连接情况
masterha_check_repl -conf=/opt/mysql-mha/mysql_mha.cnf 测试主从情况
启动和查看状态
nohup masterha_manager \
--conf=/opt/mysql-mha/mysql_mha.cnf \
--remove_dead_master_conf \
--ignore_last_failover < /dev/null > /var/log/mha_manager.log 2>&1 &
masterha_check_status --conf=/opt/mysql-mha/mysql_mha.cnf 查看服务
masterha_stop --conf=/opt/mysql-mha/mysql_mha.cnf 关闭服务
tips:
--remove_dead_master_conf:该参数代表当发生主从切换后,老的主库的 ip 将会从配置文件中移除。
--manger_log:日志存放位置。
--ignore_last_failover 在缺省情况下,如果 MHA 检测到连续发生宕机,且两次宕机间隔不足 8 小时的话,则不会进行 Failover, 之所以这样限制是为了避免 ping-pong 效应。该参数代表忽略上次 MHA 触发切换产生的文件,默认情况下,MHA 发生切换后会在日志记目录,也就是上面设置的日志app1.failover.complete文件,下次再次切换的时候如果发现该目录下存在该文件将不允许触发切换,除非在第一次切换后收到删除该文件,为了方便,这里设置为--ignore_last_failover。
cat /opt/mysql-mha/manager.log | grep "current master" 查看日志
四、测试和恢复
1.停掉主节点的mysql服务
master:
systemctl stop mysqld
2.查看哪一个节点能成为新的主节点
slave:
show master status \G
show slave
3.恢复故障
master:
change master to
master_host='[新节点ip]',
master_user='slave',
master_password='@Syh2025659',
master_log_file='[新master的binlog日志]',
master_log_pos=[新位置];