案例搭建 Mysql-mmm+mysql5.6双主高可用集群

最新推荐文章于 2024-08-27 16:35:35 发布

道不贱卖，法不轻传

最新推荐文章于 2024-08-27 16:35:35 发布

阅读量791

点赞数

分类专栏： mysql

本文链接：https://blog.csdn.net/Richardlygo/article/details/81637604

版权

mysql 专栏收录该内容

23 篇文章 1 订阅

订阅专栏

案例环境：

系统	IP地址	主机名	所需软件
Centos 7.4 1708 64bit	192.168.100.101	master1	mysql-5.6.36.tar.gz mysql-mmm mysql-mmm-agent mysql-tools
Centos 7.4 1708 64bit	192.168.100.102	master2	mysql-5.6.36.tar.gz mysql-mmm mysql-mmm-agent mysql-tools
Centos 7.4 1708 64bit	192.168.100.103	slave1	mysql-5.6.36.tar.gz mysql-mmm mysql-mmm-agent mysql-tools
Centos 7.4 1708 64bit	192.168.100.104	slave2	mysql-5.6.36.tar.gz mysql-mmm mysql-mmm-agent mysql-tools
Centos 7.4 1708 64bit	192.168.100.105	monitor	mysql-5.6.36.tar.gz mysql-mmm mysql-mmm-monitor mysql-tools
Centos 7.4 1708 64bit	192.168.100.106	client	mysql

案例步骤：

部署master1节点的ntp服务以及域名解析；
配置master2、slave1、slave2、monitor节点同步ntp时间及域名解析（在此只列举master2单台主机配置）；
分别在master1、master2、slave1、slave2节点上安装mysql服务（在此只列举master1单台主机配置）；
配置master1实现双主复制；
配置master2实现双主复制；
配置slave1和slave2实现主从复制（在此只列举slave1单台主机配置）；
分别在master1、master2、slave1、slave2四个节点安装mysql-mmm软件程序并且配置agent指定本机的节点名称（在此只列举master1单台主机配置）；
在master1节点上授权monitor节点连接数据库集群；
安装monitor节点上的mysql-mmm软件程序；
配置 monitor节点上的mysql-mmm的配置文件并且复制到各个mysql节点；
启动master1、master2、slave1、slave2四个节点上的mysql-mmm服务（在此只列举master1单台主机配置）；
启动monitor节点上的mysql-mmm服务并查看集群状态；
客户端验证测试读写数据；
将master1主节点的mysql服务停止，测试集群状况；

部署master1节点的ntp服务以及域名解析；

[root@master1 ~]# cat <<END >>/etc/hosts

192.168.100.101 master1

192.168.100.102 master2

192.168.100.103 slave1

192.168.100.104 slave2

192.168.100.105 monitor

END

[root@master1 ~]# yum -y install ntp

[root@master1 ~]# sed -i '/^server/s/^/#/g' /etc/ntp.conf

[root@master1 ~]# cat <<END >>/etc/ntp.conf

server 127.127.1.0

fudge 127.127.1.0 stratum 8

END

[root@master1 ~]# systemctl start ntpd

[root@master1 ~]# systemctl enable ntpd

Created symlink from /etc/systemd/system/multi-user.target.wants/ntpd.service to /usr/lib/systemd/system/ntpd.service.

配置master2、slave1、slave2、monitor节点同步ntp时间及域名解析（在此只列举master2单台主机配置）；

[root@master2 ~]# cat <<END >>/etc/hosts

192.168.100.101 master1

192.168.100.102 master2

192.168.100.103 slave1

192.168.100.104 slave2

192.168.100.105 monitor

END

[root@master2 ~]# yum -y install ntpdate

[root@master2 ~]# /usr/sbin/ntpdate 192.168.100.101

ech 9 Aug 18:04:38 ntpdate[1106]: adjust time server 192.168.100.101 offset 0.299673 sec

[root@master2 ~]# echo "/usr/sbin/ntpdate 192.168.100.101">>/etc/rc.local

[root@master2 ~]# chmod +x /etc/rc.local

分别在master1、master2、slave1、slave2节点上安装mysql服务（在此只列举master1单台主机配置）；

[root@master1 ~]# yum -y install ncurses cmake

[root@master1 ~]# mount /dev/cdrom /mnt/

mount: /dev/sr0 写保护，将以只读方式挂载

[root@master1 ~]# rpm -ivh /mnt/Packages/ncurses-devel-5.9-13.20130511.el7.x86_64.rpm --nodeps

[root@master1 ~]# ls

mysql-5.6.36.tar.gz

[root@master1 ~]# tar zxvf mysql-5.6.36.tar.gz -C /usr/src/

[root@master1 ~]# cd /usr/src/mysql-5.6.36/

[root@master2 mysql-5.6.36]# cmake -DCMAKE_INSTALL_PREFIX=/usr/local/mysql -DDEFAULT_CHARSET=utf8 -DDEFAULT_COLLATION=utf8_general_ci -DWITH_INNOBASE_STORAGE_ENGINE=1 -DWITH_ARCHIVE_STORAGE_ENGINE=1 -DWITH_BLACKHOLE_STORAGE_ENGINE=1 -DENABLE_DOWNLOADS=1

[root@master1 mysql-5.6.36]# make

[root@master1 mysql-5.6.36]# make install

[root@master1 mysql-5.6.36]# cd

[root@master1 ~]# cp /usr/src/mysql-5.6.36/support-files/mysql.server /etc/init.d/

[root@master1 ~]# chmod +x /etc/init.d/mysql.server

[root@master1 ~]# cat <<END >>/usr/lib/systemd/system/mysqld.service

[Unit]

Description=mysqldapi

After=network.target

[Service]

Type=forking

PIDFile=/usr/local/mysql/logs/mysqld.pid

ExecStart=/etc/init.d/mysql.server start

ExecReload=/etc/init.d/mysql.server restart

ExecStop=/etc/init.d/mysql.server stop

PrivateTmp=Flase

[Install]

WantedBy=multi-user.target

END

[root@master1 ~]# echo "export PATH=$PATH:/usr/local/mysql/bin/" >>/etc/profile

[root@master1 ~]# source /etc/profile

[root@master1 ~]# groupadd mysql

[root@master1 ~]# useradd -g mysql mysql

[root@master1 ~]# cat <<END >/etc/my.cnf

[mysqld]

basedir = /usr/local/mysql

datadir = /usr/local/mysql/data

port = 3306

sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES

character_set_server=utf8

init_connect='SET NAMES utf8'

log-error=/usr/local/mysql/logs/mysqld.log

pid-file=/usr/local/mysql/logs/mysqld.pid

skip-name-resolve

END

[root@master1 ~]# mkdir /usr/local/mysql/logs

[root@master1 ~]# chown mysql:mysql /usr/local/mysql/ -R

[root@master1 ~]# /usr/local/mysql/scripts/mysql_install_db --user=mysql --basedir=/usr/local/mysql --datadir=/usr/local/mysql/data ##初始化mysql

[root@master1 ~]# systemctl start mysqld

[root@master1 ~]# systemctl enable mysqld

Created symlink from /etc/systemd/system/multi-user.target.wants/mysqld.service to /usr/lib/systemd/system/mysqld.service.

[root@master1 ~]# netstat -utpln |grep 3306

tcp 0 0 0.0.0.0:3306 0.0.0.0:* LISTEN 31481/mysqld

[root@master1 ~]# mysqladmin -uroot password 123123

Warning: Using a password on the command line interface can be insecure.

[root@master1 ~]# mysql -uroot -p123123

mysql> show databases;

+--------------------+

| Database |

+--------------------+

| information_schema |

| mysql |

| performance_schema |

| test |

+--------------------+

mysql> exit

配置master1实现双主复制；

[root@master1 ~]# cat <<END >>/etc/my.cnf

server-id=1

log-bin=mysql-bin

log-slave-updates

sync_binlog=1

auto_increment_increment=2

auto_increment_offset=1

relay-log=relay1-log-bin

relay-log-index=slave-relay1-bin.index

END

注解：

sync_binlog=1 ##主机每次提交事务的时候把二进制日志的内容同步到磁盘上，所以即使服务器崩溃，也会把时间写入到日志中；

auto_increment_increment=2 ##以下两参数用于主主复制中，用于错开增值，防止键值冲突

[root@master1 ~]# systemctl restart mysqld

[root@master1 ~]# mysql -uroot -p123123

mysql> show master status;

+------------------+----------+--------------+------------------+-------------------+

+------------------+----------+--------------+------------------+-------------------+

| mysql-bin.000001 | 120 | | | |

+------------------+----------+--------------+------------------+-------------------+

mysql> grant replication slave on *.* to 'master'@'192.168.100.%' identified by '123123';

Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;

Query OK, 0 rows affected (0.00 sec)

mysql> exit

[root@master1 ~]# mysql -uroot -p123123

mysql> change master to master_host='192.168.100.102',master_user='master',master_password='123123',master_log_file='mysql-bin.000001',master_log_pos=120;

Query OK, 0 rows affected, 2 warnings (0.01 sec)

mysql> start slave;

Query OK, 0 rows affected (0.00 sec)

mysql> show slave status\G;

*************************** 1. row ***************************

Slave_IO_State: Waiting for master to send event

Master_Host: 192.168.100.102

Master_User: master

Master_Port: 3306

Connect_Retry: 60

Master_Log_File: mysql-bin.000001

Read_Master_Log_Pos: 421

Relay_Log_File: relay1-log-bin.000002

Relay_Log_Pos: 584

Relay_Master_Log_File: mysql-bin.000001

Slave_IO_Running: Yes

Slave_SQL_Running: Yes

配置master2实现双主复制；

[root@master2 ~]# cat <<END >>/etc/my.cnf

server-id=2

log-bin=mysql-bin

log-slave-updates

sync_binlog=1

auto_increment_increment=2

auto_increment_offset=1

relay-log=relay2-log-bin

relay-log-index=slave-relay2-bin.index

END

[root@master2 ~]# systemctl restart mysqld

[root@master2 ~]# mysql -uroot -p123123

mysql> show master status;

+------------------+----------+--------------+------------------+-------------------+

+------------------+----------+--------------+------------------+-------------------+

| mysql-bin.000001 | 120 | | | |

+------------------+----------+--------------+------------------+-------------------+

mysql> grant replication slave on *.* to 'master'@'192.168.100.%' identified by '123123';

Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;

Query OK, 0 rows affected (0.00 sec)

mysql> exit

[root@master2 ~]# mysql -uroot -p123123

mysql> change master to master_host='192.168.100.101',master_user='master',master_password='123123',master_log_file='mysql-bin.000001',master_log_pos=120;

Query OK, 0 rows affected, 2 warnings (0.01 sec)

mysql> start slave;

Query OK, 0 rows affected (0.00 sec)

mysql> show slave status\G;

*************************** 1. row ***************************

Slave_IO_State: Waiting for master to send event

Master_Host: 192.168.100.102

Master_User: master

Master_Port: 3306

Connect_Retry: 60

Master_Log_File: mysql-bin.000001

Read_Master_Log_Pos: 421

Relay_Log_File: relay1-log-bin.000002

Relay_Log_Pos: 584

Relay_Master_Log_File: mysql-bin.000001

Slave_IO_Running: Yes

Slave_SQL_Running: Yes

配置slave1和slave2实现主从复制（在此只列举slave1单台主机配置）；

[root@slave1 ~]# cat <<END >>/etc/my.cnf

server-id=3

relay-log=relay3-log-bin

relay-log-index=slave-relay3-bin.index

END

[root@slave1 ~]# systemctl restart mysqld

[root@slave1 ~]# mysql -uroot -p123123

mysql> change master to master_host='192.168.100.101',master_user='master',master_password='123123',master_log_file='mysql-bin.000001',master_log_pos=120;

Query OK, 0 rows affected, 2 warnings (0.02 sec)

mysql> start slave;

Query OK, 0 rows affected (0.01 sec)

mysql> show slave status\G;

*************************** 1. row ***************************

Slave_IO_State: Waiting for master to send event

Master_Host: 192.168.100.101

Master_User: master

Master_Port: 3306

Connect_Retry: 60

Master_Log_File: mysql-bin.000002

Read_Master_Log_Pos: 421

Relay_Log_File: relay3-log-bin.000003

Relay_Log_Pos: 584

Relay_Master_Log_File: mysql-bin.000002

Slave_IO_Running: Yes

Slave_SQL_Running: Yes

[root@master1 ~]# mysql -uroot -p123123

mysql> create database linuxfan;

Query OK, 1 row affected (0.00 sec)

mysql> show databases;

+--------------------+

| Database |

+--------------------+

| information_schema |

| linuxfan |

| mysql |

| performance_schema |

| test |

+--------------------+

mysql> exit

[root@master2 ~]# mysql -uroot -p123123

mysql> show databases;

+--------------------+

| Database |

+--------------------+

| information_schema |

| linuxfan |

| mysql |

| performance_schema |

| test |

+--------------------+

mysql> exit

[root@slave1 ~]# mysql -uroot -p123123

mysql> show databases;

+--------------------+

| Database |

+--------------------+

| information_schema |

| linuxfan |

| mysql |

| performance_schema |

| test |

+--------------------+

mysql> exit

分别在master1、master2、slave1、slave2四个节点安装mysql-mmm软件程序并且配置agent指定本机的节点名称（在此只列举master1单台主机配置）；

[root@master1 ~]# wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo

[root@master1 ~]# yum -y install epel-release

[root@master1 ~]# yum -y install mysql-mmm mysql-mmm-agent mysql-mmm-tools

[root@master1 ~]# vi /etc/mysql-mmm/mmm_agent.conf

include mmm_common.conf

# The 'this' variable refers to this server. Proper operation requires

# that 'this' server (db1 by default), as well as all other servers, have the

# proper IP addresses set in mmm_common.conf.

this db1

:wq

在master1节点上授权monitor节点连接数据库集群；

[root@master1 ~]# mysql -uroot -p123123

mysql> grant replication client on *.* to 'mmm_monitor'@'192.168.100.%' identified by 'monitor';

Query OK, 0 rows affected (0.00 sec)

mysql> grant super,replication client,process on *.* to 'mmm_agent'@'192.168.100.%' identified by 'agent';

Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;

Query OK, 0 rows affected (0.00 sec)

mysql> exit

权限注解：

replication client：权限用于执行show master status等命令。这些命令是用来查看复制状态的；

replication slave：是用于连接主库从库进行读取二进制文件进而实现复制的；

super：杀死mysql中连接的进程，设置全局变量，重置主从配置的权限；
process：具有查看当前运行的sql的权限，以及explain执行计划；

安装monitor节点上的mysql-mmm软件程序；

[root@monitor ~]# wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo

[root@monitor ~]# yum -y install epel-release

[root@monitor ~]# yum -y install mysql-mmm mysql-mmm-tools mysql-mmm-monitor

配置 monitor节点上的mysql-mmm的配置文件并且复制到各个mysql节点；

[root@monitor ~]# vi /etc/mysql-mmm/mmm_common.conf

active_master_role writer ##指定活跃角色为写角色

cluster_interface eth0 ##承载的网卡

pid_path /var/run/mysql-mmm/mmm_agentd.pid

bin_path /usr/libexec/mysql-mmm/ ##可执行文件路径

replication_user master ##mysql集群主从复制账户

replication_password 123123

agent_user mmm_agent ##monitor连接集群的账户

agent_password agent

</host>

ip 192.168.100.101

mode master

peer db2 ##指定对立的节点名

</host>

ip 192.168.100.102

mode master

peer db1

</host>

ip 192.168.100.103

mode slave

</host>

ip 192.168.100.104

mode slave

</host>

hosts db1, db2

ips 192.168.100.250

mode exclusive ##同一时间存在单个主

</role>

hosts db3, db4

ips 192.168.100.251,192.168.100.252

mode balanced ##轮询

</role>

[root@monitor ~]# vi /etc/mysql-mmm/mmm_mon.conf

include mmm_common.conf

ip 127.0.0.1

pid_path /var/run/mysql-mmm/mmm_mond.pid

bin_path /usr/libexec/mysql-mmm

status_path /var/lib/mysql-mmm/mmm_mond.status

ping_ips 192.168.100.101, 192.168.100.102, 192.168.100.103, 192.168.100.104 ##指定监听的所有节点ip

auto_set_online 60 ##判定其online的时间，超过60s认为其down

</monitor>

monitor_user mmm_monitor ##monitor的工作用户

monitor_password monitor

</host>

debug 0

[root@monitor ~]# for i in 101 102 103 104;do scp /etc/mysql-mmm/mmm_common.conf root@192.168.100.$i:/etc/mysql-mmm/; done ##将配置文件复制到mysql节点

启动master1、master2、slave1、slave2四个节点上的mysql-mmm服务（在此只列举master1单台主机配置）；

[root@master1 ~]# mkdir /var/run/mysql-mmm

[root@master1 ~]# vi /usr/lib/systemd/system/mysql-mmm-agent.service

7 PIDFile=/var/run/mysql-mmm/mmm_agentd.pid

[root@master1 ~]# systemctl daemon-reload

[root@master1 ~]# systemctl start mysql-mmm-agent

[root@master1 ~]# netstat -utpln |grep mmm

tcp 0 0 192.168.100.101:9989 0.0.0.0:* LISTEN 32670/mmm_agentd

启动monitor节点上的mysql-mmm服务并查看集群状态；

[root@monitor ~]# mkdir /var/run/mysql-mmm

[root@monitor ~]# vi /usr/lib/systemd/system/mysql-mmm-monitor.service

7 PIDFile=/var/run/mysql-mmm/mmm_mond.pid

[root@monitor ~]# systemctl daemon-reload

[root@monitor ~]# systemctl start mysql-mmm-monitor

[root@monitor ~]# netstat -utpln |grep mmm

tcp 0 0 127.0.0.1:9988 0.0.0.0:* LISTEN 15266/mmm_mond

[root@monitor ~]# mmm_control show

# Warning: agent on host db4 is not reachable

db1(192.168.100.101) master/ONLINE. Roles: writer(192.168.100.250)

db2(192.168.100.102) master/ONLINE. Roles:

db3(192.168.100.103) slave/ONLINE. Roles: reader(192.168.100.251) reader(192.168.100.252)

db4(192.168.100.104) slave/ONLINE. Roles:

客户端验证测试读写数据；

[root@master1 ~]# mysql -uroot -p123123

mysql> grant all on *.* to 'client'@'192.168.100.%' identified by '123123';

Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;

Query OK, 0 rows affected (0.00 sec)

mysql> exit

[root@client ~]# yum -y install mysql

[root@client ~]# mysql -uclient -p123123 -h192.168.100.250

MySQL [(none)]> show databases;

+--------------------+

| Database |

+--------------------+

| information_schema |

| linuxfan |

| mysql |

| performance_schema |

| test |

+--------------------+

5 rows in set (0.00 sec)

MySQL [(none)]> exit

[root@client ~]# mysql -uclient -p123123 -h192.168.100.251

MySQL [(none)]> show databases;

+--------------------+

| Database |

+--------------------+

| information_schema |

| linuxfan |

| mysql |

| performance_schema |

| test |

+--------------------+

MySQL [(none)]> exit

将master1主节点的mysql服务停止，测试集群状况；

[root@master1 ~]# systemctl stop mysqld

[root@monitor ~]# mmm_control show

# Warning: agent on host db4 is not reachable

db1(192.168.100.101) master/HARD_OFFLINE. Roles:

db2(192.168.100.102) master/ONLINE. Roles: writer(192.168.100.250)

db3(192.168.100.103) slave/ONLINE. Roles: reader(192.168.100.251)

db4(192.168.100.104) slave/ONLINE. Roles:

注解：

ONLINE. Roles表示在线节点；

HARD_OFFLINE表示ping不通并且(或者)mysql连接中断,会导致hard_offline状态；

admin_offline是手动下线的状态；

[root@monitor ~]# tail /var/log/mysql-mmm/mmm_mond.log

2018/08/10 07:44:37 FATAL State of host 'db1' changed from AWAITING_RECOVERY to ONLINE because of auto_set_online(60 seconds). It was in state AWAITING_RECOVERY for 61 seconds

2018/08/10 07:44:37 FATAL Agent on host 'db1' is reachable again

2018/08/10 07:50:28 FATAL Agent on host 'db1' is reachable again

2018/08/10 08:04:00 FATAL State of host 'db1' changed from ONLINE to HARD_OFFLINE (ping: OK, mysql: not OK)

[root@client ~]# mysql -uroot -p123123 192.168.100.250

MySQL [(none)]> show databases;

+--------------------+

| Database |

+--------------------+

| information_schema |

| linuxfan |

| mysql |

| performance_schema |