利用伪装master快速恢复数据
情景:
客户不小心 drop database,利用当天的备份快速进行恢复
环境:
版本:Ver 14.14 Distrib 5.7.20, for linux-glibc2.12 (x86_64) using EditLine wrapper
91:3306 --主库
91:3307 --伪装master
92:3306 --连接到伪装master,恢复主库到为出错之前复现步骤:
- 在91上初始化mysql实例(略)
- 造数据
- 备份数据库
- 模拟事务,对每张表进行checksum
- drop database;
- 拉起伪装master实例
- 初始化从库(92:3306),配置复制参数,启动复制功能
- 检查数据
注意事项:
- 利用mysqldump备份时要加上–master-data=2和–single-transaction参数。
- 从库需要根据备份设置gtid_purged,否则一经执行过的语句还会重放一次。
- start slave sql_thread时要注意gtid的位置。
-
初始化实例(略)
-
造数据,模拟事务
mysqlslap -S /tmp/mysql3306.sock -uroot -a --no-drop -uroot --auto-generate-sql-execute-number=10000
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"create table test1(id int primary key auto_increment,name varchar(10))"
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"insert into test1(name) select 'Jerry'"
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"insert into test1(name) select 'Grace'"
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"insert into test1(name) select 'Andy'"
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"insert into test1(name) select 'Shelly'"
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"insert into test1(name) select 'Bruce'"
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"insert into test1(name) select 'Diana'"
- 备份数据库
mysqldump -S /tmp/mysql3306.sock -uroot -A --master-data=2 --single-transaction > 91_3306.sql
- 模拟事务,对没张表进行check sum
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"create table test2(id int primary key auto_increment,deptno int,deptname varchar(20))"
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"insert into test2(deptno,deptname) values (10,'Fanace'),(20,'HR'),(30,'Sales'),(40,'IT Support')"
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"checksum table t1"
+--------------+------------+
| Table | Checksum |
+--------------+------------+
| mysqlslap.t1 | 4193919349 |
+--------------+------------+
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"checksum table test1"
+-----------------+-----------+
| Table | Checksum |
+-----------------+-----------+
| mysqlslap.test1 | 900485638 |
+-----------------+-----------+
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"checksum table test2"
+-----------------+-----------+
| Table | Checksum |
+-----------------+-----------+
| mysqlslap.test2 | 147003289 |
+-----------------+-----------+
- 客户不小心drop database
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"drop database mysqlslap"
- 拉起伪装master(91:3307),初始化之后把root密码改为空
拷贝原来主库的所有bin log到3307实例的logs目录下,构建新的mysql-bin.index
cp /data/mysql/mysql3306/logs/mysql-bin.* /data/mysql/mysql3307/logs/
sed -i 's/3306/3307/g' mysql-bin.index
cat mysql-bin.index
/data/mysql/mysql3307/logs/mysql-bin.000001
/data/mysql/mysql3307/logs/mysql-bin.000002
/data/mysql/mysql3307/logs/mysql-bin.000003
/data/mysql/mysql3307/logs/mysql-bin.000004
/data/mysql/mysql3307/logs/mysql-bin.000005
/data/mysql/mysql3307/logs/mysql-bin.000006
–查看91:3307数据库的binary log.说明master已经伪装成功
mysql -S /tmp/mysql3307.sock -uroot -e"show binary logs"
+------------------+-----------+
| Log_name | File_size |
+------------------+-----------+
| mysql-bin.000001 | 177 |
| mysql-bin.000002 | 831 |
| mysql-bin.000003 | 3082 |
| mysql-bin.000004 | 241 |
| mysql-bin.000005 | 2295145 |
| mysql-bin.000006 | 194 |
+------------------+-----------+
找到drop database 的gtid
- 利用第三部的备份初始化数据库(略) 92:3306,配置复制
7.1 设置从库gtid_purged
在备份文件中找到备份开始时的gtid信息(91_3306.sql)
SET @@GLOBAL.GTID_PURGED='bd809690-f181-11e9-be4a-6c92bf2b6bf2:1-5846';
在新的从库上设置gtid_purged
>set global gtid_purged='bd809690-f181-11e9-be4a-6c92bf2b6bf2:1-5846';
7.2 配置复制 change master to
change master to
master_host='xxx.xxx.0.91',
master_user='repl',
master_password='repl',
master_port=3307,
master_auto_position=1;
7.1 start io_thread
>start slave io_thread;
>show slave status\G;
*************************** 1. row ***************************
Slave_IO_State: Queueing master event to the relay log
Master_Host: 192.168.0.91
Master_User: repl
Master_Port: 3307
Connect_Retry: 60
Master_Log_File: mysql-bin.000006
Read_Master_Log_Pos: 194
Relay_Log_File: relay-bin.000001
Relay_Log_Pos: 4
Relay_Master_Log_File:
Slave_IO_Running: Yes
Slave_SQL_Running: No
Replicate_Do_DB:
Replicate_Ignore_DB:
Replicate_Do_Table:
Replicate_Ignore_Table:
Replicate_Wild_Do_Table:
Replicate_Wild_Ignore_Table:
Last_Errno: 0
Last_Error:
Skip_Counter: 0
Exec_Master_Log_Pos: 0
Relay_Log_Space: 2300593
Until_Condition: None
Until_Log_File:
Until_Log_Pos: 0
Master_SSL_Allowed: No
Master_SSL_CA_File:
Master_SSL_CA_Path:
Master_SSL_Cert:
Master_SSL_Cipher:
Master_SSL_Key:
Seconds_Behind_Master: NULL
Master_SSL_Verify_Server_Cert: No
Last_IO_Errno: 0
Last_IO_Error:
Last_SQL_Errno: 0
Last_SQL_Error:
Replicate_Ignore_Server_Ids:
Master_Server_Id: 913307
Master_UUID: ecf2665f-f94f-11e9-9ebf-6c92bf2b6bf2
Master_Info_File: /data/mysql/mysql3306/data/master.info
SQL_Delay: 0
SQL_Remaining_Delay: NULL
Slave_SQL_Running_State:
Master_Retry_Count: 86400
Master_Bind:
Last_IO_Error_Timestamp:
Last_SQL_Error_Timestamp:
Master_SSL_Crl:
Master_SSL_Crlpath:
Retrieved_Gtid_Set: bd809690-f181-11e9-be4a-6c92bf2b6bf2:4-5849
Executed_Gtid_Set: d61aafb2-f95e-11e9-8e16-6c92bf2b6cf6:1
Auto_Position: 1
Replicate_Rewrite_DB:
Channel_Name:
Master_TLS_Version:
1 row in set (0.11 sec)
7.2 start sql_thread
>start slave sql_thread until SQL_BEFORE_GTIDS='bd809690-f181-11e9-be4a-6c92bf2b6bf2:5849';
>show slave status\G;
*************************** 1. row ***************************
Slave_IO_State:
Master_Host: 192.168.0.91
Master_User: repl
Master_Port: 3307
Connect_Retry: 60
Master_Log_File: mysql-bin.000006
Read_Master_Log_Pos: 194
Relay_Log_File: relay-bin.000007
Relay_Log_Pos: 2295186
Relay_Master_Log_File: mysql-bin.000005
Slave_IO_Running: No
Slave_SQL_Running: No
Replicate_Do_DB:
Replicate_Ignore_DB:
Replicate_Do_Table:
Replicate_Ignore_Table:
Replicate_Wild_Do_Table:
Replicate_Wild_Ignore_Table:
Last_Errno: 0
Last_Error:
Skip_Counter: 0
Exec_Master_Log_Pos: 2294973
Relay_Log_Space: 2296100
Until_Condition: SQL_BEFORE_GTIDS
Until_Log_File:
Until_Log_Pos: 0
Master_SSL_Allowed: No
Master_SSL_CA_File:
Master_SSL_CA_Path:
Master_SSL_Cert:
Master_SSL_Cipher:
Master_SSL_Key:
Seconds_Behind_Master: NULL
Master_SSL_Verify_Server_Cert: No
Last_IO_Errno: 0
Last_IO_Error:
Last_SQL_Errno: 0
Last_SQL_Error:
Replicate_Ignore_Server_Ids:
Master_Server_Id: 913307
Master_UUID: ecf2665f-f94f-11e9-9ebf-6c92bf2b6bf2
Master_Info_File: /data/mysql/mysql3306/data/master.info
SQL_Delay: 0
SQL_Remaining_Delay: NULL
Slave_SQL_Running_State:
Master_Retry_Count: 86400
Master_Bind:
Last_IO_Error_Timestamp:
Last_SQL_Error_Timestamp:
Master_SSL_Crl:
Master_SSL_Crlpath:
Retrieved_Gtid_Set: bd809690-f181-11e9-be4a-6c92bf2b6bf2:4-5849
Executed_Gtid_Set: bd809690-f181-11e9-be4a-6c92bf2b6bf2:1-5848
Auto_Position: 1
Replicate_Rewrite_DB:
Channel_Name:
Master_TLS_Version:
1 row in set (0.00 sec)
- 检查数据
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"checksum table t1";
+--------------+------------+
| Table | Checksum |
+--------------+------------+
| mysqlslap.t1 | 4193919349 |
+--------------+------------+
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"checksum table test1";
+-----------------+-----------+
| Table | Checksum |
+-----------------+-----------+
| mysqlslap.test1 | 900485638 |
mysql -S /tmp/mysql3306.sock -uroot mysqlslap -e"checksum table test2";
+-----------------+-----------+
| Table | Checksum |
+-----------------+-----------+
| mysqlslap.test2 | 147003289 |
+-----------------+-----------+