DM数据同步

@[TOC]DM数据同步
中控机操作

配置任务

环境
mysql
IP：10.0..
端口：3307
用户：user
密码：*****
mysql 用户的权限
REPLICATION SLAVE
REPLICATION CLIENT
RELOAD
SELECT

dm现在只支持大于5.0小于8.0

配置task
cd dm-ansible/conf

cp task_basic.yaml.example task.yaml
vim task.yaml

---
name: xie # 任务名称
task-mode: all  # full/incremental/all all表示全量加增量
#ignore-checking-items: ["version"]

target-database:
  host: "10.*.*.*"  #tidb ip
  port: 4000
  user: "root"
  password: ""

mysql-instances:             # one or more source database, config more source database for sharding merge
  -
    source-id: "mysql-replica-01" #这里的mysql-replica-01名称跟inventory.ini文件里的一样
    black-white-list:  "instance"
    mydumper-config-name: "global"

    # number of threads to use for dump data
    mydumper-thread: 4

    # number of threads to use for load data
    loader-thread: 16

    # number of threads to use for replicate binlog
    syncer-thread: 16


black-white-list:
  instance:
    do-tables:   #白名单
    - db-name: "yhtdb"   #同步的库
      tbl-name: "pub_yht_online_user"  #同步的表

mydumpers:
  global:
    mydumper-path: "/home/tidb/dm-ansible/resources/bin/mydumper"   # Mydumper 二进制文件的路径。
    extra-args: "-B yhtdb" 

启动任务

dm-ansible/resources/bin/dmctl --master-addr 172.16.10.71:8261

start-task ./task.yaml #启动任务

query-status #查看任务
stop-task xie #停止任务

详细配置参考官方文档
https://docs.pingcap.com/zh/tidb-data-migration/stable/replicate-data-using-dm