Lightning数据导入

使用Dumpling备份数据

参考Dumpling介绍和使用_一条大河-CSDN博客

编辑配置文件

[lightning]
#日志

level = "info"
file = "tidb-lightning.log"

[tikv-importer]
# 选择使用的local后端
backend = "tidb"

# 设置排序的键值对的临时存放地址， 目标路径目录需要为空
sorted-kv-dir = "/export/servers/temp/tiuplightning/kv_data"


[mydumper]
# 源数据目录
data-source-dir = "/export/servers/temp/tiuplightning/jcdp"

[tidb]
# 目标集群信息
host = "XX.XX.XX.XX"
port = 4000
user = "root"
password = "password"
# 表结构信息在从TiDB的状态端口获取， status-port = 10080
# 集群pd地址
pd-addr = "XX.XX.XX.XX:2379"

开始导入

切换到toolkit的bin目录下开始执行导入， 

nohup ./tidb-lightning -config  tidb-lightning.toml > nohup.out

查看状态

•  导入过程中，可以通过tidb 的show processlist命令看到多线程并发导入；
• 如果导入成功， nohup.out  和 tidb-lightning.log  行尾均会显示"tidb lightning exit"

+---+----------------------------------------------+-------------+--------+
| # | CHECK ITEM                                   | TYPE        | PASSED |
+---+----------------------------------------------+-------------+--------+
| 1 | Source csv files size is proper              | performance | true   |
+---+----------------------------------------------+-------------+--------+
| 2 | checkpoints are valid                        | critical    | true   |
+---+----------------------------------------------+-------------+--------+
| 3 | table schemas are valid                      | critical    | true   |
+---+----------------------------------------------+-------------+--------+
| 4 | Cluster is available                         | critical    | true   |
+---+----------------------------------------------+-------------+--------+
| 5 | Lightning has the correct storage permission | critical    | true   |
+---+----------------------------------------------+-------------+--------+
tidb lightning exit