【TIDB】cdc_server 和tiflash 扩容

最新推荐文章于 2024-09-25 11:41:26 发布
最新推荐文章于 2024-09-25 11:41:26 发布
阅读量210 收藏
点赞数 1
分类专栏： 国产数据库-TIDB 文章标签： tidb 数据库 服务器
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_43346403/article/details/141265704
版权

1.检查 placement-rules的情况 

[tidb@mysql1 ~]$ pd-ctl -i -u http://192.168.1.11:2379
» config show
{
  "replication": {
    "enable-placement-rules": "true",
    "isolation-level": "",
    "location-labels": "host",
    "max-replicas": 3,
    "strictly-match-label": "false"
  },
  "schedule": {
    "enable-cross-table-merge": "true",
    "enable-debug-metrics": "false",
    "enable-joint-consensus": "true",
    "enable-location-replacement": "true",
    "enable-make-up-replica": "true",
    "enable-one-way-merge": "false",
    "enable-remove-down-replica": "true",
    "enable-remove-extra-replica": "true",
    "enable-replace-offline-replica": "true",
    "high-space-ratio": 0.7,
    "hot-region-cache-hits-threshold": 3,
    "hot-region-schedule-limit": 4,
    "leader-schedule-limit": 4,
    "leader-schedule-policy": "count",
    "low-space-ratio": 0.8,
    "max-merge-region-keys": 200000,
    "max-merge-region-size": 20,
    "max-pending-peer-count": 16,
    "max-snapshot-count": 3,
    "max-store-down-time": "30m0s",
    "merge-schedule-limit": 8,
    "patrol-region-interval": "100ms",
    "region-schedule-limit": 2048,
    "region-score-formula-version": "v2",
    "replica-schedule-limit": 64,
    "scheduler-max-waiting-operator": 5,
    "split-merge-interval": "1h0m0s",
    "store-limit-mode": "manual",
    "tolerant-size-ratio": 0
  }
}

2.检查现有的 cdc_server 

--只有11上有CDC 服务。
--tiflash也只有一个节点。
[tidb@mysql1 ~]$ ps -ef |grep cdc
tidb      96609      1  0 16:56 ?        00:00:07 bin/cdc server --addr 0.0.0.0:8300 --advertise-addr 192.168.1.11:8300 --pd http://192.168.1.11:2379,http://192.168.1.12:2379,http://192.168.1.13:2379 --data-dir=/tidb/tidb-data/cdc-8300 --config conf/cdc.toml --log-file /tidb/tidb-deploy/cdc-8300/log/cdc.log
tidb     102208  44178  0 17:20 pts/1    00:00:00 grep --color=auto cdc

mysql> select * from information_schema.cluster_info;
+---------+--------------------+--------------------+---------+------------------------------------------+---------------------------+------------------+-----------+
| TYPE    | INSTANCE           | STATUS_ADDRESS     | VERSION | GIT_HASH                                 | START_TIME                | UPTIME           | SERVER_ID |
+---------+--------------------+--------------------+---------+------------------------------------------+---------------------------+------------------+-----------+
| tidb    | 192.168.1.12:4001  | 192.168.1.12:10081 | 5.1.1   | 797bddd25310ed42f0791c8eccb78be8cce2f502 | 2024-08-16T16:56:36+08:00 | 24m5.135387578s  |         0 |
| tidb    | 192.168.1.13:4000  | 192.168.1.13:10080 | 5.1.1   | 797bddd25310ed42f0791c8eccb78be8cce2f502 | 2024-08-16T16:56:36+08:00 | 24m5.135393558s  |         0 |
| tidb    | 192.168.1.11:4000  | 192.168.1.11:10080 | 5.1.1   | 797bddd25310ed42f0791c8eccb78be8cce2f502 | 2024-08-16T16:56:36+08:00 | 24m5.135396331s  |         0 |
| pd      | 192.168.1.13:2379  | 192.168.1.13:2379  | 5.1.1   | 7cba1912b317a533e18b16ea2ba9a14ed2891129 | 2024-08-16T16:56:27+08:00 | 24m14.135397738s |         0 |
| pd      | 192.168.1.11:2379  | 192.168.1.11:2379  | 5.1.1   | 7cba1912b317a533e18b16ea2ba9a14ed2891129 | 2024-08-16T16:56:26+08:00 | 24m15.135399086s |         0 |
| pd      | 192.168.1.12:2379  | 192.168.1.12:2379  | 5.1.1   | 7cba1912b317a533e18b16ea2ba9a14ed2891129 | 2024-08-16T16:56:27+08:00 | 24m14.135400418s |         0 |
| tiflash | 192.168.1.11:3930  | 192.168.1.11:20292 | v5.1.1  | c8fabfb50fe28db17cc5118133a69be255c40efd | 2024-08-16T16:56:40+08:00 | 24m1.135401766s  |         0 |
| tikv    | 192.168.1.12:20161 | 192.168.1.12:20181 | 5.1.1   | 4705d7c6e9c42d129d3309e05911ec6b08a25a38 | 2024-08-16T16:56:28+08:00 | 24m13.135403126s |         0 |
| tikv    | 192.168.1.13:20160 | 192.168.1.13:20180 | 5.1.1   | 4705d7c6e9c42d129d3309e05911ec6b08a25a38 | 2024-08-16T16:56:29+08:00 | 24m12.135404509s |         0 |
| tikv    | 192.168.1.11:20160 | 192.168.1.11:20180 | 5.1.1   | 4705d7c6e9c42d129d3309e05911ec6b08a25a38 | 2024-08-16T16:56:29+08:00 | 24m12.135405831s |         0 |
+---------+--------------------+--------------------+---------+------------------------------------------+---------------------------+------------------+-----------+
10 rows in set (0.02 sec)

3.新增节点 

--扩容 CDC 和 tiflash 服务。
tiflash新增一个节点:12 
cdc_server 新增一个节点:12

[tidb@mysql1 ~]$ cat config-scale-out.yaml 
tiflash_servers:
        - host: 192.168.1.14
cdc_servers:
        - host: 192.168.1.12

--正式扩容 
[tidb@mysql1 ~]$ tiup cluster scale-out tidbcluster config-scale-out.yaml --user root -p
Starting component `cluster`: /home/tidb/.tiup/components/cluster/v1.5.3/tiup-cluster scale-out tidbcluster config-scale-out.yaml --user root -p
Please confirm your topology:
Cluster type:    tidb
Cluster name:    tidbcluster
Cluster version: v5.1.1
Role     Host          Ports                            OS/Arch       Directories
----     ----          -----                            -------       -----------
tiflash  192.168.1.14  9000/8123/3930/20170/20292/8234  linux/x86_64  /tidb/tidb-deploy/tiflash-9000,/tidb/tidb-data/tiflash-9000
cdc      192.168.1.12  8300                             linux/x86_64  /tidb/tidb-deploy/cdc-8300,/tidb/tidb-data/cdc-8300
Attention:
    1. If the topology is not what you expected, check your yaml file.
    2. Please confirm there is no port/directory conflicts in same host.
Do you want to continue? [y/N]: (default=N) y
Input SSH password: 
+ [ Serial ] - SSHKeySet: privateKey=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/ssh/id_rsa, publicKey=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/ssh/id_rsa.pub



  - Download tiflash:v5.1.1 (linux/amd64) ... Done
+ [ Serial ] - RootSSH: user=root, host=192.168.1.14, port=22
+ [ Serial ] - EnvInit: user=tidb, host=192.168.1.14
+ [ Serial ] - Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy','/tidb/tidb-data'
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.12
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.13
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.12
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.13
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.12
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.13
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.11

+ [ Serial ] - UserSSH: user=tidb, host=192.168.1.14
+ [ Serial ] - Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy/tiflash-9000','/tidb/tidb-deploy/tiflash-9000/bin','/tidb/tidb-deploy/tiflash-9000/conf','/tidb/tidb-deploy/tiflash-9000/scripts'
+ [ Serial ] - UserSSH: user=tidb, host=192.168.1.12
+ [ Serial ] - Mkdir: host=192.168.1.12, directories='/tidb/tidb-deploy/cdc-8300','/tidb/tidb-deploy/cdc-8300/bin','/tidb/tidb-deploy/cdc-8300/conf','/tidb/tidb-deploy/cdc-8300/scripts'
  - Copy blackbox_exporter -> 192.168.1.14 ... ⠇ Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy/monitor-9100','/tidb/tidb-data/monitor-9100','/tidb/tidb-deploy/monitor-9100/log','/t...
  - Copy blackbox_exporter -> 192.168.1.14 ... ⠙ Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy/monitor-9100','/tidb/tidb-data/monitor-9100','/tidb/tidb-deploy/monitor-9100/log','/t...
  - Copy blackbox_exporter -> 192.168.1.14 ... ⠧ Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy/monitor-9100','/tidb/tidb-data/monitor-9100','/tidb/tidb-deploy/monitor-9100/log','/t...
  - Copy node_exporter -> 192.168.1.14 ... ⠦ Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy/monitor-9100','/tidb/tidb-data/monitor-9100','/tidb/tidb-deploy/monitor-9100/log','/tidb/...
  - Copy blackbox_exporter -> 192.168.1.14 ... ⠸ Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy/monitor-9100','/tidb/tidb-data/monitor-9100','/tidb/tidb-deploy/monitor-9100/log','/t...
+ [ Serial ] - ScaleConfig: cluster=tidbcluster, user=tidb, host=192.168.1.12, service=cdc-8300.service, deploy_dir=/tidb/tidb-deploy/cdc-8300, data_dir=[/tidb/tidb-data/cdc-8300], log_dir=/tidb
  - Copy blackbox_exporter -> 192.168.1.14 ... ⠙ Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy/monitor-9100','/tidb/tidb-data/monitor-9100','/tidb/tidb-deploy/monitor-9100/log','/t...
  - Copy blackbox_exporter -> 192.168.1.14 ... ⠦ Mkdir: host=192.168.1.14, directories='/tidb/tidb-deploy/monitor-9100','/tidb/tidb-data/monitor-9100','/tidb/tidb-deploy/monitor-9100/log',''/t...
  - Copy node_exporter -> 192.168.1.14 ... Done
+ [ Serial ] - ScaleConfig: cluster=tidbcluster, user=tidb, host=192.168.1.14, service=tiflash-9000.service, deploy_dir=/tidb/tidb-deploy/tiflash-9000, data_dir=[/tidb/tidb-data/tiflash-9000], log_dir=/tidb/tidb-deploy/tiflash-9000/log, cache_dir=
+ Check status
Enabling component tiflash
	Enabling instance 192.168.1.14:9000
	Enable instance 192.168.1.14:9000 success
Enabling component cdc
	Enabling instance 192.168.1.12:8300
	Enable instance 192.168.1.12:8300 success
Enabling component node_exporter
	Enabling instance 192.168.1.12
	Enabling instance 192.168.1.14
	Enable 192.168.1.14 success
	Enable 192.168.1.12 success
Enabling component blackbox_exporter
	Enabling instance 192.168.1.12
	Enabling instance 192.168.1.14
	Enable 192.168.1.14 success
	Enable 192.168.1.12 success
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.12
+ [Parallel] - UserSSH: user=tidb, host=192.168.1.14
+ [ Serial ] - Save meta
+ [ Serial ] - StartCluster
Starting component tiflash
	Starting instance 192.168.1.14:9000
	Start instance 192.168.1.14:9000 success
Starting component cdc
	Starting instance 192.168.1.12:8300
	Start instance 192.168.1.12:8300 success
Starting component node_exporter
	Starting instance 192.168.1.12
	Starting instance 192.168.1.14
	Start 192.168.1.12 success
	Start 192.168.1.14 success
Starting component blackbox_exporter
	Starting instance 192.168.1.12
	Starting instance 192.168.1.14
	Start 192.168.1.12 success
	Start 192.168.1.14 success
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tispark-worker-7078.service, deploy_dir=/tidb/tidb-deploy/tispark-worker-7078, data_dir=[], log_dir=/tidb/tidb-deploy/tispark-worker-7078/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/pd-2379.service, deploy_dir=/tidb/tidb-deploy/pd-2379, data_dir=[/tidb/tidb-data/pd-2379], log_dir=/tidb/tidb-deploy/pd-2379/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.12, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/pd-2379.service, deploy_dir=/tidb/tidb-deploy/pd-2379, data_dir=[/tidb/tidb-data/pd-2379], log_dir=/tidb/tidb-deploy/pd-2379/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.13, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/pd-2379.service, deploy_dir=/tidb/tidb-deploy/pd-2379, data_dir=[/tidb/tidb-data/pd-2379], log_dir=/tidb/tidb-deploy/pd-2379/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tikv-20160.service, deploy_dir=/tidb/tidb-deploy/tikv-20160, data_dir=[/tidb/tidb-data/tikv-20160], log_dir=/tidb/tidb-deploy/tikv-20160/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.12, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tikv-20161.service, deploy_dir=/tidb/tidb-deploy/tikv-20161, data_dir=[/tidb/tidb-data/tikv-20161], log_dir=/tidb/tidb-deploy/tikv-20161/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.13, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tikv-20160.service, deploy_dir=/tidb/tidb-deploy/tikv-20160, data_dir=[/tidb/tidb-data/tikv-20160], log_dir=/tidb/tidb-deploy/tikv-20160/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tidb-4000.service, deploy_dir=/tidb/tidb-deploy/tidb-4000, data_dir=[], log_dir=/tidb/tidb-deploy/tidb-4000/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.12, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tidb-4001.service, deploy_dir=/tidb/tidb-deploy/tidb-4001, data_dir=[], log_dir=/tidb/tidb-deploy/tidb-4001/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.13, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tidb-4000.service, deploy_dir=/tidb/tidb-deploy/tidb-4000, data_dir=[], log_dir=/tidb/tidb-deploy/tidb-4000/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tiflash-9000.service, deploy_dir=/tidb/tidb-deploy/tiflash-9000, data_dir=[/tidb/tidb-data/tiflash-9000], log_dir=/tidb/tidb-deploy/tiflash-9000/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.14, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tiflash-9000.service, deploy_dir=/tidb/tidb-deploy/tiflash-9000, data_dir=[/tidb/tidb-data/tiflash-9000], log_dir=/tidb/tidb-deploy/tiflash-9000/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/cdc-8300.service, deploy_dir=/tidb/tidb-deploy/cdc-8300, data_dir=[/tidb/tidb-data/cdc-8300], log_dir=/tidb/tidb-deploy/cdc-8300/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.12, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/cdc-8300.service, deploy_dir=/tidb/tidb-deploy/cdc-8300, data_dir=[/tidb/tidb-data/cdc-8300], log_dir=/tidb/tidb-deploy/cdc-8300/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/prometheus-9090.service, deploy_dir=/tidb/tidb-deploy/prometheus-9090, data_dir=[/tidb/tidb-data/prometheus-9090], log_dir=/tidb/tidb-deploy/prometheus-9090/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/grafana-3000.service, deploy_dir=/tidb/tidb-deploy/grafana-3000, data_dir=[], log_dir=/tidb/tidb-deploy/grafana-3000/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/alertmanager-9093.service, deploy_dir=/tidb/tidb-deploy/alertmanager-9093, data_dir=[/tidb/tidb-data/alertmanager-9093], log_dir=/tidb/tidb-deploy/alertmanager-9093/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - InitConfig: cluster=tidbcluster, user=tidb, host=192.168.1.11, path=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache/tispark-master-7077.service, deploy_dir=/tidb/tidb-deploy/tispark-master-7077, data_dir=[], log_dir=/tidb/tidb-deploy/tispark-master-7077/log, cache_dir=/home/tidb/.tiup/storage/cluster/clusters/tidbcluster/config-cache
+ [ Serial ] - SystemCtl: host=192.168.1.11 action=reload prometheus-9090.service
+ [ Serial ] - UpdateTopology: cluster=tidbcluster
Scaled cluster `tidbcluster` out successfully

4.cdc 检查 

--果然2号节点新怎了CDC ;
[root@mysql2 tidb-deploy]# ps -ef |grep cdc
tidb     124736      1  0 17:23 ?        00:00:01 bin/cdc server --addr 0.0.0.0:8300 --advertise-addr 192.168.1.12:8300 --pd http://192.168.1.11:2379,http://192.168.1.12:2379,http://192.168.1.13:2379 --data-dir=/tidb/tidb-data/cdc-8300 --config conf/cdc.toml --log-file /tidb/tidb-deploy/cdc-8300/log/cdc.log
root     125984   1766  0 17:26 pts/0    00:00:00 grep --color=auto cdc

--1号节点原先有一个，说明扩容成功。
[tidb@mysql1 ~]$ ps -ef |grep cdc
tidb      96609      1  0 16:56 ?        00:00:10 bin/cdc server --addr 0.0.0.0:8300 --advertise-addr 192.168.1.11:8300 --pd http://192.168.1.11:2379,http://192.168.1.12:2379,http://192.168.1.13:2379 --data-dir=/tidb/tidb-data/cdc-8300 --config conf/cdc.toml --log-file /tidb/tidb-deploy/cdc-8300/log/cdc.log
tidb     106266 105488  0 17:27 pts/2    00:00:00 grep --color=auto cdc
[tidb@mysql1 ~]$ 

--tiflash检查 
mysql> select * from information_schema.cluster_info;
+---------+--------------------+--------------------+---------+------------------------------------------+---------------------------+------------------+-----------+
| TYPE    | INSTANCE           | STATUS_ADDRESS     | VERSION | GIT_HASH                                 | START_TIME                | UPTIME           | SERVER_ID |
+---------+--------------------+--------------------+---------+------------------------------------------+---------------------------+------------------+-----------+
| tidb    | 192.168.1.12:4001  | 192.168.1.12:10081 | 5.1.1   | 797bddd25310ed42f0791c8eccb78be8cce2f502 | 2024-08-16T16:56:36+08:00 | 31m50.850401814s |         0 |
| tidb    | 192.168.1.13:4000  | 192.168.1.13:10080 | 5.1.1   | 797bddd25310ed42f0791c8eccb78be8cce2f502 | 2024-08-16T16:56:36+08:00 | 31m50.850407862s |         0 |
| tidb    | 192.168.1.11:4000  | 192.168.1.11:10080 | 5.1.1   | 797bddd25310ed42f0791c8eccb78be8cce2f502 | 2024-08-16T16:56:36+08:00 | 31m50.850409404s |         0 |
| pd      | 192.168.1.13:2379  | 192.168.1.13:2379  | 5.1.1   | 7cba1912b317a533e18b16ea2ba9a14ed2891129 | 2024-08-16T16:56:27+08:00 | 31m59.850410857s |         0 |
| pd      | 192.168.1.11:2379  | 192.168.1.11:2379  | 5.1.1   | 7cba1912b317a533e18b16ea2ba9a14ed2891129 | 2024-08-16T16:56:26+08:00 | 32m0.850412319s  |         0 |
| pd      | 192.168.1.12:2379  | 192.168.1.12:2379  | 5.1.1   | 7cba1912b317a533e18b16ea2ba9a14ed2891129 | 2024-08-16T16:56:27+08:00 | 31m59.850414902s |         0 |
| tikv    | 192.168.1.12:20161 | 192.168.1.12:20181 | 5.1.1   | 4705d7c6e9c42d129d3309e05911ec6b08a25a38 | 2024-08-16T16:56:28+08:00 | 31m58.850416221s |         0 |
| tikv    | 192.168.1.13:20160 | 192.168.1.13:20180 | 5.1.1   | 4705d7c6e9c42d129d3309e05911ec6b08a25a38 | 2024-08-16T16:56:29+08:00 | 31m57.850417525s |         0 |
| tikv    | 192.168.1.11:20160 | 192.168.1.11:20180 | 5.1.1   | 4705d7c6e9c42d129d3309e05911ec6b08a25a38 | 2024-08-16T16:56:29+08:00 | 31m57.850418882s |         0 |
| tiflash | 192.168.1.11:3930  | 192.168.1.11:20292 | v5.1.1  | c8fabfb50fe28db17cc5118133a69be255c40efd | 2024-08-16T16:56:40+08:00 | 31m46.850423342s |         0 |
| tiflash | 192.168.1.14:3930  | 192.168.1.14:20292 | v5.1.1  | c8fabfb50fe28db17cc5118133a69be255c40efd | 2024-08-16T17:23:13+08:00 | 5m13.850424725s  |         0 |
+---------+--------------------+--------------------+---------+------------------------------------------+---------------------------+------------------+-----------+
11 rows in set (0.01 sec)

5.tiflash 的使用  

create table my_test2(id int,name varchar(20));
insert into my_test2 values(1,'薛双奇1');
insert into my_test2 values(2,'薛双奇2');
insert into my_test2 values(3,'薛双奇3');
insert into my_test2 values(4,'薛双奇4');
insert into my_test2 values(5,'薛双奇5');
insert into my_test2 values(6,'薛双奇6');
insert into my_test2 values(7,'薛双奇7');
insert into my_test2 values(8,'薛双奇8');
insert into my_test2 values(9,'薛双奇9');
insert into my_test2 values(10,'薛双奇10');
select * from my_test2; 
mysql> select * from my_test2; 
+------+-------------+
| id   | name        |
+------+-------------+
|    1 | 薛双奇1     |
|    2 | 薛双奇2     |
|    3 | 薛双奇3     |
|    4 | 薛双奇4     |
|    5 | 薛双奇5     |
|    6 | 薛双奇6     |
|    7 | 薛双奇7     |
|    8 | 薛双奇8     |
|    9 | 薛双奇9     |
|   10 | 薛双奇10    |
+------+-------------+
10 rows in set (0.00 sec)

--创建2个副本 
ALTER TABLE my_test2 SET TIFLASH REPLICA 2;
mysql> ALTER TABLE my_test2 SET TIFLASH REPLICA 2;
Query OK, 0 rows affected (0.52 sec)

SELECT * FROM information_schema.tiflash_replica 
WHERE TABLE_SCHEMA = 'test' 
and TABLE_NAME = 'my_test2';
mysql> SELECT * FROM information_schema.tiflash_replica 
    -> WHERE TABLE_SCHEMA = 'test' 
    -> and TABLE_NAME = 'my_test2';
+--------------+------------+----------+---------------+-----------------+-----------+----------+
| TABLE_SCHEMA | TABLE_NAME | TABLE_ID | REPLICA_COUNT | LOCATION_LABELS | AVAILABLE | PROGRESS |
+--------------+------------+----------+---------------+-----------------+-----------+----------+
| test         | my_test2   |       55 |             2 |                 |         1 |        1 |
+--------------+------------+----------+---------------+-----------------+-----------+----------+
1 row in set (0.00 sec)

--查询执行计划 。
mysql> desc select count(*) from test.my_test2;
+----------------------------+---------+-------------------+----------------+---------------------------------+
| id                         | estRows | task              | access object  | operator info                   |
+----------------------------+---------+-------------------+----------------+---------------------------------+
| StreamAgg_25               | 1.00    | root              |                | funcs:count(Column#7)->Column#4 |
| └─TableReader_26           | 1.00    | root              |                | data:StreamAgg_9                |
|   └─StreamAgg_9            | 1.00    | batchCop[tiflash] |                | funcs:count(1)->Column#7        |
|     └─TableFullScan_24     | 10.00   | batchCop[tiflash] | table:my_test2 | keep order:false, stats:pseudo  |
+----------------------------+---------+-------------------+----------------+---------------------------------+
4 rows in set (0.00 sec)

戒掉贪嗔痴(薛双奇)
关注
专栏目录
TiDB部署全攻略——存储引擎TiFlash
bbsxb520的博客
07-04 359
TiFlash的构建及加速方法等
TIDB+tiflash搭建过程
qq_43297415的博客
06-02 283
TIDB 搭建过程 1、各个节点简介与环境准备 节点官方说明：https://docs.pingcap.com/zh/tidb/v4.0/tidb-architecture 1.1、节点简介 tidb: 对外暴露MySQL协议的连接endpoint,负责接收客户端的连接，执行SQL解析和优化，最终生成分布式执行计划。 pd: 负责对tikv节点实时数据分析，提供tidb dashboard管控界面，同时会根据tikv节点实时上传的数据分布状态， 下发数据调度命令给具体的tikv节点。建议部署奇数个pd节
通过 TiUP 部署 TiDB 集群的拓扑文件配置
weixin_42241611的博客
09-02 563
通过 TiUP 部署或扩容 TiDB 集群时，需要提供一份拓扑文件（）来描述集群拓扑。同样，修改集群配置也是通过编辑拓扑文件来实现的，区别在于修改配置时仅允许修改部分字段。本文档介绍拓扑文件的各个区块以各区块中的各字段。
TiDB + TiFlash ： 朝着真 HTAP 平台演进
chigangdou7652的博客
09-02 2032
作者介绍: 韦万，PingCAP 数据库研发工程师，主要领域是数据库的存储引擎研发，以及系统性能优化。 一、为什么我们需要 HTAP 数据库？ 在互联网浪潮出现之前，企业的数据量普遍不大，特别是核心的业务数据，通常一个单机的数据库就可以保存。那时候的存储并不需要复杂的架构，所有的线上请求(...
TiDB5.4分布式安装部署（一）
大伟的博客
04-21 1294
192.168.31.28 pd,tidb,tikv,tiflash,monitoring,grafana,alertmanager 192.168.31.196 pd,tidb,tikv,tiflash 192.168.31.112 pd,tidb,tikv 一、安装 1、执行如下命令安装 TiUP 工具： curl --proto '=https' --tlsv1.2 -sSf https://tiup-mirrors.pingcap.com/install.sh |
Tiflash 尝鲜小案例
TiDB 社区干货传送门
09-26 78
作者：顾大伟 原文来源： https://tidb.net/blog/94e92326 ...
使用 TiUP 扩容缩容 TiDB 集群
weixin_42241611的博客
09-09 744
TiDB 集群可以在不中断线上服务的情况下进行扩容和缩容。本文介绍如何使用 TiUP 扩容缩容集群中的 TiDB、TiKV、PD、TiCDC 或者 TiFlash 节点。如未安装 TiUP，可参考。你可以通过查看当前的集群名称列表。
TiDB扩缩容
weixin_43110668的博客
02-07 722
更多参考: https://docs.pingcap.com/zh/tidb/v4.0/scale-tidb-using-tiup 使用 TiUP 扩容缩容 TiDB 集群 TiDB 集群可以在不中断线上服务的情况下进行扩容和缩容。 本文介绍如何使用 TiUP 扩容缩容集群中的 TiDB、TiKV、PD、TiCDC 或者 TiFlash 节点。如未安装 TiUP，可参考升级文档中的步骤，将集群 Import 到 TiUP 环境中，再使用 TiUP 进行扩容缩容。 你可以通过 tiup cluster
TiDB测试_201808201
08-03
- **TiDB Server**：作为SQL查询处理层，TiDB Server接收SQL请求，执行逻辑并透过PD找到数据在TiKV中的位置。由于它不存储数据，因此是无状态的，可以无限水平扩展，通常配合负载均衡器提供统一的服务入口。 - **...
[中文翻译 by Hangzhi] High Performance TiDB 7_ transactions1
08-04
此外，TiDB 还支持 TiFlash 作为列式存储引擎，用于加速分析查询。TiFlash 与 TiKV 协同工作，允许在事务处理的同时进行高效的数据分析，从而实现 HTAP（Hybrid Transactional/Analytical Processing）能力。 为了...
如何对TiDB进行在线扩容
weixin_45694422的博客
07-06 782
1、 检查集群状态 [root@tidb ~]# tiup cluster display sandata 我们发现集群里只有1个TIDB节点，根据官方手册要求生产环境最少需要两个TIDB节点所以我们进行在线扩容添加一个TIDB节点。 2、 创建扩容文件scale-out-tidb.yaml 这里我们复制topology.yaml文件的tidb部分内容进行修改，如果找不到topology.yaml文件也可以去官方文档查找对应的参数，将注释去掉不需要的部分也删掉，注意格式，有可能格式不对会报错，目录端口根
TiDB 6.0 新特性解读 | TiFlash 新增算子和函数下推
TiDB 社区干货传送门
05-07 343
作者：严世超 原文来源： https://tidb.net/blog/2188d936 ...
TiFlash：并非另一个 T + 1 列存数据库
Enmotech的博客
03-22 654
摘要：TiFlash 是配合 TiDB 体系的列存引擎，它和 TiDB 无缝结合，在线 DDL、无缝扩容、自动容错等等方便运维的特点也在 TiFlash 中得到继承，此外，TiFlash 可以实时与行存保持同步。 在上篇关于 TiFlash 的文章发布后，我们收到了很多伙伴们的反馈，大家有各种各样的疑问，包括 TiFlash 是不是 T + 1 列存数据库？为啥实时写入也很快？读压力大怎么办...
tidb-一场select in百万参数引发的血案
最新发布
line_on_database的博客
09-25 264
当然，中间的排查结果并不是这么顺利的，调整了很多参数，都没有太起作用，最后才定位到这个慢sql,主要是没有想到这个慢sql的执行计划这么大，造成了如此大的影响。
TiDB 简单集群部署拓扑文件
20000_ZuuuuYao的博客
09-24 341
都2024了还在为分库分表烦恼吗😘，用分布式数据库TiDB、OceanBase、华为 GaussDB，你就使劲往里存数据。早下班、少脱发、脱单！🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻。
计算机毕业设计之：基于微信小程序的诗词智能学习系统（源码+文档+解答）
程序员阿龙的博客
09-22 4370
博主介绍： ✌我是阿龙，一名专注于Java技术领域的程序员，全网拥有10W+粉丝。作为CSDN特邀作者、博客专家、新星计划导师，我在计算机毕业设计开发方面积累了丰富的经验。同时，我也是掘金、华为云、阿里云、InfoQ等平台的优质作者。通过长期分享和实战指导，我致力于帮助更多学生完成毕业项目和技术提升。 技术范围： 我熟悉的技术领域涵盖SpringBoot、Vue、SSM、HLMT、Jsp、PHP、Nodejs、Python、爬虫、数据可视化、小程序、安卓app、大数据、物联网、机器学习等方
Online DDL (Data Definition Language)
09-23 246
是MySQL中的一个功能，允许在修改表结构（如添加、删除或修改列）的同时，允许对表进行并发读写操作。在传统的DDL操作中，对表结构的修改会导致整个表被锁定，从而阻止其他事务对该表进行读写操作，这可能导致长时间的锁定和性能问题。Online DDL的引入解决了这个问题，它允许在修改表结构的同时，保持对表的并发访问。MySQL从5.6版本开始引入了Online DDL的部分功能，而在8.0版本中对Online DDL进行了进一步的优化。
tidb auto_increment
06-09
TiDB 的 auto_increment 是用来生成自增主键的功能。在 TiDB 中，定义一个自增主键的方式与 MySQL 类似，只需要在创建表的时候在主键字段的类型后面加上 AUTO_INCREMENT 关键字即可。 例如，创建一个名为 user 的表...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值