Clickhouse集群_ 双副本配置下Replicatedmergetree引擎的表在一个节点被删除后会自动恢复吗

2分片双副本的配置：1,2,3,4节点，分片1落在1,2节点, 1,2节点互为对方的副本，分片2落在3,4节点, 3,4节点互为对方的副本
replicatedmergetree引擎的表在一个节点被删除后，虽然另一个节点还有它的副本，但是这个副本不过同步到被删除的节点，也就是说双副本的配置情况下replicatedmergetree引擎的表在一个节点被删除后不会自动恢复

replicatedmergetree引擎的表，表文件在节点3删除，但是节点4还有表文件，会自动同步到节点3吗？
答案：不会，该表文件在节点3删除后，在节点3查询该表报错，且24小时后再查询还是报错

DAILACHDBUD003 :) select name,engine,data_paths from system.tables where name in ('table_Distributed_ReplicatedMergeTree1','table_Distributed_ReplicatedMergeTree20231031','table_ReplicatedMergeTree1','table_ReplicatedMergeTree20231031');
┌─name──────────────────────────────────────────┬─engine──────────────┬─data_paths──────────────────────────────────────────────────────────────────┐
│ table_Distributed_ReplicatedMergeTree1        │ Distributed         │ ['/chdata/clickhouse/data/store/966/9663a43b-dcf5-4b2e-b9b0-dbecb1def8bc/'] │
│ table_Distributed_ReplicatedMergeTree20231031 │ Distributed         │ ['/chdata/clickhouse/data/store/e4b/e4bcc136-193a-4ad8-a56e-c123a80a683f/'] │
│ table_ReplicatedMergeTree1                    │ ReplicatedMergeTree │ ['/chdata/clickhouse/data/store/f9c/f9ce3729-2815-4a9b-bdf5-7f24cd6ab01b/'] │
│ table_ReplicatedMergeTree20231031             │ ReplicatedMergeTree │ ['/chdata/clickhouse/data/store/600/600470de-9db1-419f-9009-35a552616c56/'] │
└───────────────────────────────────────────────┴─────────────────────┴─────────────────────────────────────────────────────────────────────────────┘

在节点3把表table_ReplicatedMergeTree1表文件/chdata/clickhouse/data/store/f9c/f9ce3729-2815-4a9b-bdf5-7f24cd6ab01b/干掉，查询该表报错Cannot open file /chdata/clickhouse/data/store/f9c/f9ce3729-2815-4a9b-bdf5-7f24cd6ab01b

DAILACHDBUD003 :) select * from table_ReplicatedMergeTree1;
0 rows in set. Elapsed: 0.267 sec.

Received exception from server (version 23.4.2):
Code: 107. DB::Exception: Received from DAILACHDBUD003:9000. DB::ErrnoException. DB::ErrnoException: Cannot open file /chdata/clickhouse/data/store/f9c/f9ce3729-2815-4a9b-bdf5-7f24cd6ab01b/202011_0_0_0/data.bin, errno: 2, strerror: No such file or directory: While executing MergeTreeInOrder. (FILE_DOESNT_EXIST)

replicatedmergetree引擎的表，表文件在节点4删除，但是节点3还有表文件，会自动同步到节点4吗？
答案：不会，该表文件在节点3删除后，在节点3查询该表报错，且24小时后再查询还是报错

DAILACHDBUD004 :) select name,engine,data_paths from system.tables where name in ('table_Distributed_ReplicatedMergeTree1','table_Distributed_ReplicatedMergeTree20231031','table_ReplicatedMergeTree1','table_ReplicatedMergeTree20231031');
┌─name──────────────────────────────────────────┬─engine──────────────┬─data_paths──────────────────────────────────────────────────────────────────┐
│ table_Distributed_ReplicatedMergeTree1        │ Distributed         │ ['/chdata/clickhouse/data/store/966/9663a43b-dcf5-4b2e-b9b0-dbecb1def8bc/'] │
│ table_Distributed_ReplicatedMergeTree20231031 │ Distributed         │ ['/chdata/clickhouse/data/store/e4b/e4bcc136-193a-4ad8-a56e-c123a80a683f/'] │
│ table_ReplicatedMergeTree1                    │ ReplicatedMergeTree │ ['/chdata/clickhouse/data/store/f9c/f9ce3729-2815-4a9b-bdf5-7f24cd6ab01b/'] │
│ table_ReplicatedMergeTree20231031             │ ReplicatedMergeTree │ ['/chdata/clickhouse/data/store/600/600470de-9db1-419f-9009-35a552616c56/'] │
└───────────────────────────────────────────────┴─────────────────────┴─────────────────────────────────────────────────────────────────────────────┘

在节点4把table_ReplicatedMergeTree20231031表文件/chdata/clickhouse/data/store/600/600470de-9db1-419f-9009-35a552616c56/干掉,查询该表报错Cannot open file /chdata/clickhouse/data/store/600/600470de-9db1-419f-9009-35a552616c56/

DAILACHDBUD004 :) select * from table_ReplicatedMergeTree20231031;
0 rows in set. Elapsed: 0.007 sec.

Received exception from server (version 23.5.2):
Code: 107. DB::Exception: Received from DAILACHDBUD004:9000. DB::ErrnoException. DB::ErrnoException: Cannot open file /chdata/clickhouse/data/store/600/600470de-9db1-419f-9009-35a552616c56/202011_0_0_0/data.bin, errno: 2, strerror: No such file or directory: While executing MergeTreeInOrder. (FILE_DOESNT_EXIST)

3-4节点数据都是如下情况

DAILACHDBUD003 :) select * from table_ReplicatedMergeTree1;
┌─id─┬─────────create_time─┐
│ 21 │ 2020-11-17 00:00:00 │
│ 22 │ 2020-11-17 00:00:00 │
│ 24 │ 2020-11-17 00:00:00 │
│ 25 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘

DAILACHDBUD003 :) select * from table_Distributed_ReplicatedMergeTree1;
┌─id─┬─────────create_time─┐
│ 21 │ 2020-11-17 00:00:00 │
│ 22 │ 2020-11-17 00:00:00 │
│ 24 │ 2020-11-17 00:00:00 │
│ 25 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘
┌─id─┬─────────create_time─┐
│ 23 │ 2020-11-17 00:00:00 │
│ 26 │ 2020-11-17 00:00:00 │
│ 27 │ 2020-11-17 00:00:00 │
│ 28 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘


DAILACHDBUD003 :) select * from table_ReplicatedMergeTree20231031;
┌─id─┬─────────create_time─┐
│ 23 │ 2020-11-17 00:00:00 │
│ 24 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘

DAILACHDBUD003 :) select * from table_Distributed_ReplicatedMergeTree20231031;
┌─id─┬─────────create_time─┐
│ 23 │ 2020-11-17 00:00:00 │
│ 24 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘
┌─id─┬─────────create_time─┐
│ 21 │ 2020-11-17 00:00:00 │
│ 22 │ 2020-11-17 00:00:00 │
│ 25 │ 2020-11-17 00:00:00 │
│ 26 │ 2020-11-17 00:00:00 │
│ 27 │ 2020-11-17 00:00:00 │
│ 28 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘

1-2节点数据都是如下情况

DAILACHDBUD001 :) select * from table_ReplicatedMergeTree1;
┌─id─┬─────────create_time─┐
│ 23 │ 2020-11-17 00:00:00 │
│ 26 │ 2020-11-17 00:00:00 │
│ 27 │ 2020-11-17 00:00:00 │
│ 28 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘


DAILACHDBUD001 :) select * from table_Distributed_ReplicatedMergeTree1;
┌─id─┬─────────create_time─┐
│ 23 │ 2020-11-17 00:00:00 │
│ 26 │ 2020-11-17 00:00:00 │
│ 27 │ 2020-11-17 00:00:00 │
│ 28 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘
┌─id─┬─────────create_time─┐
│ 21 │ 2020-11-17 00:00:00 │
│ 22 │ 2020-11-17 00:00:00 │
│ 24 │ 2020-11-17 00:00:00 │
│ 25 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘


DAILACHDBUD001 :) select * from table_ReplicatedMergeTree20231031;
┌─id─┬─────────create_time─┐
│ 21 │ 2020-11-17 00:00:00 │
│ 22 │ 2020-11-17 00:00:00 │
│ 25 │ 2020-11-17 00:00:00 │
│ 26 │ 2020-11-17 00:00:00 │
│ 27 │ 2020-11-17 00:00:00 │
│ 28 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘


DAILACHDBUD001 :) select * from table_Distributed_ReplicatedMergeTree20231031;
┌─id─┬─────────create_time─┐
│ 21 │ 2020-11-17 00:00:00 │
│ 22 │ 2020-11-17 00:00:00 │
│ 25 │ 2020-11-17 00:00:00 │
│ 26 │ 2020-11-17 00:00:00 │
│ 27 │ 2020-11-17 00:00:00 │
│ 28 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘
┌─id─┬─────────create_time─┐
│ 23 │ 2020-11-17 00:00:00 │
│ 24 │ 2020-11-17 00:00:00 │
└────┴─────────────────────┘