redis5.0 cluster集群搭建

恬淡虚无真气从之

已于 2023-04-25 22:59:59 修改

阅读量245

点赞数

文章标签： redis 数据库缓存

于 2023-04-25 22:39:34 首次发布

本文链接：https://blog.csdn.net/u012565458/article/details/130375464

版权

1、redis 新建集群，配置文件：

protected-mode yes
port 3000
tcp-backlog 511
timeout 0
tcp-keepalive 300
daemonize yes
supervised no
pidfile /var/run/redis_3000.pid
loglevel notice
logfile /data/redis_node3000/redis_3000.log
databases 16
always-show-logo yes
save 86400 1
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename dump.rdb
dir /data/redis_node3000/
replica-serve-stale-data yes
replica-read-only yes
repl-diskless-sync no
repl-diskless-sync-delay 5
repl-disable-tcp-nodelay no
replica-priority 100
lazyfree-lazy-eviction no
lazyfree-lazy-expire no
lazyfree-lazy-server-del no
replica-lazy-flush no
appendonly no
appendfilename "appendonly.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
aof-load-truncated yes
aof-use-rdb-preamble yes
lua-time-limit 5000
cluster-enabled yes
cluster-config-file nodes-3000.conf
cluster-node-timeout 15000
cluster-replica-validity-factor 0
cluster-migration-barrier 1
cluster-require-full-coverage no
#cluster-replica-no-failover yes
slowlog-log-slower-than 10000
slowlog-max-len 128
latency-monitor-threshold 0
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-size -2
list-compress-depth 0
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
hll-sparse-max-bytes 3000
stream-node-max-bytes 4096
stream-node-max-entries 100
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit replica 256mb 64mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
dynamic-hz yes
aof-rewrite-incremental-fsync yes
rdb-save-incremental-fsync yes
maxmemory 4294967296
maxmemory-policy volatile-lru
bind 0.0.0.0

2、cluster meet 加入集群：

root@orc_test01:/data$ redis-cli -p 3000
127.0.0.1:3000>  cluster meet 10.21.108.174 3001
OK
127.0.0.1:3000>  cluster meet 10.21.108.174 3002
OK
127.0.0.1:3000>  cluster meet 10.21.108.174 3003
OK

3、现在没有分配slot:

root@orc_test01:/data/redis_node3000$ redis-cli --cluster check 10.21.108.174:3000
10.21.108.174:3000 (56d166a1...) -> 0 keys | 0 slots | 0 slaves.
10.21.108.174:3002 (d12ef76b...) -> 0 keys | 0 slots | 0 slaves.
10.21.108.174:3001 (c9dd9271...) -> 0 keys | 0 slots | 0 slaves.
10.21.108.174:3003 (992ff608...) -> 0 keys | 0 slots | 0 slaves.
[OK] 0 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 10.21.108.174:3000)
M: 56d166a1c902c1acd3fa639a138c6e74f34c56ed 10.21.108.174:3000
   slots: (0 slots) master
M: d12ef76bef53d4994e9a6e3962f04b001316aedf 10.21.108.174:3002
   slots: (0 slots) master
M: c9dd9271f86419febbc2db71f2989869e8471d98 10.21.108.174:3001
   slots: (0 slots) master
M: 992ff608810f25806640f2746b241b267385ceca 10.21.108.174:3003
   slots: (0 slots) master
[ERR] Nodes don't agree about configuration!
>>> Check for open slots...
>>> Check slots coverage...
[ERR] Not all 16384 slots are covered by nodes.

4、分配slot:

redis-cli -h 10.21.108.174 -p 3000 cluster addslots {0..16383}

5.查看分配slot后状态：

root@orc_test01:/data/redis_node3000$ redis-cli --cluster check 10.21.108.174:3000
10.21.108.174:3000 (56d166a1...) -> 0 keys | 16384 slots | 0 slaves.
10.21.108.174:3002 (d12ef76b...) -> 0 keys | 0 slots | 0 slaves.
10.21.108.174:3001 (c9dd9271...) -> 0 keys | 0 slots | 0 slaves.
10.21.108.174:3003 (992ff608...) -> 0 keys | 0 slots | 0 slaves.
[OK] 0 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 10.21.108.174:3000)
M: 56d166a1c902c1acd3fa639a138c6e74f34c56ed 10.21.108.174:3000
   slots:[0-16383] (16384 slots) master
M: d12ef76bef53d4994e9a6e3962f04b001316aedf 10.21.108.174:3002
   slots: (0 slots) master
M: c9dd9271f86419febbc2db71f2989869e8471d98 10.21.108.174:3001
   slots: (0 slots) master
M: 992ff608810f25806640f2746b241b267385ceca 10.21.108.174:3003
   slots: (0 slots) master
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.

6、分配slot后，重新平衡slot( 参数--cluster-use-empty-masters是让空的节点也要分配slot)

redis-cli --cluster rebalance 10.21.108.174:3000   --cluster-use-empty-masters

7、查看集群正常：

7.1 slot分配正常:

root@orc_test01:/data/redis_node3000$ redis-cli --cluster check 10.21.108.174:3000
10.21.108.174:3000 (56d166a1...) -> 0 keys | 4096 slots | 0 slaves.
10.21.108.174:3002 (d12ef76b...) -> 0 keys | 4096 slots | 0 slaves.
10.21.108.174:3001 (c9dd9271...) -> 0 keys | 4096 slots | 0 slaves.
10.21.108.174:3003 (992ff608...) -> 0 keys | 4096 slots | 0 slaves.
[OK] 0 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 10.21.108.174:3000)
M: 56d166a1c902c1acd3fa639a138c6e74f34c56ed 10.21.108.174:3000
   slots:[12288-16383] (4096 slots) master
M: d12ef76bef53d4994e9a6e3962f04b001316aedf 10.21.108.174:3002
   slots:[0-4095] (4096 slots) master
M: c9dd9271f86419febbc2db71f2989869e8471d98 10.21.108.174:3001
   slots:[4096-8191] (4096 slots) master
M: 992ff608810f25806640f2746b241b267385ceca 10.21.108.174:3003
   slots:[8192-12287] (4096 slots) master
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.

7.2 cluster_state 状态正常

127.0.0.1:3000> cluster info
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:4
cluster_size:4
cluster_current_epoch:6
cluster_my_epoch:1
cluster_stats_messages_ping_sent:2424
cluster_stats_messages_pong_sent:2550
cluster_stats_messages_meet_sent:3
cluster_stats_messages_sent:4977
cluster_stats_messages_ping_received:2550
cluster_stats_messages_pong_received:2427
cluster_stats_messages_received:4977

8.添加从节点

redis-cli --cluster add-node 10.21.108.174:3004 10.21.108.174:3000 --cluster-slave --cluster-master-id 56d166a1c902c1acd3fa639a138c6e74f34c56ed

注意：1、第一个ip是新加从节点：10.21.108.174:3004

2、第二个ip是原有主节点：10.21.108.174:3000

9. 查看集群slot信息，从节点已经加上：

root@orc_test01:/data/redis_node3000$ redis-cli --cluster check 10.21.108.174:3000
10.21.108.174:3000 (56d166a1...) -> 0 keys | 4096 slots | 1 slaves.
10.21.108.174:3002 (d12ef76b...) -> 0 keys | 4096 slots | 0 slaves.
10.21.108.174:3003 (992ff608...) -> 0 keys | 4096 slots | 0 slaves.
10.21.108.174:3001 (c9dd9271...) -> 0 keys | 4096 slots | 0 slaves.
[OK] 0 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 10.21.108.174:3000)
M: 56d166a1c902c1acd3fa639a138c6e74f34c56ed 10.21.108.174:3000
   slots:[12288-16383] (4096 slots) master
   1 additional replica(s)
M: d12ef76bef53d4994e9a6e3962f04b001316aedf 10.21.108.174:3002
   slots:[0-4095] (4096 slots) master
S: 96b52d892e448549b63a39f131201044eb336b9c 10.21.108.174:3004
   slots: (0 slots) slave
   replicates 56d166a1c902c1acd3fa639a138c6e74f34c56ed
M: 992ff608810f25806640f2746b241b267385ceca 10.21.108.174:3003
   slots:[8192-12287] (4096 slots) master
M: c9dd9271f86419febbc2db71f2989869e8471d98 10.21.108.174:3001
   slots:[4096-8191] (4096 slots) master
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.