Redis Cluster线上扩容

最新推荐文章于 2022-04-11 22:11:12 发布
最新推荐文章于 2022-04-11 22:11:12 发布
阅读量1.3k 收藏 5
点赞数 1
文章标签： redis java
原文链接：https://www.jianshu.com/p/15ec6e870f2d
版权

前言： 很多文章及自带管理工具都是免密码扩容，但是线上环境怎么能少了密码呢。以下为针对带密码集群扩容的探索：

概念

去中心、去中间件，各节点平等，保存各自数据和集群状态，节点间活跃互连。

传统用一致性哈希分配数据，集群用哈希槽（hash slot）分配。 算法为CRC16。

默认分配16384个slot， 用CRC16算法取模{ CRC16(key)%16384 }计算所属slot。

最少3个主节点

migrating 与 importing

默认slots分配

image.png

部署

ruby:

yum:

/opt/rh/${RUBY_VERSION}
}/root/usr/local/share/gems/gems/${GEM_REDIS_VERSION}/lib/redis/client.rb
修改 password => nil 为 password => "abc123"

编译：

创建

redis-trib.rb create --replicas 1 172.20.133.39:7701 172.20.133.39:7702 172.20.133.39:7703 172.20.133.39:7704 172.20.133.39:7705 172.20.133.39:7706

[root@asiskskek ~]# ./redis-trib.rb create --password abc123 --replicas 1 172.20.133.39:7701 172.20.133.39:7702 172.20.133.39:7703 172.20.133.39:7704 172.20.133.39:7705 172.20.133.39:7706
>>> Creating cluster
>>> Performing hash slots allocation on 6 nodes...
Using 3 masters:
172.20.133.39:7701
172.20.133.39:7702
172.20.133.39:7703
Adding replica 172.20.133.39:7704 to 172.20.133.39:7701
Adding replica 172.20.133.39:7705 to 172.20.133.39:7702
Adding replica 172.20.133.39:7706 to 172.20.133.39:7703
M: c76f037234f873f69b3dff981b82e37b7e98b7b2 172.20.133.39:7701
   slots:0-5460 (5461 slots) master
M: d2f155f3ea1506c9ac26c39b78925cd31278da67 172.20.133.39:7702
   slots:5461-10922 (5462 slots) master
M: 3af53debec41cf4ddace3f568538e0e5062d11a2 172.20.133.39:7703
   slots:10923-16383 (5461 slots) master
S: 12659ccc59a3b4e28a9cbbc978f19a79fdee0fdd 172.20.133.39:7704
   replicates c76f037234f873f69b3dff981b82e37b7e98b7b2
S: 87a3f5546ed9d8000e725edc7ebd879e219d351b 172.20.133.39:7705
   replicates d2f155f3ea1506c9ac26c39b78925cd31278da67
S: c61a72b37f25542f5eaa257211a31b512d763a03 172.20.133.39:7706
   replicates 3af53debec41cf4ddace3f568538e0e5062d11a2
Can I set the above configuration? (type 'yes' to accept): yes
>>> Nodes configuration updated
>>> Assign a different config epoch to each node
>>> Sending CLUSTER MEET messages to join the cluster
Waiting for the cluster to join..
>>> Performing Cluster Check (using node 172.20.133.39:7701)
M: c76f037234f873f69b3dff981b82e37b7e98b7b2 172.20.133.39:7701
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 3af53debec41cf4ddace3f568538e0e5062d11a2 172.20.133.39:7703
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: 87a3f5546ed9d8000e725edc7ebd879e219d351b 172.20.133.39:7705
   slots: (0 slots) slave
   replicates d2f155f3ea1506c9ac26c39b78925cd31278da67
S: 12659ccc59a3b4e28a9cbbc978f19a79fdee0fdd 172.20.133.39:7704
   slots: (0 slots) slave
   replicates c76f037234f873f69b3dff981b82e37b7e98b7b2
S: c61a72b37f25542f5eaa257211a31b512d763a03 172.20.133.39:7706
   slots: (0 slots) slave
   replicates 3af53debec41cf4ddace3f568538e0e5062d11a2
M: d2f155f3ea1506c9ac26c39b78925cd31278da67 172.20.133.39:7702
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
[root@asiskskek ~]#

维护

1. 配置优化

timeout = 3000
cluster-node-timeout 3000

慢日志记录

2. 分析统计

集群管理工具

  1. 官方自带 redis-trib.rb
  2. 半支持认证版：

下载地址： https://github.com/otherpirate/redis/blob/382867aaafeffcdd542688df49e8a1518e9738b5/src/redis-trib.rb

pr地址：
https://github.com/antirez/redis/pull/4288

redis-trib.rb command --password thepw xxxx

分析dump文件及内存使用量

https://github.com/sripathikrishnan/redis-rdb-tools

性能分析工具

https://github.com/facebookarchive/redis-faina.git

redis-cli -c -h 172.20.133.39 -p 7701 -a abc123 MONITOR | head -10000 | ./redis-faina.py --redis-version=3.0 >faina-date +"%Y%m%d_%H%M%S".txt

时间分析能力有限：由于是通过请求开始时间和下个请求开始时间间隔计算请求执行时间，并不精确，特别是请求量很少的时候

3. 命令防身：

cluster 命令

CLUSTER INFO   # 打印集群的信息
CLUSTER NODES   # 列出集群当前已知的所有节点(node),以及这些节点的相关信息。

节点

CLUSTER MEET <ip> <port>   # 将 ip 和 port 所指定的节点添加到集群当中，让它成为集群的一份子。
CLUSTER FORGET <node_id>   # 从集群中移除 node_id 指定的节点。
CLUSTER REPLICATE <node_id>   # 将当前节点设置为 node_id 指定的节点的从节点。
CLUSTER SAVECONFIG   # 将节点的配置文件保存到硬盘里面。
CLUSTER ADDSLOTS <slot> [slot ...]   # 将一个或多个槽（slot）指派（assign）给当前节点。
CLUSTER DELSLOTS <slot> [slot ...]   # 移除一个或多个槽对当前节点的指派。
CLUSTER FLUSHSLOTS   # 移除指派给当前节点的所有槽，让当前节点变成一个没有指派任何槽的节点。
CLUSTER SETSLOT <slot> NODE <node_id>   # 将槽 slot 指派给 node_id 指定的节点。
CLUSTER SETSLOT <slot> MIGRATING <node_id>   # 将本节点的槽 slot 迁移到 node_id 指定的节点中。
CLUSTER SETSLOT <slot> IMPORTING <node_id>   # 从 node_id 指定的节点中导入槽 slot 到本节点。
CLUSTER SETSLOT <slot> STABLE   # 取消对槽 slot 的导入（import）或者迁移（migrate）。

键

CLUSTER KEYSLOT <key>   # 计算键 key 应该被放置在哪个槽上。
CLUSTER COUNTKEYSINSLOT <slot>   # 返回槽 slot 目前包含的键值对数量。
CLUSTER GETKEYSINSLOT <slot> <count>   # 返回 count 个 slot 槽中的键。

新增

CLUSTER SLAVES node-id   # 返回一个master节点的slaves 列表
  • 查看集群节点情况
redis-cli -c -h 172.20.133.39 -p 7701 -a abc123 cluster nodes
  • 添加master节点：
redis-trib.rb add-node 172.20.133.39:7706(新节点) 172.20.133.39:7701(已有节点)
  • 添加slave节点
redis-trib.rb add-node --slave --master-id xxxxxx  172.20.133.37:7707(添加slave) 172.20.133.37:7701(已有节点)
  • 删除节点
redis-trib.rb del-node 172.20.133.37:7701(已有节点)  172.20.133.37:7707(删除节点)
  • 迁移：
redis-trib.rb reshard 172.20.133.39:7701
4096
id
all
  • 删除槽
redis-cli -c -h 172.20.133.39 -p 7701 -a abc123 cluster delslots 5461

在线扩容

核心概念：

扩容的核心就是迁移slot并同步迁移key-value，不管是用工具还是集群命令，核心都是以下几步:

> 在迁移目的节点执行cluster setslot <slot> IMPORTING <node ID>命令，指明需要迁移的slot和迁移源节点。
> 在迁移源节点执行cluster setslot <slot> MIGRATING <node ID>命令，指明需要迁移的slot和迁移目的节点。
> 在迁移源节点执行cluster getkeysinslot获取该slot的key列表。
> 在迁移源节点执行对每个key执行migrate命令，该命令会同步把该key迁移到目的节点。
> 在迁移源节点反复执行cluster getkeysinslot命令，直到该slot的列表为空。
> 在迁移源节点和目的节点执行cluster setslot <slot> NODE <node ID>，完成迁移操作。

前提:

迁移与redis版本及是否开启认证有关：
1. 未开启认证，任何方式都可以
2. 开启认证，只有4.0.7之后的版本支持migrate auth
3. 最新稳定版4.0.9的redis-trib.rb未支持migrate auth，坊间未找到支持版，这是个给redis贡献代码的机会😄
4. 有密码最简单的扩容办法就是迁移的时候去掉密码,前提是业务代码要支持，去掉密码能正常使用。想折腾就写脚本实现带密码用集群命令实现，见附4

https://github.com/antirez/redis/commit/47717222b64b9437b12d76f39ac694f7454e3c7c

本次commit之后开始支持 cluster migate auth，但是好像忘了更新redis-trib.rb，应该用不了多久就会支持

image

1. 环境：

  • Centos 6.8
  • Redis 4.0.9 ---- { redis version(<4.0.7) doesn't support migrate command in the cluster with auth mode }
  • Ruby 2.0.5
  • redis gem 3.3.3 ---- { 要小于4.0 版本，否则会报：[ERR] Calling MIGRATE: ERR Syntax error, try CLIENT (LIST | KILL ip:port | GETNAME | SETNAME connection-name) ，但是 v3.3.3 don't support redis cluter with password }

2. 扩容过程：

2.1. 添加节点

  • 添加master节点：

将7707添加进集群

redis-trib.rb add-node 172.20.133.39:7707 172.20.133.39:7701

[root@asiskskek ~]# ./redis-trib.rb add-node --password abc123 172.20.133.39:7707 172.20.133.39:7701
>>> Adding node 172.20.133.39:7707 to cluster 172.20.133.39:7701
>>> Performing Cluster Check (using node 172.20.133.39:7701)
M: c76f037234f873f69b3dff981b82e37b7e98b7b2 172.20.133.39:7701
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 3af53debec41cf4ddace3f568538e0e5062d11a2 172.20.133.39:7703
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: 87a3f5546ed9d8000e725edc7ebd879e219d351b 172.20.133.39:7705
   slots: (0 slots) slave
   replicates d2f155f3ea1506c9ac26c39b78925cd31278da67
S: 12659ccc59a3b4e28a9cbbc978f19a79fdee0fdd 172.20.133.39:7704
   slots: (0 slots) slave
   replicates c76f037234f873f69b3dff981b82e37b7e98b7b2
S: c61a72b37f25542f5eaa257211a31b512d763a03 172.20.133.39:7706
   slots: (0 slots) slave
   replicates 3af53debec41cf4ddace3f568538e0e5062d11a2
M: d2f155f3ea1506c9ac26c39b78925cd31278da67 172.20.133.39:7702
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
>>> Send CLUSTER MEET to node 172.20.133.39:7707 to make it join the cluster.
[OK] New node added correctly.
[root@asiskskek ~]#
  • 检查集群状态
[root@asiskskek ~]# ./redis-trib.rb check --password abc123 172.20.133.39:7701    
>>> Performing Cluster Check (using node 172.20.133.39:7701)
M: c76f037234f873f69b3dff981b82e37b7e98b7b2 172.20.133.39:7701
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 3af53debec41cf4ddace3f568538e0e5062d11a2 172.20.133.39:7703
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: 87a3f5546ed9d8000e725edc7ebd879e219d351b 172.20.133.39:7705
   slots: (0 slots) slave
   replicates d2f155f3ea1506c9ac26c39b78925cd31278da67
M: c713e819cf41b1c79faab18c93398c510dfc314d 172.20.133.39:7707
   slots: (0 slots) master
   0 additional replica(s)
S: 12659ccc59a3b4e28a9cbbc978f19a79fdee0fdd 172.20.133.39:7704
   slots: (0 slots) slave
   replicates c76f037234f873f69b3dff981b82e37b7e98b7b2
S: c61a72b37f25542f5eaa257211a31b512d763a03 172.20.133.39:7706
   slots: (0 slots) slave
   replicates 3af53debec41cf4ddace3f568538e0e5062d11a2
M: d2f155f3ea1506c9ac26c39b78925cd31278da67 172.20.133.39:7702
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
[root@asiskskek ~]#
  • 添加slave节点

将7707添加进集群作为7706的slave节点

redis-trib.rb add-node --slave --master-id 7707's-id  172.20.133.39:7708 172.20.133.39:7701

[root@asiskskek ~]# ./redis-trib.rb add-node --password abc123 --slave --master-id c713e819cf41b1c79faab18c93398c510dfc314d  172.20.133.39:7708 172.20.133.39:7701
>>> Adding node 172.20.133.39:7708 to cluster 172.20.133.39:7701
>>> Performing Cluster Check (using node 172.20.133.39:7701)
M: c76f037234f873f69b3dff981b82e37b7e98b7b2 172.20.133.39:7701
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 3af53debec41cf4ddace3f568538e0e5062d11a2 172.20.133.39:7703
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: 87a3f5546ed9d8000e725edc7ebd879e219d351b 172.20.133.39:7705
   slots: (0 slots) slave
   replicates d2f155f3ea1506c9ac26c39b78925cd31278da67
M: c713e819cf41b1c79faab18c93398c510dfc314d 172.20.133.39:7707
   slots: (0 slots) master
   0 additional replica(s)
S: 12659ccc59a3b4e28a9cbbc978f19a79fdee0fdd 172.20.133.39:7704
   slots: (0 slots) slave
   replicates c76f037234f873f69b3dff981b82e37b7e98b7b2
S: c61a72b37f25542f5eaa257211a31b512d763a03 172.20.133.39:7706
   slots: (0 slots) slave
   replicates 3af53debec41cf4ddace3f568538e0e5062d11a2
M: d2f155f3ea1506c9ac26c39b78925cd31278da67 172.20.133.39:7702
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
>>> Send CLUSTER MEET to node 172.20.133.39:7708 to make it join the cluster.
Waiting for the cluster to join.
>>> Configure node as replica of 172.20.133.39:7707.
[OK] New node added correctly.
[root@asiskskek ~]#

2.2. 迁移槽位

如果有密码认证，先批量去掉密码，附2

redis-trib.rb reshard 172.20.133.39:7701
4096 (分配给新master的slots数)
masterid
all

[root@asiskskek ~]# ./redis-trib.rb reshard --password abc123 172.20.133.39:7701 
>>> Performing Cluster Check (using node 172.20.133.39:7701)
M: c76f037234f873f69b3dff981b82e37b7e98b7b2 172.20.133.39:7701
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 3af53debec41cf4ddace3f568538e0e5062d11a2 172.20.133.39:7703
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: 87a3f5546ed9d8000e725edc7ebd879e219d351b 172.20.133.39:7705
   slots: (0 slots) slave
   replicates d2f155f3ea1506c9ac26c39b78925cd31278da67
M: c713e819cf41b1c79faab18c93398c510dfc314d 172.20.133.39:7707
   slots: (0 slots) master
   1 additional replica(s)
S: 12659ccc59a3b4e28a9cbbc978f19a79fdee0fdd 172.20.133.39:7704
   slots: (0 slots) slave
   replicates c76f037234f873f69b3dff981b82e37b7e98b7b2
S: d0fb6ebab8ea6d795917f5b0a385ff2736e7c9b9 172.20.133.39:7708
   slots: (0 slots) slave
   replicates c713e819cf41b1c79faab18c93398c510dfc314d
S: c61a72b37f25542f5eaa257211a31b512d763a03 172.20.133.39:7706
   slots: (0 slots) slave
   replicates 3af53debec41cf4ddace3f568538e0e5062d11a2
M: d2f155f3ea1506c9ac26c39b78925cd31278da67 172.20.133.39:7702
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 4096  <=====
What is the receiving node ID? c713e819cf41b1c79faab18c93398c510dfc314d  
Please enter all the source node IDs.
  Type 'all' to use all the nodes as source nodes for the hash slots.
  Type 'done' once you entered all the source nodes IDs.
Source node #1:all      <=====

Ready to move 4096 slots.
  Source nodes:
    M: c76f037234f873f69b3dff981b82e37b7e98b7b2 172.20.133.39:7701
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
    M: 3af53debec41cf4ddace3f568538e0e5062d11a2 172.20.133.39:7703
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
    M: d2f155f3ea1506c9ac26c39b78925cd31278da67 172.20.133.39:7702
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
  Destination node:
    M: c713e819cf41b1c79faab18c93398c510dfc314d 172.20.133.39:7707
   slots: (0 slots) master
   1 additional replica(s)
  Resharding plan:
    Moving slot 5461 from d2f155f3ea1506c9ac26c39b78925cd31278da67
    Moving slot 5462 from d2f155f3ea1506c9ac26c39b78925cd31278da67
    ...
    Moving slot 6825 from d2f155f3ea1506c9ac26c39b78925cd31278da67
    Moving slot 6826 from d2f155f3ea1506c9ac26c39b78925cd31278da67
    Moving slot 0 from c76f037234f873f69b3dff981b82e37b7e98b7b2
    Moving slot 1 from c76f037234f873f69b3dff981b82e37b7e98b7b2
    ...
    Moving slot 1363 from c76f037234f873f69b3dff981b82e37b7e98b7b2
    Moving slot 1364 from c76f037234f873f69b3dff981b82e37b7e98b7b2
    Moving slot 10923 from 3af53debec41cf4ddace3f568538e0e5062d11a2
    Moving slot 10924 from 3af53debec41cf4ddace3f568538e0e5062d11a2
    ...
    Moving slot 12286 from 3af53debec41cf4ddace3f568538e0e5062d11a2
    Moving slot 12287 from 3af53debec41cf4ddace3f568538e0e5062d11a2
Do you want to proceed with the proposed reshard plan (yes/no)? yes
Moving slot 5461 from 172.20.133.39:7702 to 172.20.133.39:7707: 
Moving slot 5462 from 172.20.133.39:7702 to 172.20.133.39:7707: 
...
Moving slot 6825 from 172.20.133.39:7702 to 172.20.133.39:7707: 
Moving slot 6826 from 172.20.133.39:7702 to 172.20.133.39:7707: 
Moving slot 0 from 172.20.133.39:7701 to 172.20.133.39:7707: 
Moving slot 1 from 172.20.133.39:7701 to 172.20.133.39:7707: 
...
Moving slot 1363 from 172.20.133.39:7701 to 172.20.133.39:7707: 
Moving slot 1364 from 172.20.133.39:7701 to 172.20.133.39:7707: 
Moving slot 10923 from 172.20.133.39:7703 to 172.20.133.39:7707: 
Moving slot 10924 from 172.20.133.39:7703 to 172.20.133.39:7707: 
...
Moving slot 12286 from 172.20.133.39:7703 to 172.20.133.39:7707: 
Moving slot 12287 from 172.20.133.39:7703 to 172.20.133.39:7707: 
[root@asiskskek ~]#
  • 检查集群状态
[root@asiskskek ~]# ./redis-trib.rb check --password abc123 172.20.133.39:7701        
>>> Performing Cluster Check (using node 172.20.133.39:7701)
M: c76f037234f873f69b3dff981b82e37b7e98b7b2 172.20.133.39:7701
   slots:1365-5460 (4096 slots) master
   1 additional replica(s)
M: 3af53debec41cf4ddace3f568538e0e5062d11a2 172.20.133.39:7703
   slots:12288-16383 (4096 slots) master
   1 additional replica(s)
S: 87a3f5546ed9d8000e725edc7ebd879e219d351b 172.20.133.39:7705
   slots: (0 slots) slave
   replicates d2f155f3ea1506c9ac26c39b78925cd31278da67
M: c713e819cf41b1c79faab18c93398c510dfc314d 172.20.133.39:7707
   slots:0-1364,5461-6826,10923-12287 (4096 slots) master
   1 additional replica(s)
S: 12659ccc59a3b4e28a9cbbc978f19a79fdee0fdd 172.20.133.39:7704
   slots: (0 slots) slave
   replicates c76f037234f873f69b3dff981b82e37b7e98b7b2
S: d0fb6ebab8ea6d795917f5b0a385ff2736e7c9b9 172.20.133.39:7708
   slots: (0 slots) slave
   replicates c713e819cf41b1c79faab18c93398c510dfc314d
S: c61a72b37f25542f5eaa257211a31b512d763a03 172.20.133.39:7706
   slots: (0 slots) slave
   replicates 3af53debec41cf4ddace3f568538e0e5062d11a2
M: d2f155f3ea1506c9ac26c39b78925cd31278da67 172.20.133.39:7702
   slots:6827-10922 (4096 slots) master
   1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
[root@asiskskek ~]#

异常处理：

1. gem install redis

ERROR: Loading command: install (LoadError)
cannot load such file -- zlib
ERROR: While executing gem ... (NoMethodError)
undefined method `invoke_with_build_args' for nil:NilClass

解决：

编译安装的ruby缺少库文件，从ruby源码编译安装：
ruby目录：
cd ext/zlib
修改Makefile：
$(top_srcdir)/include/ruby.h  -->  zlib.o: ../../include/ruby.h
ruby extconf.rb
make && make install
如果有openssl 报错，处理方法类似：
Makefile 添加 top_srcdir = ../..

2. redis-trib.rb xxx

  1.  

[WARNING] Node 172.20.133.39:7701 has slots in migrating state (0).
[WARNING] Node 172.20.133.39:7709 has slots in importing state (0).
[WARNING] The following slots are open: 0

解决：

redis-cli -h 172.20.133.39 -p 7701 -a abc123 cluster setslot 0 stable
redis-cli -h 172.20.133.39 -p 7709 -a abc123 cluster setslot 0 stable
  1.  

[ERR] Calling MIGRATE: ERR Syntax error, try CLIENT (LIST | KILL ip:port | GETNAME | SETNAME connection-name)

解决:

需小于4.0的版本

gem uninstall redis
gem install redis -v 3.3.3

3. redis-trib reshard ip:port

  • 认证失败

Do you want to proceed with the proposed reshard plan (yes/no)? yes
Moving slot 1365 from 172.20.133.39:7701 to 172.20.133.39:7705:
[ERR] ERR Target instance replied with error: NOAUTH Authentication required.

解决：

目前只能去掉密码

redis-cli -c -h 172.20.133.39 -p $i -a abc123 config set masterauth ""
redis-cli -c -h 172.20.133.39 -p $i -a abc123 config set requirepass ""
见附2

4. redis-trib reshard --password thepw ip:port

  • 语法错误

Do you want to proceed with the proposed reshard plan (yes/no)? yes
Moving slot 1365 from 172.20.133.39:7701 to 172.20.133.39:7705:
[ERR] Calling MIGRATE: ERR syntax error

附：

脚本：

1. 批量向redis插入数据：

    1. 单shell脚本版：
#!/bin/bash
for ((i=0;i<1000000;i++))
do
echo -en "hello" | redis-cli -c -h 172.20.133.39 -p 7701 -a coocaa set name$i $i >> keyset.log
done
    1. pipeline方式，高效版：
#!/usr/bin/python
for i in range(1000000):
    print 'set name'+str(i),'helloworld'

python 1.py > redis_commands.txt

#!/bin/bash

while read CMD; do
  # each command begins with *{number arguments in command}\r\n
  XS=($CMD); printf "*${#XS[@]}\r\n"
  # for each argument, we append ${length}\r\n{argument}\r\n
  for X in $CMD; do printf "\$${#X}\r\n$X\r\n"; done
done < redis_commands.txt

bash 2.sh > redis_data.txt

cat redis_data.txt | redis-cli -c -h 172.20.133.39 -p 7701 -a abc123 --pipe

集群需要连每个master执行一遍。

2. 批量密码操作

#!/bin/bash
for ((i=7701;i<7713;i++))
do
# 增加认证
redis-cli -c -h 172.20.133.39 -p $i -a abc123 config set masterauth abc123
redis-cli -c -h 172.20.133.39 -p $i -a abc123 config set requirepass abc123
# 取消认证
#redis-cli -c -h 172.20.133.39 -p $i -a abc123 config set masterauth ""
#redis-cli -c -h 172.20.133.39 -p $i -a abc123 config set requirepass ""
done

3.redis重启脚本

#!/bin/sh

#
# Simple Redis init.d script conceived to work on Linux systems
# as it does use of the /proc filesystem.

REDISPORT=7701
EXEC=/usr/local/bin/redis-server
CLIEXEC=/usr/local/bin/redis-cli

PIDFILE=/tmp/redis_${REDISPORT}.pid
CONF="/etc/redis/${REDISPORT}.conf"

case "$1" in
    start)
        if [ -f $PIDFILE ]
        then
                echo "$PIDFILE exists, process is already running or crashed"
        else
                echo "Starting Redis server..."
                $EXEC $CONF
        fi
        ;;
    stop)
        if [ ! -f $PIDFILE ]
        then
                echo "$PIDFILE does not exist, process is not running"
        else
                PID=$(cat $PIDFILE)
                echo "Stopping ..."
                $CLIEXEC -p $REDISPORT -a abc123 -h 172.20.133.39 shutdown
                while [ -x /proc/${PID} ]
                do
                    echo "Waiting for Redis to shutdown ..."
                    sleep 1
                done
                echo "Redis stopped"
        fi
        ;;
    *)
        echo "Please use start or stop as first argument"
        ;;
esac

4.redis迁移脚本

#!/bin/bash
source_ip=$1
source_port=$2
target_ip=$3
target_port=$4
startSlot=$5
endSlot=$6
password=$7

#目标节点执行importing命令，目标节点将从源节点迁移slot

for slot in `seq ${startSlot} ${endSlot}`  
do  
    redis-cli -c -h ${target_ip} -p ${target_port} -a ${password} cluster setslot ${slot} IMPORTING `redis-cli -c -h ${source_ip} -p ${source_port} -a ${password} cluster nodes | grep ${source_ip} | grep ${source_port} | awk '{print $1}'`  
done

#源节点执行migrating命令，源节点将向目标节点迁移slot

for slot in `seq ${startSlot} ${endSlot}`  
do  
    redis-cli -c -h ${source_ip} -p ${source_port} -a ${password} cluster setslot ${slot} MIGRATING `redis-cli -c -h ${source_ip} -p ${source_port} -a ${password} cluster nodes | grep ${target_ip} | grep ${target_port} | awk '{print $1}'`  
done


for slot in `seq ${startSlot} ${endSlot}`  
do  
    while [ 1 -eq 1 ]  
    do  

#源节点执行getkeysinslot命令，从slot中取出count个键值对的key

        allkeys=`redis-cli -c -h ${source_ip} -p ${source_port} -a ${password} cluster getkeysinslot ${slot} 20`  
#        if [ !-z ${allkeys} ]  
        if [ -z "${allkeys}" ]
        then  

#源节点和目标节点执行setslot命令，将slot分配给目标节点

            redis-cli -c -h ${source_ip} -p ${source_port} -a ${password} cluster setslot ${slot} NODE `redis-cli -c -h ${source_ip} -p ${source_port} -a ${password} cluster nodes | grep ${target_ip} | grep ${target_port} | awk '{print $1}'`  
            redis-cli -c -h ${target_ip} -p ${target_port} -a ${password} cluster setslot ${slot} NODE `redis-cli -c -h ${source_ip} -p ${source_port} -a ${password} cluster nodes | grep ${target_ip} | grep ${target_port} | awk '{print $1}'`  
            break  
        else  
            for key in ${allkeys}  
            do  
                echo "slot ${slot} key ${key}"  

#源节点执行migrate命令，将key迁移到目标节点

                redis-cli -c -h ${source_ip} -p ${source_port} -a ${password} MIGRATE ${target_ip} ${target_port} ${key} 0 5000 AUTH ${password}
            done  
        fi
    done
done

 

走在小路
关注
  • 1
    点赞
  • 踩
  • 5
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
redis集群扩容和缩容_redis集群cluster搭建，扩容缩容
weixin_28683065的博客
02-11 363
1. 概要说明1.1. 概述本文旨在说明平台部署环境搭建的过程和详细步骤说明，为后面系统部署提供清晰的参考依照。以下搭建部署的环境，为一个小型的分布式集群环境。满足负载均衡和单点故障转移，支持动态增减服务器等功能。后续平台的部署都可参考此搭建过程扩充。1.2. 环境清单系统：Red Hat Enterprise Linux Server release 6.5 (Santiago...
redis集群（Sharding）和在线扩容（Pre-Sharding）
CTO成长之路——Rosanu
03-29 9628
redis集群分为服务端集群和客户端分片，redis3.0以上版本实现了集群机制，即服务端集群，3.0以下使用客户端分片（Sharding）。redis3.0服务端集群使用哈希槽，计算key的CRC16结果再模16834。3.0以下版本采用Key的一致性hash算法来区分key存储在哪个Redis实例上。 JedisPoolConfig config = new JedisPoolCon
Redis Cluster 部署、在线扩容、缩容、迁移、集群管理实践
star8521的专栏
11-28 777
概述 Redis 分片集群是为了应对业务增长带来的数据增长, 实现在线动态横向扩缩容，集群中的每个分片主节点处理 16384 个哈希槽的一个子集; 为了稳定也可以进行高可用部署, 即将各分片节点启用一个或多个副本节点; 当分片主节点挂掉,其对应的副本节点自动提升为新主节点,当原主节点重新上线后,自动成为新主节点的副本节点; 当一对分片主从节点都故障时,整个集群不能正常工作，需要人工介入恢复启动故障节点 分片集群 1、创建一个有 3 个分片节点的集群 # 创建具有 3 个分片节点的集群、每个分片有
Redis cluster 扩容
lixiaolinzq的博客
05-21 675
Redis cluster扩容的方法 redis cluster的主从默认只有主支持读和写，从库默认只是 一个热备，不负责任何的读写请求，只是在主库挂掉之后，会被选举成为主库，然后承担主库的责任； 所以，cluster的扩容是先创建一个主库，然后把槽再次平分，接着做数据迁移，当数据迁移完成后，再创建一个从库，把新主库的数据同步一份过去即可。 具体操作如下： 1.创建新主库，并且启动 2.重新计算slot，slot重分 ...
redis cluster集群搭建及扩容
零一的博客
07-19 386
阿里云Centos7.4redis5.05端口号分别为：7001~7006RedisCluster最少需要三台主服务器，三台从服务器。
codis/redis 迁移redis cluster工具
08-18
Codis到Redis Cluster的迁移工具支持将已经在Codis集群中的数据平滑迁移到Redis Cluster，无需停机，保证业务的连续性。同样，它也支持从Redis迁移到Codis，以及在Redis实例之间进行迁移，这些功能使得数据管理更具...
Redis高可用集群Redis Cluster搭建
08-18
Redis Cluster 的主要优点是可以实现动态扩容或缩容，提高了系统的灵活性和可扩展性。此外，Redis Cluster 也可以减少冗余，提高内存利用率。 3. Redis Cluster 的实现细节 Redis Cluster 的实现细节是采用了哈希...
redis-cluster-operator:Redis Cluster Operator在Kubernetes上创建和管理Redis集群
05-03
redis-cluster-operator 概述 Redis Cluster Operator在Kubernetes上管理 。 操作员本身是用。 每个主节点及其从节点都由statefulSet管理，为每个statefulSet创建一个无头svc，并为所有节点创建clusterIP服务。 ...
rediscluster配置文件.zip
04-02
这个压缩包文件"rediscluster配置文件.zip"包含了一系列配置文件，用于搭建一个三主三从的Redis Cluster架构。在这个架构中，每个主节点都有一个对应的从节点，确保在主节点失效时可以从其从节点接管服务，从而保持...
rediscluster.rar
05-31
Redis Cluster是Redis官方提供的分布式解决方案，它允许用户在多个节点之间分发数据，从而实现高可用性和水平扩展。本文将详细介绍Redis Cluster的工作原理、配置、使用以及与MySQL数据库的配合。 **一、Redis ...
纯手工打造redis线上生产级别集群
liyingying111111的专栏
12-04 379
环境配置: 三台centos6.5虚拟机 172.20.10.2 172.20.10.3 172.20.10.4 redis: linux版本 redis-3.2.8.tar.gz ruby:ruby-2.6.5.tar.tar 因为集群的启动脚本是基于ruby语言。所以要安装ruby环境。版本不能太低。 tcl: tcl8.6.1-src.tar.gz redis的make命令...
redis-cluster的实例动态调整内存
wuzhan的专栏
03-05 795
可以通过config set xxxx xxxx 来设置redis实例的内存大小，而不需要重启实例。 获取当前最大内存的大小： config get maxmemory 修改内存大小： config set maxmemory 22474836480 ...
Redis集群节点管理（cluster）
Dear_xq 的博客
04-11 3840
Redis集群节点管理（cluster）
Redis Cluster搭建与维护
lxbjkben的博客
09-07 424
1 安装搭建 1.1 Redis安装 1.1.1 下载安装redis mkdir -p /opt/redis-4.0.9 &amp;&amp; cd /opt/redis-4.0.9 wget http://download.redis.io/releases/redis-4.0.9.tar.gz yum install -y gcc g++ gcc-c++ make yum -...
jedis连接redis3.2.9集群密码问题
那又怎样？的博客
04-24 3447
转载来自：https://www.cnblogs.com/snowstar123/p/5696052.html主要想说的是，源码中对于jedis连接redis clsuter没有设置密码，所以会一直报错说NOAUTH认证需要。后来，在改篇文章的评论中有如下：#1楼 2016-12-28 14:21 破壁人  您好按照您的方式进行了修改，但是问题依然出现报错，NOAUTH Authenticatio...
redis-cluster集群部署及测试（超详细）
浴火成诗的博客
10-18 8067
redis-cluster集群部署及测试（超详细），傻瓜式照搬
Python3 操作 Redis(Cluster)及实践(key 前缀)词频统计
SHOWufei
11-07 1935
目录 一、简单介绍 二、安装 Redis 模块 三、Redis 模块基本操作 1、Redis 模块使用分类 2、Redis 使用参考文档 3、Python 操作 Redis 模式 4、数据操作 4.1redisconn.py 4.2redis_key_analysis.py 4.3以下是一些测试结果 一、简单介绍 Redis 是一个 key-value...
jedis处理redis cluster集群的密码问题
weixin_30588675的博客
07-22 1162
环境介绍：jedis：2.8.0 redis版本：3.2 首先说一下redis集群的方式，一种是cluster的 一种是sentinel的，cluster的是redis 3.0之后出来新的集群方式 本身redis3.2的cluster集群是支持密码的 ，具体怎么搭建，可以查找相关的文档，这里只介绍应用层面的操作 jedis2.8.0的版本没有实现对redis cluster...
redis-5.0 cluster带认证及客户端连接
weixin_33714884的博客
11-14 1170
      Redis在3.0版正式引入redis-cluster集群这个特性。Redis集群是一个提供在多个Redis间节点间共享数据的程序集。Redis集群是一个分布式（distributed）、容错（fault-tolerant）的Redis内存K/V服务，集群可以使用的功能是普通单机Redis所能使用的功能的一个子集（subset），比如Redis集群并不支持处理多个keys的命令，因为这...
rediscluster扩容
最新发布
12-16
Redis Cluster扩容可以通过增加节点或增加内存来实现。具体步骤如下： 1. 增加节点 - 准备新节点，确保新节点的Redis版本与集群中的其他节点版本相同。 - 在新节点上配置redis.conf文件，将端口号设置为集群中未...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值