Redis集群搭建

Linux安装Redis

1. 解压Redis安装包

tar -zxvf redis-4.0.11.tar.gz

2. 安装的是redis源码包，所以需要gcc环境支持

yum install gcc-c++

3. 进入解压后的目录进行编译

cd redis-4.0.11/
make PREFIX=/root/redis install

4. redis启动

cd redis
./redis-server 

集群搭建

1. 创建文件夹

集群中 Redis 节点的端口号为 9001-9006 ，端口号即集群下各实例文件夹。数据存放在 端口号/data 文件夹中。

mkdir redis-cluster
cd redis-cluster
mkdir -p 9001/data 9002/data 9003/data 9004/data 9005/data 9006/data
cp /root/redis-4.0.11/* /root/redis-cluster/9001

2. 复制执行脚本

在 /root/redis-cluster 下创建 bin 文件夹，用来存放集群运行脚本，并把安装好的 Redis 的 src 路径下的运行脚本拷贝过来。看命令：

cp mkreleasehdr.sh redis-benchmark redis-check-aof
redis-cli redis-server redis-trib.rb /root/redis-cluster/bin

3. 复制一个新 Redis 实例

从已安装好的 Redis 中复制一个新的实例到 9001 文件夹，并修改redis.conf 配置。

port 9001
daemonize yes
bind 192.168.0.41
dir /root/redis-cluster/9001/data/
pidfile /var/run/redis_9001.pid
cluster-enabled yes
cluster-config-file nodes9001.conf
cluster-node-timeout 15000
appendonly yes

4. 再复制出五个新 Redis 实例

把 9001 实例 复制到另外五个文件夹中，唯一要修改的就是 redis.conf 中的所有和端口的相关的信息即可：

\cp -rf /root/redis-cluster/9001/* /root/redis-cluster/9002
\cp -rf /root/redis-cluster/9001/* /root/redis-cluster/9003
\cp -rf /root/redis-cluster/9001/* /root/redis-cluster/9004
\cp -rf /root/redis-cluster/9001/* /root/redis-cluster/9005
\cp -rf /root/redis-cluster/9001/* /root/redis-cluster/9006

启动集群

1. 启动 9001-9006 六个节点

[root@master redis-cluster]# /root/redis/bin/redis-server /root/redis-cluster/9001/redis.conf 
14061:C 13 Oct 11:45:55.251 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
14061:C 13 Oct 11:45:55.251 # Redis version=4.0.11, bits=64, commit=00000000, modified=0, pid=14061, just started
14061:C 13 Oct 11:45:55.251 # Configuration loaded
[root@master redis-cluster]# /root/redis/bin/redis-server /root/redis-cluster/9002/redis.conf 
14074:C 13 Oct 11:46:13.682 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
14074:C 13 Oct 11:46:13.682 # Redis version=4.0.11, bits=64, commit=00000000, modified=0, pid=14074, just started
14074:C 13 Oct 11:46:13.682 # Configuration loaded
[root@master redis-cluster]# /root/redis/bin/redis-server /root/redis-cluster/9003/redis.conf 
14079:C 13 Oct 11:46:22.100 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
14079:C 13 Oct 11:46:22.100 # Redis version=4.0.11, bits=64, commit=00000000, modified=0, pid=14079, just started
14079:C 13 Oct 11:46:22.100 # Configuration loaded
[root@master redis-cluster]# /root/redis/bin/redis-server /root/redis-cluster/9004/redis.conf 
14084:C 13 Oct 11:46:28.421 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
14084:C 13 Oct 11:46:28.421 # Redis version=4.0.11, bits=64, commit=00000000, modified=0, pid=14084, just started
14084:C 13 Oct 11:46:28.421 # Configuration loaded
[root@master redis-cluster]# /root/redis/bin/redis-server /root/redis-cluster/9005/redis.conf 
14089:C 13 Oct 11:46:34.668 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
14089:C 13 Oct 11:46:34.669 # Redis version=4.0.11, bits=64, commit=00000000, modified=0, pid=14089, just started
14089:C 13 Oct 11:46:34.669 # Configuration loaded
[root@master redis-cluster]# /root/redis/bin/redis-server /root/redis-cluster/9006/redis.conf 
14094:C 13 Oct 11:46:41.725 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
14094:C 13 Oct 11:46:41.726 # Redis version=4.0.11, bits=64, commit=00000000, modified=0, pid=14094, just started
14094:C 13 Oct 11:46:41.726 # Configuration loaded

查看节点启动情况

[root@master redis-cluster]# ps -el | grep redis
5 S     0 14062     1  0  80   0 - 36328 ep_pol ?        00:00:00 redis-server
5 S     0 14075     1  0  80   0 - 36328 ep_pol ?        00:00:00 redis-server
5 S     0 14080     1  0  80   0 - 36328 ep_pol ?        00:00:00 redis-server
5 S     0 14085     1  0  80   0 - 36328 ep_pol ?        00:00:00 redis-server
5 S     0 14090     1  0  80   0 - 36328 ep_pol ?        00:00:00 redis-server
5 S     0 14095     1  0  80   0 - 36328 ep_pol ?        00:00:00 redis-server

2. 安装集群所需软件

yum install ruby
yum install rubygems
gem install redis 

3. 执行启动集群的命令

/root/redis-cluster/bin/redis-trib.rb create --replicas 1 192.168.0.41:9001 192.168.0.41:9002 192.168.0.41:9003 192.168.0.41:9004 192.168.0.41:9005 192.168.0.41:9006

执行效果

简单解释一下这个命令：调用 ruby 命令来进行创建集群，–replicas 1 表示主从复制比例为 1:1，即一个主节点对应一个从节点；然后，默认给我们分配好了每个主节点和对应从节点服务，以及 solt 的大小，因为在 Redis 集群中有且仅有 16383 个 solt ，默认情况会给我们平均分配，当然你可以指定，后续的增减节点也可以重新分配。

M: 4ea3333c702741b4aeaa304e808c7d32dd6ee3f0 为主节点Id

S: 067c67204c4db6c12b4dc349a29ad76793e43bf3 192.168.0.41:9006
replicates 4ea3333c702741b4aeaa304e808c7d32dd6ee3f0从节点下对应主节点Id

目前来看，9001-9003 为主节点，9004-9006为从节点，并向你确认是否同意这么配置。输入 yes 后，会开始集群创建。

[root@192 ~]# /root/redis-cluster/bin/redis-trib.rb create --replicas 1 192.168.0.41:9001 192.168.0.41:9002 192.168.0.41:9003 192.168.0.41:9004 192.168.0.41:9005 192.168.0.41:9006
>>> Creating cluster
>>> Performing hash slots allocation on 6 nodes...
Using 3 masters:
192.168.0.41:9001
192.168.0.41:9002
192.168.0.41:9003
Adding replica 192.168.0.41:9005 to 192.168.0.41:9001
Adding replica 192.168.0.41:9006 to 192.168.0.41:9002
Adding replica 192.168.0.41:9004 to 192.168.0.41:9003
>>> Trying to optimize slaves allocation for anti-affinity
[WARNING] Some slaves are in the same host as their master
M: 4ea3333c702741b4aeaa304e808c7d32dd6ee3f0 192.168.0.41:9001
   slots:0-5460 (5461 slots) master
M: a0e8c79058df013e6e98ed87c3282251c2c1d742 192.168.0.41:9002
   slots:5461-10922 (5462 slots) master
M: a718c34942f4ee74f5d2d84defefec6c674eee4a 192.168.0.41:9003
   slots:10923-16383 (5461 slots) master
S: eb00382d22f660a8c68f20237f23d3013650982b 192.168.0.41:9004
   replicates a0e8c79058df013e6e98ed87c3282251c2c1d742
S: 4b22b43b3e3ddc3c294169123ed2539b5bff22ab 192.168.0.41:9005
   replicates a718c34942f4ee74f5d2d84defefec6c674eee4a
S: 067c67204c4db6c12b4dc349a29ad76793e43bf3 192.168.0.41:9006
   replicates 4ea3333c702741b4aeaa304e808c7d32dd6ee3f0
Can I set the above configuration? (type 'yes' to accept): yes
>>> Nodes configuration updated
>>> Assign a different config epoch to each node
>>> Sending CLUSTER MEET messages to join the cluster
Waiting for the cluster to join.....
>>> Performing Cluster Check (using node 192.168.0.41:9001)
M: 4ea3333c702741b4aeaa304e808c7d32dd6ee3f0 192.168.0.41:9001
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
S: 067c67204c4db6c12b4dc349a29ad76793e43bf3 192.168.0.41:9006
   slots: (0 slots) slave
   replicates 4ea3333c702741b4aeaa304e808c7d32dd6ee3f0
S: 4b22b43b3e3ddc3c294169123ed2539b5bff22ab 192.168.0.41:9005
   slots: (0 slots) slave
   replicates a718c34942f4ee74f5d2d84defefec6c674eee4a
M: a0e8c79058df013e6e98ed87c3282251c2c1d742 192.168.0.41:9002
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
M: a718c34942f4ee74f5d2d84defefec6c674eee4a 192.168.0.41:9003
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: eb00382d22f660a8c68f20237f23d3013650982b 192.168.0.41:9004
   slots: (0 slots) slave
   replicates a0e8c79058df013e6e98ed87c3282251c2c1d742
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.

集群验证
通过客户端命令连接，通过集群命令看一下状态和节点信息等。

[root@192 ~]# /root/redis-cluster/bin/redis-cli -c -h 192.168.0.41 -p 9001
192.168.0.41:9001> cluster info
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:6
cluster_size:3
cluster_current_epoch:6
cluster_my_epoch:1
cluster_stats_messages_ping_sent:362
cluster_stats_messages_pong_sent:364
cluster_stats_messages_sent:726
cluster_stats_messages_ping_received:359
cluster_stats_messages_pong_received:362
cluster_stats_messages_meet_received:5
cluster_stats_messages_received:726
192.168.0.41:9001> cluster nodes
067c67204c4db6c12b4dc349a29ad76793e43bf3 192.168.0.41:9006@19006 slave 4ea3333c702741b4aeaa304e808c7d32dd6ee3f0 0 1539655789648 6 connected
4b22b43b3e3ddc3c294169123ed2539b5bff22ab 192.168.0.41:9005@19005 slave a718c34942f4ee74f5d2d84defefec6c674eee4a 0 1539655788641 5 connected
4ea3333c702741b4aeaa304e808c7d32dd6ee3f0 192.168.0.41:9001@19001 myself,master - 0 1539655789000 1 connected 0-5460
a0e8c79058df013e6e98ed87c3282251c2c1d742 192.168.0.41:9002@19002 master - 0 1539655789000 2 connected 5461-10922
a718c34942f4ee74f5d2d84defefec6c674eee4a 192.168.0.41:9003@19003 master - 0 1539655790654 3 connected 10923-16383
eb00382d22f660a8c68f20237f23d3013650982b 192.168.0.41:9004@19004 slave a0e8c79058df013e6e98ed87c3282251c2c1d742 0 1539655791660 4 connected
192.168.0.41:9001> 

通过命令，可以详细的看出集群信息和各个节点状态，主从信息以及连接数、槽信息等。可以看到，已经把 Redis 集群搭建部署成功啦！

当在9001节点 set name mafly 时，出现了 Redirected to slot 信息并自动连接到了9002节点。这也是集群的一个数据分配特性

192.168.0.41:9001> set name mafly
-> Redirected to slot [5798] located at 192.168.0.41:9002
OK
192.168.0.41:9002> get name
"mafly"
192.168.0.41:9002>