RabbitMQ Cluster集群安装与配置
集群架构
|
+---------+-------------------------------+-------------------------------+----------+
| | |
| | |
+---------+------------+ +----------------------+ +----------------------+
| [ Cluster Node #1 ] | | [ Cluster Node #2 ] | | [ Cluster Node #3 ] |
| node1.sumail.com +<------+ node2.sumail.com +<------+ node3.sumail.com |
| 11.1.1.51 | | 11.1.1.52 | | 11.1.1.53 |
+----------------------+ +----------------------+ +----------------------+
RabbitMQ Cluster 配置
[1] 安装rabbitmq单机版
[2] 放行防火墙端口
# node1
[root@node1 ~]# firewall-cmd --add-port=4369/tcp,25672/tcp
success
[root@node1 ~]# firewall-cmd --runtime-to-permanent
success
# node2
[root@node2 ~]# firewall-cmd --add-port=4369/tcp,25672/tcp
success
[root@node2 ~]# firewall-cmd --runtime-to-permanent
success
# node3
[root@node3 ~]# firewall-cmd --add-port=4369/tcp,25672/tcp
success
[root@node3 ~]# firewall-cmd --runtime-to-permanent
success
[3] 配置hosts
[root@node1 ~]# cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
11.1.1.51 node1 node1@sumail.com
11.1.1.52 node2 node2@sumail.com
11.1.1.53 node3 node3@sumail.com
# 复制到node2中
[root@node1 ~]# scp /etc/hosts root@node2:/etc/hosts
The authenticity of host 'node2 (11.1.1.52)' can't be established.
ED25519 key fingerprint is SHA256:BQD837RdlkpurpiYQYlLVeWNmk1zRFwIjeHo7YnMcfk.
This host key is known by the following other names/addresses:
~/.ssh/known_hosts:1: node2
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added 'node2' (ED25519) to the list of known hosts.
root@node2's password:
hosts
# 复制到node2中
[root@node1 ~]# scp /etc/hosts root@node3:/etc/hosts
The authenticity of host 'node3 (11.1.1.53)' can't be established.
ED25519 key fingerprint is SHA256:BQD837RdlkpurpiYQYlLVeWNmk1zRFwIjeHo7YnMcfk.
This host key is known by the following other names/addresses:
~/.ssh/known_hosts:1: node2
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added 'node3' (ED25519) to the list of known hosts.
root@node3's password:
hosts
[4] 配置集群
node1 配置
# 在所有集群节点中存放相同的cookie
[root@node1 ~]# scp /var/lib/rabbitmq/.erlang.cookie root@node2:/var/lib/rabbitmq/.erlang.cookie
root@node2's password:
.erlang.cookie 100% 20 34.3KB/s 00:00
[root@node1 ~]# scp /var/lib/rabbitmq/.erlang.cookie root@node3:/var/lib/rabbitmq/.erlang.cookie
root@node3's password:
.erlang.cookie 100% 20 11.3KB/s 00:00
node2 配置
# 重启服务
[root@node2 ~]# systemctl restart rabbitmq-server
# 停止应用并重置
[root@node2 ~]# rabbitmqctl stop_app
Stopping rabbit application on node rabbit@node2 ...
[root@node2 ~]# rabbitmqctl reset
Resetting node rabbit@node2 ...
# node2加入集群
[root@node2 ~]# rabbitmqctl join_cluster rabbit@node1
Clustering node rabbit@node2 with rabbit@node1
# 启动应用
[root@node02 ~]# rabbitmqctl start_app
Starting node rabbit@node2 ...
# 查看集群状态
[root@node2 ~]# rabbitmqctl cluster_status
Cluster status of node rabbit@node2 ...
Basics
Cluster name: rabbit@node2
Disk Nodes
rabbit@node1
rabbit@node2
Running Nodes
rabbit@node1
rabbit@node2
Versions
rabbit@node1: RabbitMQ 3.9.21 on Erlang 24.3.4.2
rabbit@node2: RabbitMQ 3.9.21 on Erlang 24.3.4.2
Maintenance status
Node: rabbit@node1, status: not under maintenance
Node: rabbit@node2, status: not under maintenance
Alarms
(none)
Network Partitions
(none)
Listeners
Node: rabbit@node1, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
Node: rabbit@node1, interface: [::], port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
Node: rabbit@node2, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
Node: rabbit@node2, interface: 0.0.0.0, port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
Feature flags
Flag: implicit_default_bindings, state: enabled
Flag: maintenance_mode_status, state: enabled
Flag: quorum_queue, state: enabled
Flag: stream_queue, state: enabled
Flag: user_limits, state: enabled
Flag: virtual_host_metadata, state: enabled
node3 配置
# 重启服务
[root@node3 ~]# systemctl restart rabbitmq-server
# 停止应用并重置
[root@node3 ~]# rabbitmqctl stop_app
Stopping rabbit application on node rabbit@node3 ...
[root@node3 ~]# rabbitmqctl reset
Resetting node rabbit@node3 ...
# node3加入集群
[root@node3 ~]# rabbitmqctl join_cluster rabbit@node2
Clustering node rabbit@node3 with rabbit@node2
# 启动应用
[root@node3 ~]# rabbitmqctl start_app
Starting node rabbit@node3 ...
[root@node3 ~]# rabbitmqctl cluster_status
Cluster status of node rabbit@node3 ...
Basics
Cluster name: rabbit@node3
Disk Nodes
rabbit@node1
rabbit@node2
rabbit@node3
Running Nodes
rabbit@node1
rabbit@node2
rabbit@node3
Versions
rabbit@node1: RabbitMQ 3.9.21 on Erlang 24.3.4.2
rabbit@node2: RabbitMQ 3.9.21 on Erlang 24.3.4.2
rabbit@node3: RabbitMQ 3.9.21 on Erlang 24.3.4.2
Maintenance status
Node: rabbit@node1, status: not under maintenance
Node: rabbit@node2, status: not under maintenance
Node: rabbit@node3, status: not under maintenance
Alarms
(none)
Network Partitions
(none)
Listeners
Node: rabbit@node1, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
Node: rabbit@node1, interface: [::], port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
Node: rabbit@node2, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
Node: rabbit@node2, interface: 0.0.0.0, port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
Node: rabbit@node3, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
Node: rabbit@node3, interface: 0.0.0.0, port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
Feature flags
Flag: implicit_default_bindings, state: enabled
Flag: maintenance_mode_status, state: enabled
Flag: quorum_queue, state: enabled
Flag: stream_queue, state: enabled
Flag: user_limits, state: enabled
Flag: virtual_host_metadata, state: enabled
使用rabbitmqadmin
避免node1 down机后消息丢失
[root@node1 ~]# curl http://node1:15672/cli/rabbitmqadmin -o /usr/sbin/rabbitmqadmin
[root@node1 ~]# chmod +x /usr/sbin/rabbitmqadmin
# 配置同步队列
[root@node1 ~]# rabbitmqadmin declare queue name=shared_queue
queue declared
# 配置同步策略
# rabbitmqctl set_policy [policy name(any name you like)] [Queue] [Mode]
[root@node1 ~]# rabbitmqctl set_policy ha-policy "shared_queue" '{"ha-mode":"all"}'
Setting policy "ha-policy" for pattern "shared_queue" to "{"ha-mode":"all"}" with priority "0" for vhost "/" ...
# 查看同步状态
[root@node1 ~]# rabbitmqadmin list queues name node policy slave_nodes state synchronised_slave_nodes
+--------------+--------------+-----------+---------------------------+---------+--------------------------+
| name | node | policy | slave_nodes | state | synchronised_slave_nodes |
+--------------+--------------+-----------+---------------------------+---------+--------------------------+
| shared_queue | rabbit@node1 | ha-policy | rabbit@node3 rabbit@node2 | running | rabbit@node3rabbit@node2 |
+--------------+--------------+-----------+---------------------------+---------+--------------------------+