RabbitMQ集群，大数据开发工程师最容易遇到4个瓶颈是什么

RabbitMQ Cluster 配置

[1] 安装rabbitmq单机版

[2] 放行防火墙端口

# node1
[root@node1 ~]# firewall-cmd --add-port=4369/tcp,25672/tcp
success
[root@node1 ~]# firewall-cmd --runtime-to-permanent 
success

# node2
[root@node2 ~]# firewall-cmd --add-port=4369/tcp,25672/tcp
success
[root@node2 ~]# firewall-cmd --runtime-to-permanent 
success

# node3
[root@node3 ~]# firewall-cmd --add-port=4369/tcp,25672/tcp
success
[root@node3 ~]# firewall-cmd --runtime-to-permanent 
success

[3] 配置hosts

[root@node1 ~]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
11.1.1.51   node1  node1@sumail.com
11.1.1.52   node2  node2@sumail.com
11.1.1.53   node3  node3@sumail.com

# 复制到node2中
[root@node1 ~]# scp /etc/hosts root@node2:/etc/hosts
The authenticity of host 'node2 (11.1.1.52)' can't be established.
ED25519 key fingerprint is SHA256:BQD837RdlkpurpiYQYlLVeWNmk1zRFwIjeHo7YnMcfk.
This host key is known by the following other names/addresses:
 ~/.ssh/known\_hosts:1: node2
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added 'node2' (ED25519) to the list of known hosts.
root@node2's password: 
hosts  

# 复制到node2中
[root@node1 ~]# scp /etc/hosts root@node3:/etc/hosts
The authenticity of host 'node3 (11.1.1.53)' can't be established.
ED25519 key fingerprint is SHA256:BQD837RdlkpurpiYQYlLVeWNmk1zRFwIjeHo7YnMcfk.
This host key is known by the following other names/addresses:
 ~/.ssh/known\_hosts:1: node2
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added 'node3' (ED25519) to the list of known hosts.
root@node3's password: 
hosts  

[4] 配置集群

node1 配置

# 在所有集群节点中存放相同的cookie
[root@node1 ~]# scp /var/lib/rabbitmq/.erlang.cookie root@node2:/var/lib/rabbitmq/.erlang.cookie 
root@node2's password: 
.erlang.cookie 100% 20 34.3KB/s 00:00 
[root@node1 ~]# scp /var/lib/rabbitmq/.erlang.cookie root@node3:/var/lib/rabbitmq/.erlang.cookie 
root@node3's password: 
.erlang.cookie                                                           100%   20    11.3KB/s   00:00 

node2 配置

# 重启服务
[root@node2 ~]# systemctl restart rabbitmq-server

# 停止应用并重置
[root@node2 ~]# rabbitmqctl stop\_app
Stopping rabbit application on node rabbit@node2 ...
[root@node2 ~]# rabbitmqctl reset
Resetting node rabbit@node2 ...

# node2加入集群
[root@node2 ~]# rabbitmqctl join\_cluster rabbit@node1
Clustering node rabbit@node2 with rabbit@node1

# 启动应用
[root@node02 ~]# rabbitmqctl start\_app
Starting node rabbit@node2 ...

# 查看集群状态
[root@node2 ~]# rabbitmqctl cluster\_status
Cluster status of node rabbit@node2 ...
Basics

Cluster name: rabbit@node2

Disk Nodes

rabbit@node1
rabbit@node2

Running Nodes

rabbit@node1
rabbit@node2

Versions

rabbit@node1: RabbitMQ 3.9.21 on Erlang 24.3.4.2
rabbit@node2: RabbitMQ 3.9.21 on Erlang 24.3.4.2

Maintenance status

Node: rabbit@node1, status: not under maintenance
Node: rabbit@node2, status: not under maintenance

Alarms

(none)

Network Partitions

(none)

Listeners

Node: rabbit@node1, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
Node: rabbit@node1, interface: [::], port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
Node: rabbit@node2, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
Node: rabbit@node2, interface: 0.0.0.0, port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0

Feature flags

Flag: implicit_default_bindings, state: enabled
Flag: maintenance_mode_status, state: enabled
Flag: quorum_queue, state: enabled
Flag: stream_queue, state: enabled
Flag: user_limits, state: enabled
Flag: virtual_host_metadata, state: enabled

node3 配置

# 重启服务
[root@node3 ~]# systemctl restart rabbitmq-server

# 停止应用并重置
[root@node3 ~]# rabbitmqctl stop\_app
Stopping rabbit application on node rabbit@node3 ...
[root@node3 ~]# rabbitmqctl reset
Resetting node rabbit@node3 ...


# node3加入集群
[root@node3 ~]# rabbitmqctl join\_cluster rabbit@node2
Clustering node rabbit@node3 with rabbit@node2

# 启动应用
[root@node3 ~]# rabbitmqctl start\_app
Starting node rabbit@node3 ...
[root@node3 ~]# rabbitmqctl cluster\_status
Cluster status of node rabbit@node3 ...
Basics

Cluster name: rabbit@node3

Disk Nodes


**自我介绍一下，小编13年上海交大毕业，曾经在小公司待过，也去过华为、OPPO等大厂，18年进入阿里一直到现在。**

**深知大多数大数据工程师，想要提升技能，往往是自己摸索成长或者是报班学习，但对于培训机构动则几千的学费，着实压力不小。自己不成体系的自学效果低效又漫长，而且极易碰到天花板技术停滞不前！**

**因此收集整理了一份《2024年大数据全套学习资料》，初衷也很简单，就是希望能够帮助到想自学提升又不知道该从何学起的朋友。**
![img](https://img-blog.csdnimg.cn/img_convert/0c723727287d7d7822492e0e304af54b.png)
![img](https://img-blog.csdnimg.cn/img_convert/14806efc27933b3933d408723d23c733.png)
![img](https://img-blog.csdnimg.cn/img_convert/3ef93b5ca6c56a34e9b018e7fd0bc1e8.png)
![img](https://img-blog.csdnimg.cn/img_convert/76a2981cf98b607cf2305af89515557a.png)
![img](https://img-blog.csdnimg.cn/img_convert/5a1275716d9060357dd06c937e0bbb83.png)

**既有适合小白学习的零基础资料，也有适合3年以上经验的小伙伴深入学习提升的进阶课程，基本涵盖了95%以上大数据开发知识点，真正体系化！**

**由于文件比较大，这里只是将部分目录大纲截图出来，每个节点里面都包含大厂面经、学习笔记、源码讲义、实战项目、讲解视频，并且后续会持续更新**

**如果你觉得这些内容对你有帮助，可以添加VX：vip204888 （备注大数据获取）**
![img](https://img-blog.csdnimg.cn/img_convert/004d2f0c83a61d600759441e83eb52d8.png)

**一个人可以走的很快，但一群人才能走的更远。不论你是正从事IT行业的老鸟或是对IT行业感兴趣的新人，都欢迎扫码加入我们的的圈子（技术交流、学习资源、职场吐槽、大厂内推、面试辅导），让我们一起学习成长！**

，并且后续会持续更新**

**如果你觉得这些内容对你有帮助，可以添加VX：vip204888 （备注大数据获取）**
[外链图片转存中...(img-F4Nk9Uwl-1712986837769)]

**一个人可以走的很快，但一群人才能走的更远。不论你是正从事IT行业的老鸟或是对IT行业感兴趣的新人，都欢迎扫码加入我们的的圈子（技术交流、学习资源、职场吐槽、大厂内推、面试辅导），让我们一起学习成长！**