rocketmq集群搭建及使用

一、双主双从集群部署

架构

主机	节点	IP
cache01	192.168.80.10	master
cache02	192.168.80.20	slave
cache03	192.168.80.30	master
cache04	192.168.80.40	slave

配置

下载

https://downloads.apache.org/rocketmq/4.8.0/

创建路径

cd /export/servers/rocketmq-all-4.8.0
mkdir -p store/{commitlog,consumequeue,index}

增加主机映射

vi /etc/hosts

192.168.80.10 cache01
192.168.80.20 cache02
192.168.80.30 cache03
192.168.80.40 cache04

192.168.80.10 rocketmq-nameserver1
192.168.80.20 rocketmq-nameserver2

修改各节点配置文件

cache01-broker-a.properties （主）

brokerClusterName=rocketmq-cluster
brokerName=broker-a
brokerId=0
deleteWhen=04
fileReservedTime=48
brokerRole=SYNC_MASTER
flushDiskType=ASYNC_FLUSH

namesrvAddr=rocketmq-nameserver1:9876;rocketmq-nameserver2:9876
defaultTopicQueueNums=4
autoCreateTopicEnable=true
autoCreateSubscriptionGroup=true
listenPort=10911
mapedFileSizeCommitLog=1073741824
mapedFileSizeConsumeQueue=300000
diskMaxUsedSpaceRatio=88
storePathRootDir=/export/servers/rocketmq-all-4.8.0/store
storePathCommitLog=/export/servers/rocketmq-all-4.8.0/store/commitlog
storePathConsumeQueue=/export/servers/rocketmq-all-4.8.0/store/consumequeue
storePathIndex=/export/servers/rocketmq-all-4.8.0/store/index
storeCheckpoint=/export/servers/rocketmq-all-4.8.0/store/checkpoint
abortFile=/export/servers/rocketmq-all-4.8.0/store/abort
maxMessageSize=65536

cache02-broker-a-s.properties（从）

brokerClusterName=rocketmq-cluster
brokerName=broker-a
brokerId=1
deleteWhen=04
fileReservedTime=48
brokerRole=SLAVE
flushDiskType=ASYNC_FLUSH

namesrvAddr=rocketmq-nameserver1:9876;rocketmq-nameserver2:9876
defaultTopicQueueNums=4
autoCreateTopicEnable=true
autoCreateSubscriptionGroup=true
listenPort=10911
mapedFileSizeCommitLog=1073741824
mapedFileSizeConsumeQueue=300000
diskMaxUsedSpaceRatio=88
storePathRootDir=/export/servers/rocketmq-all-4.8.0/store
storePathCommitLog=/export/servers/rocketmq-all-4.8.0/store/commitlog
storePathConsumeQueue=/export/servers/rocketmq-all-4.8.0/store/consumequeue
storePathIndex=/export/servers/rocketmq-all-4.8.0/store/index
storeCheckpoint=/export/servers/rocketmq-all-4.8.0/store/checkpoint
abortFile=/export/servers/rocketmq-all-4.8.0/store/abort
maxMessageSize=65536

cache03-broker-b.properties（主）

brokerClusterName=rocketmq-cluster
brokerName=broker-b
brokerId=0
deleteWhen=04
fileReservedTime=48
brokerRole=SYNC_MASTER
flushDiskType=ASYNC_FLUSH

namesrvAddr=rocketmq-nameserver1:9876;rocketmq-nameserver2:9876
defaultTopicQueueNums=4
autoCreateTopicEnable=true
autoCreateSubscriptionGroup=true
listenPort=10911
mapedFileSizeCommitLog=1073741824
mapedFileSizeConsumeQueue=300000
diskMaxUsedSpaceRatio=88
storePathRootDir=/export/servers/rocketmq-all-4.8.0/store
storePathCommitLog=/export/servers/rocketmq-all-4.8.0/store/commitlog
storePathConsumeQueue=/export/servers/rocketmq-all-4.8.0/store/consumequeue
storePathIndex=/export/servers/rocketmq-all-4.8.0/store/index
storeCheckpoint=/export/servers/rocketmq-all-4.8.0/store/checkpoint
abortFile=/export/servers/rocketmq-all-4.8.0/store/abort
maxMessageSize=65536

cache04-broker-b-s.properties（从）

brokerClusterName=rocketmq-cluster
brokerName=broker-b
brokerId=1
deleteWhen=04
fileReservedTime=48
brokerRole=SLAVE
flushDiskType=ASYNC_FLUSH

namesrvAddr=rocketmq-nameserver1:9876;rocketmq-nameserver2:9876
defaultTopicQueueNums=4
autoCreateTopicEnable=true
autoCreateSubscriptionGroup=true
listenPort=10911
mapedFileSizeCommitLog=1073741824
mapedFileSizeConsumeQueue=300000
diskMaxUsedSpaceRatio=88
storePathRootDir=/export/servers/rocketmq-all-4.8.0/store
storePathCommitLog=/export/servers/rocketmq-all-4.8.0/store/commitlog
storePathConsumeQueue=/export/servers/rocketmq-all-4.8.0/store/consumequeue
storePathIndex=/export/servers/rocketmq-all-4.8.0/store/index
storeCheckpoint=/export/servers/rocketmq-all-4.8.0/store/checkpoint
abortFile=/export/servers/rocketmq-all-4.8.0/store/abort
maxMessageSize=65536

修改脚本java参数

vi bin/runbroker.sh

JAVA_OPT="${JAVA_OPT} -server -Xms256m -Xmx256m -Xmn128m"

vi bin/runserver.sh

JAVA_OPT="${JAVA_OPT} -server -Xms256m -Xmx256m -Xmn128m -XX:MetaspaceSize=128m -XX:MaxMetaspaceSize=320m"

启动

启动nameserver

nohup sh bin/mqnamesrv & 

启动broker

nohup sh bin/mqbroker -c conf/2m-2s-sync/broker-a.properties &

nohup sh bin/mqbroker -c conf/2m-2s-sync/broker-a-s.properties &

nohup sh bin/mqbroker -c conf/2m-2s-sync/broker-b.properties &

nohup sh bin/mqbroker -c conf/2m-2s-sync/broker-b-s.properties &

二、安装配置rocketmq-console

centos安装maven

下载压缩包

wget https://mirrors.tuna.tsinghua.edu.cn/apache/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz

下载rocketmq-console源码

git clone  https://github.com/apache/rocketmq-externals.git -b release-rocketmq-console-1.0.0

修改源码配置文件

cd /export/servers/rocketmq-externals/rocketmq-console/src/main/resources
vi application.properties

更改
rocketmq.config.namesrvAddr=rocketmq-nameserver1:9876;rocketmq-nameserver2:9876

打包

mvn clean package -Dmaven.test.skip=true
target路径下，会生成rocketmq-console-ng-1.0.0.jar

编写启动脚本

vi start-rocketmq-console.sh

#!/bin/bash

nohup java -jar /export/servers/rocketmq-externals/rocketmq-console/target/rocketmq-console-ng-1.0.0.jar >/dev/null 2>&1 &