RocketMQ高手之路系列之三：RocketMQ之路由中心

最新推荐文章于 2024-10-08 19:16:38 发布

2401_83412172

最新推荐文章于 2024-10-08 19:16:38 发布

阅读量944

点赞数 15

分类专栏：程序员文章标签： rocketmq php 开发语言

本文链接：https://blog.csdn.net/2401_83412172/article/details/137051019

版权

程序员专栏收录该内容

686 篇文章 0 订阅

订阅专栏

public static NamesrvController main0(String[] args) {

try {

//创建NamesrvController

NamesrvController controller = createNamesrvController(args);

//启动NamesrvController

start(controller);

String tip = “The Name Server boot success. serializeType=” + RemotingCommand.getSerializeTypeConfigInThisServer();

log.info(tip);

System.out.printf(“%s%n”, tip);

return controller;

} catch (Throwable e) {

e.printStackTrace();

System.exit(-1);

}

return null;

}

创建NamesrvController 实例，源码如下所示：

public static NamesrvController createNamesrvController(String[] args) throws IOException, JoranException {

System.setProperty(RemotingCommand.REMOTING_VERSION_KEY, Integer.toString(MQVersion.CURRENT_VERSION));

//PackageConflictDetect.detectFastjson();

//读取启动参数

Options options = ServerUtil.buildCommandlineOptions(new Options());

commandLine = ServerUtil.parseCmdLine(“mqnamesrv”, args, buildCommandlineOptions(options), new PosixParser());

if (null == commandLine) {

System.exit(-1);

return null;

}

//NamesrvConfig为NameServer配置，NettyServerConfig为Netty配置，用来构造NamesrvController

final NamesrvConfig namesrvConfig = new NamesrvConfig();

final NettyServerConfig nettyServerConfig = new NettyServerConfig();

nettyServerConfig.setListenPort(9876);

if (commandLine.hasOption(‘c’)) {

String file = commandLine.getOptionValue(‘c’);

if (file != null) {

InputStream in = new BufferedInputStream(new FileInputStream(file));

properties = new Properties();

properties.load(in);

MixAll.properties2Object(properties, namesrvConfig);

MixAll.properties2Object(properties, nettyServerConfig);

namesrvConfig.setConfigStorePath(file);

System.out.printf(“load config properties file OK, %s%n”, file);

in.close();

}

if (commandLine.hasOption(‘p’)) {

InternalLogger console = InternalLoggerFactory.getLogger(LoggerName.NAMESRV_CONSOLE_NAME);

MixAll.printObjectProperties(console, namesrvConfig);

MixAll.printObjectProperties(console, nettyServerConfig);

System.exit(0);

}

MixAll.properties2Object(ServerUtil.commandLine2Properties(commandLine), namesrvConfig);

if (null == namesrvConfig.getRocketmqHome()) {

System.out.printf(“Please set the %s variable in your environment to match the location of the RocketMQ installation%n”, MixAll.ROCKETMQ_HOME_ENV);

System.exit(-2);

}

LoggerContext lc = (LoggerContext) LoggerFactory.getILoggerFactory();

JoranConfigurator configurator = new JoranConfigurator();

configurator.setContext(lc);

lc.reset();

configurator.doConfigure(namesrvConfig.getRocketmqHome() + “/conf/logback_namesrv.xml”);

log = InternalLoggerFactory.getLogger(LoggerName.NAMESRV_LOGGER_NAME);

MixAll.printObjectProperties(log, namesrvConfig);

MixAll.printObjectProperties(log, nettyServerConfig);

final NamesrvController controller = new NamesrvController(namesrvConfig, nettyServerConfig);

// remember all configs to prevent discard

controller.getConfiguration().registerConfig(properties);

return controller;

}

启动NamesrvController源码如下所示：

public static NamesrvController start(final NamesrvController controller) throws Exception {

if (null == controller) {

throw new IllegalArgumentException(“NamesrvController is null”);

}

//初始化NamesrvController实例

boolean initResult = controller.initialize();

if (!initResult) {

controller.shutdown();

System.exit(-3);

}

//注册JVM钩子函数，同时启动服务器，用于监听Broker、消息生产者的网络请求

Runtime.getRuntime().addShutdownHook(new ShutdownHookThread(log, new Callable() {

@Override

public Void call() throws Exception {

controller.shutdown();

return null;

}

}));

//启动

controller.start();

return controller;

}

NamesrvController初始化操作如下所示：

public boolean initialize() {

this.kvConfigManager.load();

//初始化nettyServer

this.remotingServer = new NettyRemotingServer(this.nettyServerConfig, this.brokerHousekeepingService);

//初始化线程池

this.remotingExecutor =

Executors.newFixedThreadPool(nettyServerConfig.getServerWorkerThreads(), new ThreadFactoryImpl(“RemotingExecutorThread_”));

//注册请求处理

this.registerProcessor();

this.scheduledExecutorService.scheduleAtFixedRate(new Runnable() {

@Override

public void run() {

NamesrvController.this.routeInfoManager.scanNotActiveBroker();

}

}, 5, 10, TimeUnit.SECONDS);

this.scheduledExecutorService.scheduleAtFixedRate(new Runnable() {

@Override

public void run() {

NamesrvController.this.kvConfigManager.printAllPeriodically();

}

}, 1, 10, TimeUnit.MINUTES);

if (TlsSystemConfig.tlsMode != TlsMode.DISABLED) {

// Register a listener to reload SslContext

try {

fileWatchService = new FileWatchService(

new String[] {

TlsSystemConfig.tlsServerCertPath,

TlsSystemConfig.tlsServerKeyPath,

TlsSystemConfig.tlsServerTrustCertPath

new FileWatchService.Listener() {

boolean certChanged, keyChanged = false;

@Override

public void onChanged(String path) {

if (path.equals(TlsSystemConfig.tlsServerTrustCertPath)) {

log.info(“The trust certificate changed, reload the ssl context”);

reloadServerSslContext();

}

if (path.equals(TlsSystemConfig.tlsServerCertPath)) {

certChanged = true;

}

if (path.equals(TlsSystemConfig.tlsServerKeyPath)) {

keyChanged = true;

}

if (certChanged && keyChanged) {

log.info(“The certificate and private key changed, reload the ssl context”);

certChanged = keyChanged = false;

reloadServerSslContext();

}

private void reloadServerSslContext() {

((NettyRemotingServer) remotingServer).loadSslContext();

}

});

} catch (Exception e) {

log.warn(“FileWatchService created error, can’t load the certificate dynamically”);

}

return true;

}

二、路由信息

NameServer主要是为了生产者以及消费者提供Topic的路由信息。那么路由信息是存在哪里呢？在RouteInfoManager源码中，可以查看到如下信息：

private final HashMap<String/* topic */, List> topicQueueTable;

private final HashMap<String/* brokerName */, BrokerData> brokerAddrTable;

private final HashMap<String/* clusterName /, Set<String/ brokerName */>> clusterAddrTable;

private final HashMap<String/* brokerAddr */, BrokerLiveInfo> brokerLiveTable;

private final HashMap<String/* brokerAddr /, List/ Filter Server */> filterServerTable;

1、 topicQueueTable

Topic消息队列路由信息，存储所有Topic的属性信息，消息发送时会根据路由表进行负载均衡；

它是一个HashMap的数据结构，对应的key值为Topic的名称，value为List<QueueData>，QueueData信息如下所示：

public class QueueData implements Comparable {

//Broker名称

private String brokerName;

//读队列长度

private int readQueueNums;

//写队列长度

private int writeQueueNums;

//读写去权限

private int perm;

//Topic同步标志

private int topicSynFlag;

…

}

2、 brokerAddrTable

存储Broker的属性信息，包括Broker基础信息，包含brokerName、所属集群名称，主备Broker地址；

对应的key只为BrokerName，value为BrokerData。BrokerData的相关属性如下所示：

public class BrokerData implements Comparable {

private String cluster;

private String brokerName;

private HashMap<Long/* brokerId /, String/ broker address */> brokerAddrs;

…

}

相同名称的Broker可能有多台机器，也就是说它可能是个集群，一个Master以及多个Slave。所以在BrokerData中，存储了相关的属性，即Broker的名称、所属集群的信息，以及对应的机器的地址信息。

3、clusterAddrTable

Broker集群信息，存储集群重点所有Broker的名称；

key为集群的名称，value为Broker名称的集合。

4、brokerLiveTable

Broker及其的实时状态信息，NameServer每次收到心跳探测包会进行状态信息更新；

key值为 Broker的地址，对应一台机器，value为BrokerLiveInfo，它保存着对应Broker服务器的地址信息。lastUpdateTimestamp表示上次的状态更新时间，NameServer定时检查这个时间出的实时性，如果发现这个时间戳超过一定时间没有进行更新，则会将该Broker的地址从列表中进行删除。

class BrokerLiveInfo {

//最后更新时间

private long lastUpdateTimestamp;

//数据版本号

private DataVersion dataVersion;

//连接信息

private Channel channel;

//服务器地址

private String haServerAddr;

…

}

5、filterServerTable

存储过滤服务器信息，Broker上的FilterServer列表，用于类模式消息过滤。对应的key值为Broker地址，value为FilterServer的地址列表。

三、路由注册

在第二小节中，我们介绍了路由信息的相关内容。那么在RocketMQ体系中，路由注册时如何实现的呢？路由注册通过Broker与NameServer之间心跳连接进行的。当Broker服务启动之后，就会向集群中的所有的NameServer发送心跳探测包。正常运行之后，Broker会每隔三十秒向集群中的所有NameServer发送心跳检测包。当接收到心跳检测包时，NameServer会更新brokerLiveTable缓存中的BrokerLiveInfo的lastUpdateTimestamp时间戳。与此同时，NameServer会每隔10s对brokerLiveTable进行扫描，如果发现连续120s未检测到心跳，则会将该Broker路由信息进行移除，流程如下所示：