flink jobmanager启动

最新推荐文章于 2024-04-11 14:51:05 发布

哥伦布112

最新推荐文章于 2024-04-11 14:51:05 发布

阅读量945

点赞数

分类专栏： flink

本文链接：https://blog.csdn.net/u013939918/article/details/106340210

版权

本文详细解析了Flink JobManager的启动过程，从start-cluster.sh脚本开始，介绍了StandaloneSessionClusterEntrypoint主类，深入到startCluster、initializeServices等关键方法，涵盖了RPC服务、心跳服务、监控指标服务等组件的初始化，并阐述了webMonitor、resourceManager和dispatcher三大核心组件的作用及启动细节。

摘要由CSDN通过智能技术生成

入口分析
从flink安装包的bin/start-cluster.sh分析开始，会发现Jm的主类org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint，tm的主类是
org.apache.flink.runtime.taskexecutor.TaskManagerRunner

StandaloneSessionClusterEntrypoint
public static void main(String[] args) { //args --configDir xxx --executionMode cluster
... 解析参数

   Configuration configuration = loadConfiguration(entrypointClusterConfiguration);
   StandaloneSessionClusterEntrypoint entrypoint = new StandaloneSessionClusterEntrypoint(configuration);
   entrypoint.startCluster();//启动
}

===>

protected void startCluster() {
   LOG.info("Starting {}.", getClass().getSimpleName());
   try {
       configureFileSystems(configuration);

SecurityContext securityContext = installSecurityContext(configuration);

securityContext.runSecured((Callable<Void>) () -> {
runCluster(configuration);//启动cluster

           return null;
       });
   } catch (Throwable t) {
       LOG.error("Cluster initialization failed.", t);

       shutDownAndTerminate(
           STARTUP_FAILURE_RETURN_CODE,
           ApplicationStatus.FAILED,
           t.getMessage(),
           false);
   }
}

===>

protected void runCluster(Configuration configuration) throws Exception {
synchronized (lock) {
initializeServices(configuration);//初始化组件

       // write host information into configuration
       configuration.setString(JobManagerOptions.ADDRESS, commonRpcService.getAddress());
       configuration.setInteger(JobManagerOptions.PORT, commonRpcService.getPort());

startCl