ApplictionId的生成

最新推荐文章于 2023-07-23 08:41:17 发布

巴氏旅人

最新推荐文章于 2023-07-23 08:41:17 发布

阅读量744

点赞数

分类专栏： java hadoop源码初读

本文链接：https://blog.csdn.net/zhusirong/article/details/84341650

版权

hadoop源码初读同时被 2 个专栏收录

24 篇文章

订阅专栏

java

21 篇文章

订阅专栏

ApplicationId由clusterTimestamp（ResourceManager启动时间）和递增id组成，主要在客户端提交应用程序时通过getNewJobID方法获取。JobID是对applicationId的简单封装。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

ApplictionId的生成

ApplicationId主要包括两部分:clusterTimestamp和id.
是在客户端提交应用程序前,随着rpc方法getNewJobID获取jobId时生成的.而JobID只是applicationId的简单包装.

其中clusterTimestamp是ResourceManager的启动时间.而id是一个递增的整数类型.
clusterTimestamp是ResourceManager的当前时间:

void ResourceManager.startActiveServices() throws Exception {
    if (activeServices != null) {
      clusterTimeStamp = System.currentTimeMillis();
      activeServices.start();
    }
  }

id是一个递增的整数类型:

ApplicationId getNewApplicationId() {
    ApplicationId applicationId = org.apache.hadoop.yarn.server.utils.BuilderUtils
        .newApplicationId(recordFactory, ResourceManager.getClusterTimeStamp(),
            applicationCounter.incrementAndGet());
    LOG.info("Allocated new applicationId: " + applicationId.getId());
    return applicationId;
  }

JobID是applicationID的简单包装:

 public JobID getNewJobID() throws IOException, InterruptedException {
    try {
      this.application = client.createApplication().getApplicationSubmissionContext();
      this.applicationId = this.application.getApplicationId();
      return TypeConverter.fromYarn(applicationId);
    } catch (YarnException e) {
      throw new IOException(e);
    }
  }

public static org.apache.hadoop.mapreduce.JobID fromYarn(ApplicationId appID) {
    String identifier = fromClusterTimeStamp(appID.getClusterTimestamp());
    return new org.apache.hadoop.mapred.JobID(identifier, appID.getId());
  }