yarn通过客户端提交application

最新推荐文章于 2024-07-22 17:18:17 发布

我终于有blog了

最新推荐文章于 2024-07-22 17:18:17 发布

阅读量2.8k

点赞数

分类专栏： hadoop hive 大数据

本文链接：https://blog.csdn.net/qq_29493353/article/details/85788171

版权

大数据同时被 2 个专栏收录

15 篇文章 1 订阅

订阅专栏

hadoop hive

7 篇文章 0 订阅

订阅专栏

pom:

<dependencies>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-common</artifactId>
        <version>2.6.0</version>
    </dependency>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-client</artifactId>
        <version>2.6.0</version>
    </dependency>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-hdfs</artifactId>
        <version>2.6.0</version>
    </dependency>

</dependencies>

代码:

//开启客户端连接
YarnConfiguration conf = new YarnConfiguration();
//这一步加载yarn配置,配置的地址如果是用host的话，windows上hosts文件要配置好虚拟机ip
conf.addResource( new Path( "D:\\yarn-site.xml" ) );
//yarnclient负责与resourcemanager通信 协议是ApplicationClientProtocol
YarnClient yarnClient = YarnClient.createYarnClient();
yarnClient.init( conf );
yarnClient.start();

//创建客户端application(这一步要在虚拟机开启resource manager   启动方式 yarn resourcemanager
try {
    YarnClientApplication app = yarnClient.createApplication();
    GetNewApplicationResponse res = app.getNewApplicationResponse();
    System.out.println(res.getApplicationId());
} catch (YarnException e) {
    e.printStackTrace();
} catch (IOException e) {
    e.printStackTrace();
}