Java代码通过Kerberos连接HDFS

最新推荐文章于 2024-06-20 17:24:33 发布

疯子1313

最新推荐文章于 2024-06-20 17:24:33 发布

阅读量3.3k

点赞数 2

分类专栏：通过Kerberso连接hdfs 文章标签： java kerberos hdfs

本文链接：https://blog.csdn.net/qq_32486597/article/details/122514275

版权

通过Kerberso连接hdfs 专栏收录该内容

2 篇文章 0 订阅

订阅专栏

准备配置文件工作:
1. hdfs-site.xml , core-site.xml   从【集群中下载】
2. hadoop.keytab 【创建kerberos访问的用户生成】
3. krb5.conf  【配置Kerberos生成】


pom需要的依赖:
    <dependencies>
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-common</artifactId>
            <version>${hadoop.version}</version>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-hdfs</artifactId>
            <version>${hadoop.version}</version>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-client</artifactId>
            <version>${hadoop.version}</version>
        </dependency>
    </dependencies>




具体的代码实现

package com.cib.feilong.kerber;

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.security.UserGroupInformation;

/**
 * JAVA 代码通过Kerberos连接HDFS
 *
 * @author songzhan
 * @version 1.0
 * @date 2022/1/14
 */

public class Test {

    public static void main(String[] args) throws Exception {

        String user = "hadoop";

        String keytab = "/home/hadoop/hadoop.keytab";

        String path = "/tmp/";

        Configuration conf = new Configuration();

        conf.set("fs.hdfs.impl", "org.apache.hadoop.hdfs.DistributedFileSystem");

        System.setProperty("java.security.krb5.conf", "/etc/krb5.conf");

        UserGroupInformation.setConfiguration(conf);

        UserGroupInformation.loginUserFromKeytab(user, keytab);

        FileSystem fileSystem = FileSystem.get(conf);

        boolean exists = fileSystem.exists(new Path(path));

        // TODO  判断tmp目录是否存在，如果存在返回True,如果不存在返回False
        System.out.println("exists:{}" + exists);

    }

}