flinkx读取hdfs鉴权kerberos

JenneyAes

已于 2022-04-18 16:23:38 修改

阅读量2.3k

点赞数

分类专栏： flinkx 文章标签：数据同步

于 2022-04-18 16:20:46 首次发布

本文链接：https://blog.csdn.net/zhu_19930414/article/details/124252462

版权

flinkx 专栏收录该内容

1 篇文章 1 订阅

订阅专栏

"hadoopConfig" : {
              "properties.hadoop.user.name": "sync",
              "properties.dfs.ha.namenodes.ns": "hostname1,hostname2",
              "properties.fs.defaultFS": "hdfs://bigdata",
              "properties.dfs.namenode.rpc-address.ns.nn2": "hostname1:8020",
              "properties.dfs.client.failover.proxy.provider.ns": "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider",
              "properties.dfs.namenode.rpc-address.ns.nn1": "hostname2:8020",
              "properties.dfs.nameservices": "bigdata",
              "properties.fs.hdfs.impl.disable.cache": "true",
              "properties.fs.hdfs.impl": "org.apache.hadoop.hdfs.DistributedFileSystem",
              "hadoop.security.authorization": "true",
              "hadoop.security.authentication": "Kerberos",
              "dfs.namenode.kerberos.principal": "sync@xxx.COM",
              "dfs.namenode.keytab.file": "/tmp/sync.keytab",
              "java.security.krb5.conf": "/etc/krb5.conf",
              "useLocalFile": "true",
              "principalFile": "/tmp/sync.keytab",
              "principal": "sync@xxx.COM"
            },

flinkx 验证kerberos hdfs 鉴权，亲测可用