hadoop生态的kerberos认证系列1-zookeeper

最新推荐文章于 2024-05-01 08:50:23 发布
最新推荐文章于 2024-05-01 08:50:23 发布
阅读量1.4k 收藏 4
点赞数
分类专栏： 大数据探索 文章标签： zookeeper hadoop kerberos linux
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/tktttt/article/details/111301773
版权

hadoop生态的kerberos认证系列1—zookeeper

一、zookeeper

1.准备工作

停掉hadoop集群；
安装好kerberos认证服务；

2.配置

节点名为node，本文以单节点为例说明，集群一般也差不多，只要配置文件统一、凭证区分开即可（本文操作过程中，因计算机性能等问题，将集群全部缩容为单节点）

2.1创建服务端用户

在安装好后使用命令：kadmin.local进入本地管理员模式
为zk的服务端创建zookeeper用户：

注意：必须创建zookeeper用户，其他用户名会导致认证出现问题

kadmin.local:  addprinc zookeeper/node
WARNING: no policy specified for zookeeper/node@HADOOP.COM; defaulting to no policy
Enter password for principal "zookeeper/node@HADOOP.COM":
Re-enter password for principal "zookeeper/node@HADOOP.COM":
Principal "zookeeper/node@HADOOP.COM" created.
kadmin.local:

2.2导出凭证：

kadmin.local:  ktadd -norandkey -k /usr/data/kerberos/keytab/root.keytab zookeeper/node

2.3修改zookeeper的配置文件

命令vi ${ZOOKEEPER_HOME}/conf/zoo.cfg
加入以下内容：

authProvider.1=org.apache.zookeeper.server.auth.SASLAuthenticationProvider  ##开启认证功能
jaasLoginRenew=3600000   ##重写时间
kerberos.removeHostFromPrincipal=true  #将principal对应的主机名去掉，防止hbase等服务访问zookeeper时报错，如GSS initiate failed时就有可能是该项没配置

2.4生成jaas.conf文件

命令生成touch jaas.conf，编辑vi jaas.conf

Server {
  com.sun.security.auth.module.Krb5LoginModule required
  useKeyTab=true
  keyTab="/usr/data/kerberos/keytab/root.keytab"
  storeKey=true
  useTicketCache=false
  principal="zookeeper/node@HADOOP.COM";
};

JAAS配置文件定义用于身份验证的属性，如服务主体和 keytab 文件的位置等。其中的属性意义如下：

  • useKeyTab：这个布尔属性定义了我们是否应该使用一个keytab文件（在这种情况下是true）。
  • keyTab：JAAS配置文件的此部分用于主体的keytab文件的位置和名称。路径应该用双引号括起来。
  • storeKey：这个布尔属性允许密钥存储在用户的私人凭证中。
  • useTicketCache：该布尔属性允许从票证缓存中获取票证。
  • debug：此布尔属性将输出调试消息，以帮助进行疑难解答。
  • principal：要使用的服务主体的名称。

2.5创建client的principal并导出

kadmin.local:  addprinc zkcli/node
kadmin.local:  ktadd -norandkey -k /usr/data/kerberos/keytab/root.keytab zkcli/node

2.6配置client-jaas.conf文件

命令生成touch client-jaas.conf，编辑vi client-jaas.conf

Client {
  com.sun.security.auth.module.Krb5LoginModule required
  useKeyTab=true
  keyTab="/usr/local/zookeeper/conf/zk-clie.keytab"
  storeKey=true
  useTicketCache=false
  principal="zkcli/node@HADOOP.COM";
};

3.验证zk的kerberos

[root@node bin]# export JVMFLAGS="-Djava.security.auth.login.config=/usr/local/zookeeper/zookeeper-3.4.14/conf/jaas.conf"
[root@node bin]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/zookeeper-3.4.14/conf/zoo.cfg
Starting zookeeper ... STARTED
[root@node bin]# export JVMFLAGS="-Djava.security.auth.login.config=/usr/local/zookeeper/zookeeper-3.4.14/conf/client-jaas.conf"
[root@node bin]# echo $JVMFLAGS
-Djava.security.auth.login.config=/usr/local/zookeeper/zookeeper-3.4.14/conf/client-jaas.conf
[root@node bin]# zkCli.sh -server node:2181

此时会发现连接不上
登录kerberos（此处是用的root/node用户，该用户是之前建好的，创建方法同上，用其他用户也可以的）：

kinit -kt /usr/data/kerberos/keytab/root.keytab root/node

再重新运行命令zkCli.sh -server node:2181
发现可以连接，并进行操作：

[root@node ~]# zkCli.sh -server node:2181
Connecting to node:2181
2020-12-17 09:54:40,873 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf, built on 03/06/2019 16:18 GMT
2020-12-17 09:54:40,876 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=node
2020-12-17 09:54:40,876 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_261
2020-12-17 09:54:40,878 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2020-12-17 09:54:40,878 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/usr/local/java/jdk1.8.0_261/jre
2020-12-17 09:54:40,878 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/target/classes:/usr/local/zookeeper/zookeeper-3.4.14/bin/../build/classes:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/target/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../build/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/slf4j-log4j12-1.7.25.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/slf4j-api-1.7.25.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/netty-3.10.6.Final.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/log4j-1.2.17.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/audience-annotations-0.5.0.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-3.4.14.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/src/main/resources/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../conf:.:/usr/local/java/jdk1.8.0_261/lib/dt.jar:/usr/local/java/jdk1.8.0_261/lib/tools.jar:/usr/local/hadoop/hadoop-2.7.4/bin/hadoop
2020-12-17 09:54:40,878 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2020-12-17 09:54:40,878 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2020-12-17 09:54:40,878 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2020-12-17 09:54:40,878 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
2020-12-17 09:54:40,878 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2020-12-17 09:54:40,879 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-1127.el7.x86_64
2020-12-17 09:54:40,879 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=root
2020-12-17 09:54:40,879 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/root
2020-12-17 09:54:40,879 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/root
2020-12-17 09:54:40,879 [myid:] - INFO  [main:ZooKeeper@442] - Initiating client connection, connectString=node:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@277050dc
Welcome to ZooKeeper!
2020-12-17 09:54:40,926 [myid:] - INFO  [main-SendThread(node:2181):ClientCnxn$SendThread@1025] - Opening socket connection to server node/192.168.88.129:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2020-12-17 09:54:40,932 [myid:] - INFO  [main-SendThread(node:2181):ClientCnxn$SendThread@879] - Socket connection established to node/192.168.88.129:2181, initiating session
2020-12-17 09:54:40,962 [myid:] - INFO  [main-SendThread(node:2181):ClientCnxn$SendThread@1299] - Session establishment complete on server node/192.168.88.129:2181, sessionid = 0x10017d2e7bc004b, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[zk: node:2181(CONNECTED) 0] ls /
[zookeeper, hbase, kylin]
[zk: node:2181(CONNECTED) 1]

4.更正

在2.4生成jaas.conf文件中
命令生成touch jaas.conf，编辑vi jaas.conf，将server、client的配置全部都写到一起

Server {
  com.sun.security.auth.module.Krb5LoginModule required
  useKeyTab=true
  keyTab="/usr/data/kerberos/keytab/root.keytab"
  storeKey=true
  useTicketCache=false
  principal="zookeeper/node@HADOOP.COM";
};

Client {
  com.sun.security.auth.module.Krb5LoginModule required
  useKeyTab=true
  keyTab="/usr/local/zookeeper/conf/zk-clie.keytab"
  storeKey=true
  useTicketCache=false
  principal="zkcli/node@HADOOP.COM";
};

并在/conf下生成java.env文件，加入以下内容：

export JVMFLAGS="-Djava.security.auth.login.config=/usr/local/zookeeper/zookeeper-3.4.14/conf/jaas.conf"

这样省的经常忘记引入配置变量
然后直接启动：

zkServer.sh start

再用以下命令发现：

[root@node conf]# zkCli.sh 
Connecting to localhost:2181
2020-12-18 09:54:43,352 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf, built on 03/06/2019 16:18 GMT
2020-12-18 09:54:43,354 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=node
2020-12-18 09:54:43,354 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_261
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/usr/local/java/jdk1.8.0_261/jre
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/target/classes:/usr/local/zookeeper/zookeeper-3.4.14/bin/../build/classes:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/target/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../build/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/slf4j-log4j12-1.7.25.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/slf4j-api-1.7.25.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/netty-3.10.6.Final.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/log4j-1.2.17.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/audience-annotations-0.5.0.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-3.4.14.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/src/main/resources/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../conf:.:/usr/local/java/jdk1.8.0_261/lib/dt.jar:/usr/local/java/jdk1.8.0_261/lib/tools.jar:/usr/local/hadoop/hadoop-2.7.4/bin/hadoop
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-1127.el7.x86_64
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=root
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/root
2020-12-18 09:54:43,356 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/usr/local/zookeeper/zookeeper-3.4.14/conf
2020-12-18 09:54:43,357 [myid:] - INFO  [main:ZooKeeper@442] - Initiating client connection, connectString=localhost:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@277050dc
Welcome to ZooKeeper!
JLine support is enabled
[zk: localhost:2181(CONNECTING) 0] 2020-12-18 09:54:43,680 [myid:] - INFO  [main-SendThread(localhost:2181):Login@297] - Client successfully logged in.
2020-12-18 09:54:43,683 [myid:] - INFO  [main-SendThread(localhost:2181):SecurityUtils$1@124] - Client will use GSSAPI as SASL mechanism.
2020-12-18 09:54:43,687 [myid:] - INFO  [Thread-1:Login$1@130] - TGT refresh thread started.
2020-12-18 09:54:43,691 [myid:] - INFO  [Thread-1:Login@305] - TGT valid starting at:        Fri Dec 18 09:54:43 CST 2020
2020-12-18 09:54:43,691 [myid:] - INFO  [Thread-1:Login@306] - TGT expires:                  Sun Dec 20 09:54:43 CST 2020
2020-12-18 09:54:43,691 [myid:] - INFO  [Thread-1:Login$1@185] - TGT refresh sleeping until: Sun Dec 20 00:52:24 CST 2020
2020-12-18 09:54:43,707 [myid:] - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@1025] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1%1:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
2020-12-18 09:54:43,710 [myid:] - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@879] - Socket connection established to localhost/0:0:0:0:0:0:0:1%1:2181, initiating session
2020-12-18 09:54:43,721 [myid:] - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@1299] - Session establishment complete on server localhost/0:0:0:0:0:0:0:1%1:2181, sessionid = 0x1000025d1a00000, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
2020-12-18 09:54:43,733 [myid:] - ERROR [main-SendThread(localhost:2181):ZooKeeperSaslClient@308] - An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - LOOKING_UP_SERVER)]) occurred when evaluating Zookeeper Quorum Member's  received SASL token. Zookeeper Client will go to AUTH_FAILED state.
2020-12-18 09:54:43,734 [myid:] - ERROR [main-SendThread(localhost:2181):ClientCnxn$SendThread@1072] - SASL authentication with Zookeeper Quorum member failed: javax.security.sasl.SaslException: An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - LOOKING_UP_SERVER)]) occurred when evaluating Zookeeper Quorum Member's  received SASL token. Zookeeper Client will go to AUTH_FAILED state.

WATCHER::

WatchedEvent state:AuthFailed type:None path:null

[zk: localhost:2181(AUTH_FAILED) 0] ls /
Not connected

改用以下命令，发现

zkCli.sh -server node:2181

[root@node conf]# zkCli.sh -server node
Connecting to node
2020-12-18 09:55:07,652 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf, built on 03/06/2019 16:18 GMT
2020-12-18 09:55:07,655 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=node
2020-12-18 09:55:07,655 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_261
2020-12-18 09:55:07,656 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/usr/local/java/jdk1.8.0_261/jre
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/target/classes:/usr/local/zookeeper/zookeeper-3.4.14/bin/../build/classes:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/target/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../build/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/slf4j-log4j12-1.7.25.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/slf4j-api-1.7.25.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/netty-3.10.6.Final.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/log4j-1.2.17.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../lib/audience-annotations-0.5.0.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-3.4.14.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../zookeeper-server/src/main/resources/lib/*.jar:/usr/local/zookeeper/zookeeper-3.4.14/bin/../conf:.:/usr/local/java/jdk1.8.0_261/lib/dt.jar:/usr/local/java/jdk1.8.0_261/lib/tools.jar:/usr/local/hadoop/hadoop-2.7.4/bin/hadoop
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-1127.el7.x86_64
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=root
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/root
2020-12-18 09:55:07,657 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/usr/local/zookeeper/zookeeper-3.4.14/conf
2020-12-18 09:55:07,658 [myid:] - INFO  [main:ZooKeeper@442] - Initiating client connection, connectString=node sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@277050dc
Welcome to ZooKeeper!
JLine support is enabled
[zk: node(CONNECTING) 0] 2020-12-18 09:55:07,940 [myid:] - INFO  [main-SendThread(node:2181):Login@297] - Client successfully logged in.
2020-12-18 09:55:07,942 [myid:] - INFO  [Thread-1:Login$1@130] - TGT refresh thread started.
2020-12-18 09:55:07,945 [myid:] - INFO  [Thread-1:Login@305] - TGT valid starting at:        Fri Dec 18 09:55:07 CST 2020
2020-12-18 09:55:07,945 [myid:] - INFO  [Thread-1:Login@306] - TGT expires:                  Sun Dec 20 09:55:07 CST 2020
2020-12-18 09:55:07,945 [myid:] - INFO  [Thread-1:Login$1@185] - TGT refresh sleeping until: Sun Dec 20 01:31:29 CST 2020
2020-12-18 09:55:07,949 [myid:] - INFO  [main-SendThread(node:2181):SecurityUtils$1@124] - Client will use GSSAPI as SASL mechanism.
2020-12-18 09:55:07,957 [myid:] - INFO  [main-SendThread(node:2181):ClientCnxn$SendThread@1025] - Opening socket connection to server node/192.168.88.129:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
2020-12-18 09:55:07,960 [myid:] - INFO  [main-SendThread(node:2181):ClientCnxn$SendThread@879] - Socket connection established to node/192.168.88.129:2181, initiating session
2020-12-18 09:55:07,967 [myid:] - INFO  [main-SendThread(node:2181):ClientCnxn$SendThread@1299] - Session establishment complete on server node/192.168.88.129:2181, sessionid = 0x1000025d1a00001, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null

WATCHER::

WatchedEvent state:SaslAuthenticated type:None path:null

[zk: node(CONNECTED) 0] ls /
[zookeeper, hbase, kylin]
[zk: node(CONNECTED) 1]
桃橙柳
关注
  • 0
    点赞
  • 踩
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
hadoop 上安装配置Kerberos支持的zookeeper
may_violin的专栏
11-18 1631
我的环境： Red Hat Enterprise Linux Server release 5.5 （查看系统版本的命令：lsb_release -a）  64位 Java 环境：jdk1.7.0_51 Hadoop版本：编译过源码的2.2.0 Hbase版本：0.94-17 zookeeper版本：
大数据安全-kerberos技术-zookeeper安装包
06-06
本资源包含的是大数据安全背景下的Kerberos与ZooKeeper的集成应用，特别是ZooKeeper的安装包，版本为`apache-zookeeper-3.6.3-bin.tar.gz`。 ZooKeeper是由Apache软件基金会开发的一个分布式协调服务，它为分布式...
hadoop快速集成kerberos认证
01-13
里面包含hadoop快速集成kerberos认证相关脚本与安装包。可以通过脚本直接修改hadoop，zookeeper，hbase关于集成kerberos相关配置，一键修改，一键启动，方便快捷！！！
2024年最新Apache zookeeper kafka 开启SASL安全认证_kafka开启认证
最新发布
2401_84302369的博客
05-01 1242
在实际的渗透测试过程中，面对复杂多变的网络环境，当常用工具不能满足实际需求的时候，往往需要对现有工具进行扩展，或者编写符合我们要求的工具、自动化脚本，这个时候就需要具备一定的编程能力。使用kafka-console-producer.sh脚本测试生产者，由于开启安全认证和授权，此时使用console-producer脚本来尝试发送消息，那么消息会发送失败，原因是没有指定合法的认证用户，因此客户端需要做相应的配置，需要创建一个名为producer.conf的配置文件给producer程序使用。
Kerberos环境下 命令行连接kafka 和zk
h952520296的博客
07-01 2110
加入kerberos 之后用普通命令行就无法直接操作kafka和zk了 需要增加几个文件首先添加kafka的环境文件 启动producer consumer 需要另外一个文件 然后命令行启动即可 连接zk也需要同样的一个配置文件 编写jaas-zk-keytab.conf文件 将jaas-zk-keytab.conf加载到环境变量 连接客户端时候一定要用-server参数指定zookeeper节点，不然连接不上不行就也kinit 一下 再连接.........
Kafka JAAS Plain SASL 安全认证配置
坚持的旅程
07-27 1万+
1. 为zookeeper添加 jaas 文件 zookeeper { org.apache.kafka.common.security.plain.PlainLoginModule required username="geting" password="geting"; };
开启zookeeper的安全认证功能，并配置kafka对zookeeper的身份验证
热门推荐
zhang5324496的博客
12-21 2万+
目录 1-- 为啥需要开启zookeeper认证 2-- 如何开启zookeeper认证 2.1-- 修改文件 zoo.cfg， 开启认证功能 2.2-- 创建 jaas.conf文件，配置认证的用户和密码(例子的文件路径为 /etc/zookeeper/jaas.conf) 2.3-- 设置jaas.conf的权限，权限是 zookeeper 组件的用户，假设组件zookeeper的拥有使用者名为 zkp，所需组为root 2.4-- 更新zookeeper的JVM flags 2.5...
大数据的安全管理 -- JAAS 认证代码
eyoulc123的博客
12-12 1318
1. JaaS代码在前面已经说明了JAAS的使用，在这一节，主要是解析JAAS在认证时的代码流程，我们可以看到其认证过程只有两行代码：LoginContext lc = new LoginContext("JaaSSampleTest", new TextCallbackHandler()); lc.login();我们可以把它分为二个部分：上下文设置， 登录1.1 上下文的设置LoginCont
hadoop-2.7.4.tar.gz
07-08
8. **Hadoop生态**：Hadoop生态系统还包括一系列关联项目，如Hive（数据仓库工具）、Pig（数据流处理）、HBase（NoSQL数据库）、Oozie（工作流调度器）和ZooKeeper（分布式协调服务），这些工具与Hadoop紧密集成，...
hadoop-2.10.0jar.zip
07-18
包含hadoop平台Java开发的所有所需jar包，例如activation-1.1.jar apacheds-i18n-2.0.0-M15.jar apacheds-kerberos-codec-2.0.0-M15.jar api-asn1-api-1.0.0-M20.jar api-util-1.0.0-M20.jar ...zookeeper-3.4.9.jar
Hadoop生态简介
02-18
8. **安全性与权限管理**：Hadoop生态系统通过Hadoop的认证、授权和审计机制，如Kerberos和Hadoop的访问控制列表（ACLs），提供了安全的数据存储和访问环境。 9. **YARN**：Yet Another Resource Negotiator（YARN...
JAAS 身份验证技术入门
08-01
JAAS 身份验证技术入门作者 马林
Kafka启用SASL_PLAINTEXT动态配置JAAS文件的几种方式
russle的专栏
07-14 2万+
Kafka是广泛使用消息服务，很多情况下关于认证部分我都是默认的配置，也就是不需要用户名/密码，也不配置证书。在内网或者在项目组内部可以，但是设计的跨部门时一般处于安全考虑都需要加上认证，防止kafka被误用，产生大量垃圾信息，干扰了正常业务的运行。 Kafka提供的多种认证方式，比如SASL, 本文主要介绍启用了SASL_PLAINTEXT时，如何在kafka client配置jaas文件，以...
zookeeper开启SASL,并且设置kafka如何连接
chou_kawaii的博客
09-02 4972
zookeeper开启sasl认证
Kerberos原理安装集成kafka例子
m0_37911384的博客
05-20 4994
目录 Kerbeos简介 Kerbeos认证流程 Kerberos安装步骤 kerberos简单操作 Kafka集成Kerberos例子 本地环境java客户端消费测试代码 错误记录 Kerbeos简介 Kerberos可以将认证的密钥在集群部署时事先放到可靠的节点上。集群运行时，集群内的节点使用密钥得到认证，认证通过后的节点才能提供服务。企图冒充的节点由于没...
Kafka Client配置JAAS的几种方式
sun
12-30 2658
第一种 Properties props = new Properties(); props.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, “ubuntu:9092”); props.put(“acks”, “all”); props.put(“retries”, 0); props.put(“batch.size”, 16384); props.p...
Java连接Kerberos认证的Kafak
WZY_snail的博客
04-13 7041
Java连接Kerberos认证的Kafak Java：甲。Kafka:乙。 一、一般需要三个文件。xxx.keytab ，xxkrb5.conf , 创建的 jaas.conf。 1、连谁让谁提供 xxx.keytab文件，进行身份验证（该文件由乙提供）。 2、添加krb5.conf文件，可直接从kdc所在服务器复制或让（内容由乙提供）。 #配置片段也可以放在此目录中 /etc/kr...
zookeeper配置kerberos
m0_37911384的博客
05-21 2732
zookeeper配置kerberos 前提：安装好zookeeper和kerberos 步骤： 1、创建kerberos用户 kadmin.local addprinc zookeeper/es1 //es1主机名 2、生成zookeeper认证用户keytab kadmin.local -q "xst -k /usr/local/zookeeper/key...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值