CDH 之 HIVE 异常退出 Permission denied: user=hive, access=WRITE, inode=“/tmp“:hdfs:supergroup:drwxr-xr-x

最新推荐文章于 2024-04-29 17:03:18 发布

啊这

最新推荐文章于 2024-04-29 17:03:18 发布

阅读量486

点赞数 1

分类专栏： CDH 文章标签： hive hdfs hadoop

本文链接：https://blog.csdn.net/qq_25868251/article/details/130828338

版权

CDH 专栏收录该内容

14 篇文章 3 订阅

订阅专栏

HiveServer2在CDH环境中因尝试访问/tmp目录时遇到权限问题而异常退出。日志显示，Hive用户没有写权限，导致无法创建所需临时文件。解决方案是使用HDFS命令修改/tmp目录权限为777，确保Hive有足够权限执行操作。

摘要由CSDN通过智能技术生成

CDH 显示异常退出

查看 HiveServer2 实例在哪台服务器上，查看日志 /var/log/hive/hadoop-cmf-hive-HIVESERVER2-hadoop105.log.out，日志报错如下：

2023-05-23 15:18:05,331 ERROR org.apache.hive.service.server.HiveServer2: [main]: Error starting HiveServer2
java.lang.Error: Max start attempts 30 exhausted
        at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:609) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:94) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:827) [hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:696) [hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
        at org.apache.hadoop.util.RunJar.run(RunJar.java:313) [hadoop-common-3.0.0-cdh6.3.2.jar:?]
        at org.apache.hadoop.util.RunJar.main(RunJar.java:227) [hadoop-common-3.0.0-cdh6.3.2.jar:?]
Caused by: java.lang.RuntimeException: Error applying authorization policy on hive configuration: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp":hdfs:supergroup:drwxr-xr-x
        at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:400)
        at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:256)
        at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:194)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1855)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1839)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1798)
        at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:61)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3101)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1123)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:696)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675)

        at org.apache.hive.service.cli.CLIService.init(CLIService.java:113) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.CompositeService.init(CompositeService.java:59) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:136) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:579) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        ... 9 more
Caused by: java.lang.RuntimeException: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp":hdfs:supergroup:drwxr-xr-x
        at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:400)
        at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:256)
        at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:194)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1855)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1839)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1798)
        at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:61)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3101)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1123)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:696)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675)

        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:604) ~[hive-exec-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:540) ~[hive-exec-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.cli.CLIService.applyAuthorizationConfigPolicy(CLIService.java:125) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.cli.CLIService.init(CLIService.java:110) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.CompositeService.init(CompositeService.java:59) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:136) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
        at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:579) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]

Caused by: java.lang.RuntimeException: Error applying authorization policy on hive configuration: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp":hdfs:supergroup:drwxr-xr-x

这个错误通常表示 Hive 用户没有在 "/tmp" 目录写权限，因此 Hive 无法在该目录下创建所需的临时文件，从而导致其异常退出。

进入 HiveServer2 实例服务器，查看 /tmp 权限

[root@hadoop105 ~]# su - hdfs     
Last login: Tue May 23 15:26:02 CST 2023 on pts/1
[hdfs@hadoop105 ~]$ hdfs dfs -ls -d /tmp
drwxr-xr-x   - hdfs supergroup          0 2023-05-23 14:15 /tmp

将 /tmp 目录权限设置为 "drwxrwxrwt"，否则 hive 是没有权限的，使用如下命令修改 /tmp 的权限

[hdfs@hadoop105 ~]$ hdfs dfs -chmod 777 /tmp

如果无法切换 hdfs 用户，请修改 /etc/passwd 文件，将 hdfs 列的 /sbin/nologin 改为 /bin/bash

啊这

关注

1
点赞
踩
1

收藏

觉得还不错? 一键收藏
打赏
0
评论
CDH 之 HIVE 异常退出 Permission denied: user=hive, access=WRITE, inode=“/tmp“:hdfs:supergroup:drwxr-xr-x

这个错误通常表示 Hive 用户没有在 "/tmp" 目录写权限，因此 Hive 无法在该目录下创建所需的临时文件，从而导致其异常退出。将 /tmp 目录权限设置为 "drwxrwxrwt"，否则 hive 是没有权限的，使用如下命令修改 /tmp 的权限。用户，请修改 /etc/passwd 文件，将 hdfs 列的 /sbin/nologin 改为 /bin/bash。进入 HiveServer2 实例服务器，查看 /tmp 权限。CDH 显示异常退出。
复制链接

扫一扫