HIVE：表中插入数据出错

最新推荐文章于 2024-08-21 02:51:13 发布

ZJ18712852367

最新推荐文章于 2024-08-21 02:51:13 发布

阅读量6k

点赞数

文章标签： hive sql hadoop

本文链接：https://blog.csdn.net/ZJ18712852367/article/details/81589148

版权

在hive中创建表t，id int ，name string ，age int如下图

hive> desc t;
OK
id                      int
name                    string
age                     int

向表中插入数据

hive> insert into t (id,name,age) values (1,'tom',2);

出现错误：

FAILED: SemanticException [Error 10293]: Unable to create temp file for insert values File /tmp/hive/centos/255b0f68-8004-4edb-87d8-970b6543e8fb/_tmp_space.db/Values__Tmp__Table__1/data_file could only be replicated to 0 nodes instead of minReplication (=1).  There are 3 datanode(s) running and 3 node(s) are excluded in this operation.
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1571)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3107)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3031)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:725)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)

已解决！

小白一枚，在网上搜了好多，终于发现自己的问题出现在：全为0，网上其他的小伙伴有的是因为权限问题没有正常启动datanode，但是我已经启用datanode。

[centos@s201 /home/centos]$hadoop dfsadmin -report
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

Configured Capacity: 0 (0 B)
Present Capacity: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used: 0 (0 B)
DFS Used%: NaN%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0

-------------------------------------------------

解决方案：最后才发现我的datanode结点的防火墙未关闭，折腾了一天原来是这个原因。我一直以为只需要关闭namenode的firewalld就可以，datanode的防火墙不关闭会阻碍datanode与namenode之间的通信。