关于hive动态分区太多的问题解决方案

最新推荐文章于 2024-09-25 11:18:24 发布

今夕何夕-l

最新推荐文章于 2024-09-25 11:18:24 发布

阅读量2.9k

点赞数 2

分类专栏： Hive 文章标签： hadoop

本文链接：https://blog.csdn.net/qq_47947471/article/details/108739435

版权

在尝试使用Hive插入分区表时遇到错误，原因是city分区超过默认限制。通过调整Hive配置设置，成功解决了这个问题。

摘要由CSDN通过智能技术生成

今天在hive插入分区表的时候出现以下报错

hive>
insert into table ods_PoliceKill_partition partition (city) select id,name,date,manner_of_death,armed,age,gender,race,state,signs_of_mental_illness,threat_level,flee,body_camera,city from ods_PoliceKill;

报错如下:

java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"id":147,"name":"Richard Carlin","date":"13/02/15","manner_of_death":"shot","armed":"unarmed","age":35,"gender":"M","race":"H","city":"Reading","state":"PA","signs_of_mental_illness":"FALSE","threat_level":"other","flee":"Not fleeing","body_camera":"FALSE"}
	at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
	at org.apache.hadoop.mapred.MapRunner.run(MapRu