Hive端执行 select count(*) from cdprojectdetail；出现如下错误：

womode

已于 2022-04-21 17:48:18 修改

阅读量2.8k

点赞数 3

分类专栏：学习路上文章标签： hive hbase

于 2022-04-21 17:47:56 首次发布

本文链接：https://blog.csdn.net/womode/article/details/124327622

版权

在Hive中执行`select count(*) from cdprojectdetail`时遇到错误，经过排查发现是由于Namenode内存不足导致的新job无法运行。通过在Hive shell中设置`hive.exec.mode.local.auto=true`使得任务在本地模式下执行，问题得到解决。

摘要由CSDN通过智能技术生成

好不容易搞出了hbase和hive的外链表组合应用。却在 hive端执行 select count(*) from cdprojectdetail; 出现如下错误：

Query ID = root_20220421173314_ade31c99-1ec5-4419-88c7-997bf8e82577
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
2022-04-21 17:33:15 INFO client.AHSProxy: Connecting to Application History server at udp02/10.12.3.12:10201
2022-04-21 17:33:15 INFO client.AHSProxy: Connecting to Application History server at udp02/10.12.3.12:10201
Starting Job = job_1649670158454_0012, Tracking URL = http://udp01:8088/proxy/application_1649670158454_0012/