hive执行sql:stage-1 map = 0 reduce = 0

Alcaibur

于 2023-05-09 17:05:41 发布

阅读量1k

点赞数

文章标签： hive sql hadoop

本文链接：https://blog.csdn.net/Alcaibur/article/details/130584047

版权

在执行Hive连表操作时遇到stage-1 map = 0 reduce = 0的问题，可能是由于笛卡尔积、YARN资源不足或者MapReduce任务输出错误等原因。解决方案包括检查SQL语句、调整YARN资源配置、验证MapReduce任务的正确性以及考虑升级Hive版本。

摘要由CSDN通过智能技术生成

执行hive连表时，出现这种情况：

WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = root_20180824151434_b0b979fe-7a85-4ac6-b924-33dd40897a28
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_1535114415498_0379, Tracking URL = http://master:8088/proxy/application_1535114415498_0379/
Kill Command = /opt/hadoop-2.7.4/bin/hadoop job  -kill job_1535114415498_0379
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
2023-04-24 15:14:57,985 Stage-1 map = 0%,  reduce = 0%
2023-04-24 15:15:58,823 Stage-1 map = 0%,  reduce = 0%
2023-04-24 15:16:59,579 Stage-1 map = 0%,  reduce = 0%
2023-04-24 15:18:00,262 Stage-1 map = 0%,  reduce = 0%
2023-04-24 15:19:00,912