Hive报错Error during job, obtaining debugging information...

107851 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN  org.apache.hadoop.hive.ql.session.SessionState  - METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.
111766 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN  org.apache.hadoop.hive.ql.Driver  - Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = root_20231201002745_d175f2b9-c8c8-47c3-bb31-e160e44202cc
Total jobs = 2
Launching Job 1 out of 2
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapreduce.job.reduces=<number>
112804 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN  org.apache.hadoop.mapreduce.JobResourceUploader  - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
Starting Job = job_1700588325806_0039, Tracking URL = http://bigdata1:8088/proxy/application_1700588325806_0039/
Kill Command = /opt/module/hadoop-3.1.3/bin/mapred job  -kill job_1700588325806_0039
Hadoop job information for Stage-3: number of mappers: 0; number of reducers: 0
142543 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN  mapreduce.Counters  - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2023-12-01 00:28:20,287 Stage-3 map = 0%,  reduce = 0%
142548 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN  mapreduce.Counters  - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
Ended Job = job_1700588325806_0039 with errors
142563 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] ERROR org.apache.hadoop.hive.ql.exec.Task  - Ended Job = job_1700588325806_0039 with errors
Error during job, obtaining debugging information...
142564 [Thread-35] ERROR org.apache.hadoop.hive.ql.exec.Task  - Error during job, obtaining debugging information...
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
142600 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] ERROR org.apache.hadoop.hive.ql.Driver  - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched: 
142626 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN  mapreduce.Counters  - Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
Stage-Stage-3:  HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec
当Hive发生类似的报错时,可以使用

set hive.exec.mode.local.auto.input.files.max=[number]
将执行过程中的文件上限指定的大一些,默认情况下是4

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

.英杰

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值