107851 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN org.apache.hadoop.hive.ql.session.SessionState - METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.
111766 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN org.apache.hadoop.hive.ql.Driver - Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = root_20231201002745_d175f2b9-c8c8-47c3-bb31-e160e44202cc
Total jobs = 2
Launching Job 1 out of 2
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
112804 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN org.apache.hadoop.mapreduce.JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
Starting Job = job_1700588325806_0039, Tracking URL = http://bigdata1:8088/proxy/application_1700588325806_0039/
Kill Command = /opt/module/hadoop-3.1.3/bin/mapred job -kill job_1700588325806_0039
Hadoop job information for Stage-3: number of mappers: 0; number of reducers: 0
142543 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN mapreduce.Counters - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2023-12-01 00:28:20,287 Stage-3 map = 0%, reduce = 0%
142548 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN mapreduce.Counters - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
Ended Job = job_1700588325806_0039 with errors
142563 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] ERROR org.apache.hadoop.hive.ql.exec.Task - Ended Job = job_1700588325806_0039 with errors
Error during job, obtaining debugging information...
142564 [Thread-35] ERROR org.apache.hadoop.hive.ql.exec.Task - Error during job, obtaining debugging information...
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
142600 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] ERROR org.apache.hadoop.hive.ql.Driver - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
142626 [acc21ad0-6de0-4836-b4d4-19705f8c2773 main] WARN mapreduce.Counters - Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
Stage-Stage-3: HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec
当Hive发生类似的报错时,可以使用
set hive.exec.mode.local.auto.input.files.max=[number]
将执行过程中的文件上限指定的大一些,默认情况下是4