Hive：cause:java.io.IOException: java.io.EOFException: Unexpected end of input stream

2023-07-21 08:48:14,700 INFO [main] org.apache.hadoop.hive.ql.exec.SelectOperator: 1 Close done
2023-07-21 08:48:14,700 INFO [main] org.apache.hadoop.hive.ql.exec.TableScanOperator: 0 Close done
2023-07-21 08:48:14,700 INFO [main] org.apache.hadoop.hive.ql.exec.MapOperator: 4 Close done
2023-07-21 08:48:14,704 WARN [main] org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:pgxl (auth:SIMPLE) cause:java.io.IOException: java.io.EOFException: Unexpected end of input stream
2023-07-21 08:48:14,706 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: java.io.EOFException: Unexpected end of input stream
	at org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderNextException(HiveIOExceptionHandlerChain.java:121)
	at org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderNextException(HiveIOExceptionHandlerUtil.java:77)
	at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:355)
	at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:79)
	at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:33)
	at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:116)
	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:199)
	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:185)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:52)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.io.EOFException: Unexpected end of input stream
	at org.apache.hadoop.io.compress.DecompressorStream.decompress(DecompressorStream.java:165)
	at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:105)
	at java.io.InputStream.read(InputStream.java:101)
	at org.apache.hadoop.util.LineReader.fillBuffer(LineReader.java:180)
	at org.apache.hadoop.util.LineReader.readDefaultLine(LineReader.java:216)
	at org.apache.hadoop.util.LineReader.readLine(LineReader.java:174)
	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:248)
	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:48)
	at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:350)
	... 13 more

2023-07-21 08:48:14,709 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the task
2023-07-21 08:48:14,813 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask metrics system...
2023-07-21 08:48:14,813 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system stopped.
2023-07-21 08:48:14,813 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system shutdown complete.

hive在map、reduce执行完之后，报如上错误信息，
原因基本上有：
空文件
不完整的文件
gz格式压缩的有问题
文件没有正确结束，例如.gz
文件数据有问题
解决办法：
删除对应文件…
参考:https://issues.apache.org/jira/browse/HIVE-12655

下载一下，发现文件下载不下来，说明文件未完全生成。
说明该文件下的，09点无数据，或者文件未完全生成。

查一下数据：
select count(1) from wedw_ods.module_consult_adimit_type_log_h
where date_id = ‘2023-07-20’ and hour = ‘09’ ;

select * from wedw_ods.module_consult_adimit_type_log_h
where date_id = ‘2023-07-20’ and hour = ‘09’ ;

select * from wedw_ods.module_consult_adimit_type_log_h
where date_id = ‘2023-07-20’ and hour = ‘09’ limit 10;

说明09点的数据，其中某些有问题，修改有问题数据，可以针对改数据重新生成，即可解决报错。

再重跑统计任务已经不报错了