https://issues.apache.org/jira/browse/HADOOP-9692
当sequencefile 有大小为0的文件时,会报异常:
sequencefile reader throws EOFException on zero-length file, stacktrace as shown:
Caused by: java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:180)
at java.io.DataInputStream.readFully(DataInputStream.java:152)
at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1845)
at org.apache.hadoop.io.SequenceFile$Reader.initialize(SequenceFile.java:1810)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1759)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1773)
at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:49)
at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:64)
at org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.<init>(CombineHiveRecordReader.java:65)
... 16 more
-
Affects Version/s: 2.0.3-alpha, 2.1.0-beta, 2.0.5-alpha
-
Fix Version/s: 2.8.0, 3.0.0-alpha1
这是hadoop的一个Bug,受影响的版本2.0.3-alpha, 2.1.0-beta, 2.0.5-alpha ,修复版本 2.8.0, 3.0.0-alpha1