Gzip在hdfs上不可拆分
解决方法:
把Gzip换成Bzip
/**
* SequenceFile.Writer.Option op3 = SequenceFile.Writer.compression(SequenceFile.CompressionType.RECORD,new GzipCodec());
*/
SequenceFile.Writer.Option op3 = SequenceFile.Writer.compression(SequenceFile.CompressionType.BLOCK,new BZip2Codec());