hadoop启动bzip2压缩

hadoop启动bzip2压缩

在mapred-site.xml中添加如下配置：

<property>

  <name>mapred.output.compression.codec</name>
  <value>org.apache.hadoop.io.compress.BZip2Codec</value>
  <description>If the job outputs are compressed, how should they be compressed?
  </description>
</property>


<property>
  <name>mapred.output.compression.type</name>
  <value>BLOCK</value>
  <description>If the job outputs are to compressed as SequenceFiles, how should
               they be compressed? Should be one of NONE, RECORD or BLOCK.
  </description>
</property>
<property>
  <name>mapred.compress.map.output</name>
  <value>true</value>
  <description>Should the outputs of the maps be compressed before being
               sent across the network. Uses SequenceFile compression.
  </description>
</property>


<property>
  <name>mapred.map.output.compression.codec</name>
  <value>org.apache.hadoop.io.compress.BZip2Codec</value>
  <description>If the map outputs are compressed, how should they be
               compressed?
  </description>
</property>