HBase Compression

最新推荐文章于 2024-05-16 09:14:38 发布

macyang

最新推荐文章于 2024-05-16 09:14:38 发布

阅读量4.7k

点赞数

分类专栏： database/nosql 文章标签： compression hbase algorithm command performance encoding

本文链接：https://blog.csdn.net/macyang/article/details/6618541

版权

本文介绍了HBase的压缩算法，包括GZIP, LZO和Snappy，并推荐使用Snappy，因其具备良好的编码/解码速度和压缩率。文章强调了在非压缩内容如JPEG图片之外的场景中启用压缩通常能提升整体性能，因为CPU的压缩和解压开销小于从磁盘读取更多数据的代价。同时，讲述了如何启用压缩以及可用的压缩算法特点。" 134620021,8658200,OpenGL在Qt中实现图元颜色设置,"['OpenGL', 'Qt', 'C++', '图形编程']

摘要由CSDN通过智能技术生成

Compression就是在用CPU换IO吞吐量/磁盘空间，如果没有什么特殊原因推荐针对Column Family设置compression，下面主要有三种算法: GZIP, LZO, Snappy，作者推荐使用Snappy，因为它有较好的Encoding/Decoding速度和可以接受的压缩率。

HBase comes with support for a number of compression algorithims that can be enabled at the column family level. Enabling compression is recommended unless you have a reason not to do so, for example, when using already compressed content, such as JPEG images. For every other use-case compression usually will yield an overall better performance, because the overhead of the CPU performing the compression and decompression is less than what is required to read more data from disk.

Available Codecs

You can choose from a fixed list of supported compression algorithms. They have different qualities when it comes to compression ratio, as well as CPU a