https://zhuanlan.zhihu.com/p/145551967?utm_source=wechat_session hbase详细介绍
https://blog.csdn.net/whdxjbw/article/details/81101200 hbase简介
https://wenku.baidu.com/view/0557c682cc7931b765ce15c4.html hbase查询命令
https://www.cnblogs.com/zzpblogs/p/10683356.html hbase插入数据命令
put 'cupid_dmxfeat_jd_model_shop_data_s_d_bank','0e74f82_101009','f:pin','101009'
put 'cupid_dmxfeat_jd_model_shop_data_s_d_bank','0e74f82_101009','f:dt','2020-06-15'
put 'cupid_dmxfeat_jd_model_shop_data_s_d_bank','0e74f82_101009','f:data','20191217104330214114337362:113.9461:22.49881:440300:10120191211140944054119810092,20191217104330234808823987:114.0112:22.60045:440300:10120191211140944054119810092,20191217104330381565157469:114.1274:22.54749:440300:10120191211140944054119810092,20191217104330497577134122:113.9458:22.53038:440300:10120191211140944054119810092'
https://www.cnblogs.com/cxzdy/p/5583239.htmlHBase 常用Shell命令
https://blog.csdn.net/qq_38025219/article/details/88030899 hbase压缩减少存储空间
hbase建表优化如下:
1、分区
1W 以下的不分区
可以如下执行:
create 'xxxxx', 'f'
1000-100W可以如下执行:
create 'xxxxx', 'f', SPLITS => ['19','33','4d','67','81','9b','b5','cf','e9']
100W -1000W可以如下执行:
create 'xxxxx', 'f', SPLITS => ['0c','19','26','33','40','4d','5a','67','74','81','8e','9b','a8','b5','c2','cf','dc','e9','f6']
千万级到亿可以如下执行,
create 'xxxxx', 'f', SPLITS => ['07','0f','17','1f','27','2f','37','3f','47','4f','57','5f','67','6f','77','7f','87','8f','97','9f','a7','af','b7','bf','c7','cf','d7','df','e7','ef','f7','ff']
1亿到10亿可以如下执行:
试用 create 'xxxxx', 'f', SPLITS => ['07','0f','17','1f','27','2f','37','3f','47','4f','57','5f','67','6f','77','7f','87','8f','97','9f','a7','af','b7','bf','c7','cf','d7','df','e7','ef','f7','ff']
后续用create 'xxxxx', 'f', SPLITS => ['05','0b','11','17','1d','23','29','2f','35','3b','41','47','4d','53','59','5f','65','6b','71','77','7d','83','89','8f','95','9b','a1','a7','ad','b3','b9','bf','c5','cb','d1','d7','dd','e3','e9','ef','f5','fb']
十亿以上
create 'xxxxx', 'f', SPLITS => ['04','09','0e','13','18','1d','22','27','2c','31','36','3b','40','45','4a','4f','54','59','5e','63','68','6d','72','77','7c','81','86','8b','90','95','9a','9f','a4','a9','ae','b3','b8','bd','c2','c7','cc','d1','d6','db','e0','e5','ea','ef','f4','f9','fe']
2、针对大表建议设置表的有效期,如设置7天,从插入数据开始算时,7天内如果没有更新,则被删除。
alter ‘cupid_dmcqm_lhmx_app_jr_cms_recmd_rslt_weight_pin_2q_a_d’, {NAME => ‘f’, TTL => ‘604800’}
3、新表创建必须增加压缩
disable ‘xx’
alter ‘xx’, {NAME => ‘f’, COMPRESSION => ‘LZ4’}
enable ‘xx’
如何提升hbase吞吐量:
1、hbase建表要按照实际数据量进行分区
2、建表时要设置压缩
3、写会影响读的性能,所以可以考虑用bulkload技术
https://blog.csdn.net/CHANGGUOLONG/article/details/90767187?depth_1-utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromBaidu-1&utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromBaidu-1