Hbase相关学习资料和建表规则

https://zhuanlan.zhihu.com/p/145551967?utm_source=wechat_session hbase详细介绍
https://blog.csdn.net/whdxjbw/article/details/81101200 hbase简介
https://wenku.baidu.com/view/0557c682cc7931b765ce15c4.html hbase查询命令
https://www.cnblogs.com/zzpblogs/p/10683356.html hbase插入数据命令

put 'cupid_dmxfeat_jd_model_shop_data_s_d_bank','0e74f82_101009','f:pin','101009'

put 'cupid_dmxfeat_jd_model_shop_data_s_d_bank','0e74f82_101009','f:dt','2020-06-15'

put 'cupid_dmxfeat_jd_model_shop_data_s_d_bank','0e74f82_101009','f:data','20191217104330214114337362:113.9461:22.49881:440300:10120191211140944054119810092,20191217104330234808823987:114.0112:22.60045:440300:10120191211140944054119810092,20191217104330381565157469:114.1274:22.54749:440300:10120191211140944054119810092,20191217104330497577134122:113.9458:22.53038:440300:10120191211140944054119810092'

https://www.cnblogs.com/cxzdy/p/5583239.htmlHBase 常用Shell命令
https://blog.csdn.net/qq_38025219/article/details/88030899 hbase压缩减少存储空间

hbase建表优化如下:
1、分区

1W 以下的不分区

可以如下执行:

create 'xxxxx', 'f'

1000-100W可以如下执行:

create 'xxxxx', 'f', SPLITS => ['19','33','4d','67','81','9b','b5','cf','e9']



100W -1000W可以如下执行:

create 'xxxxx', 'f', SPLITS => ['0c','19','26','33','40','4d','5a','67','74','81','8e','9b','a8','b5','c2','cf','dc','e9','f6']



千万级到亿可以如下执行,

create 'xxxxx', 'f', SPLITS => ['07','0f','17','1f','27','2f','37','3f','47','4f','57','5f','67','6f','77','7f','87','8f','97','9f','a7','af','b7','bf','c7','cf','d7','df','e7','ef','f7','ff']



1亿到10亿可以如下执行:

试用 create 'xxxxx', 'f', SPLITS => ['07','0f','17','1f','27','2f','37','3f','47','4f','57','5f','67','6f','77','7f','87','8f','97','9f','a7','af','b7','bf','c7','cf','d7','df','e7','ef','f7','ff']



后续用create 'xxxxx', 'f', SPLITS => ['05','0b','11','17','1d','23','29','2f','35','3b','41','47','4d','53','59','5f','65','6b','71','77','7d','83','89','8f','95','9b','a1','a7','ad','b3','b9','bf','c5','cb','d1','d7','dd','e3','e9','ef','f5','fb']

十亿以上

create 'xxxxx', 'f', SPLITS => ['04','09','0e','13','18','1d','22','27','2c','31','36','3b','40','45','4a','4f','54','59','5e','63','68','6d','72','77','7c','81','86','8b','90','95','9a','9f','a4','a9','ae','b3','b8','bd','c2','c7','cc','d1','d6','db','e0','e5','ea','ef','f4','f9','fe']


2、针对大表建议设置表的有效期,如设置7天,从插入数据开始算时,7天内如果没有更新,则被删除。

alter ‘cupid_dmcqm_lhmx_app_jr_cms_recmd_rslt_weight_pin_2q_a_d’, {NAME => ‘f’, TTL => ‘604800’}

3、新表创建必须增加压缩

disable ‘xx’

alter ‘xx’, {NAME => ‘f’, COMPRESSION => ‘LZ4’}

enable ‘xx’

如何提升hbase吞吐量:
1、hbase建表要按照实际数据量进行分区
2、建表时要设置压缩
3、写会影响读的性能,所以可以考虑用bulkload技术
https://blog.csdn.net/CHANGGUOLONG/article/details/90767187?depth_1-utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromBaidu-1&utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromBaidu-1

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值