莱布尼兹

 today i will learn to hit the hbase source codes.for  the rule from simple to difficult,i will get a standalone mode to run hbase to do this.ok,let's look at the shell  start-hbase.sh i...

below views are all from hbase's guide(maybe with my some comments fonted by deferent size) Overall, HBase implements close to all of the features described in Chapter 1. Where it differs,...

1in case of ONE region,a table with 10 rows and two familys(each contains 10 cols),if a Scan is set by caching and batch below will spawn appitiate rpcs:  in generate ,a additional rpc is generate...

part I:split policy  if u have used some index tools like lucene,there are some factors to control how many docs to merge some segs to a large one,and whether to freeze  some large enough seg file...

as iwinit dug in source codes[1],the 'regions assigment' in hbase is complex and trickle.there are many of zk related events across master and rs,and huge of pre-post processes in it.below is a ab...

 Note:Filer.filterRow(list) is incompatible with scan with batch,why?i think this are two mode to limit KVs to be returned: -batch returned all KVs on limit -filterRow(list) may be adjusted...

as described in title,there some memory buffers in hbase called 'memstore' which will be stuffed when writing.this policy provides a asynchronization operations in writes(if ignore the wal ,of cours...

 Part I---mvcc concepts  in most of databases,the acid symentics are ganranteed ,also,like hbase.but the formers are based on the whole db object,and hbase is based on row(so called hbase provid...

?what  in a SQL DB Server,in tradictionally,contains Triggers or Procedures,and the privior is used to handle server's internal transactions,most of 'post-do' operations;the laster also is subrout...

study and summarie below art 1:Table attributes attrdefaultusage/principleuse casenote Bloom filterdisablecost some mem to impove lookup time TBDdo huge range scan table...

what is  every db holds its storage level,either memory or fs.this is similar to,hbase,it has HFile as underlying data structure which will be stored in fs or dfs.  exquisite data structure also...

why  along with the time goes,as unreasonable table design,or some crash nodes etc,these will cause some regionservers have overloaded regions and/or much underloaded regions,so a balancer is nece...

  as some distribute systems ,a spare/second master is always supplied to guarantee high availablity.  like hbase,u can run some backup masters against with master,when the real master is failure,...

how many regions are thinked as too few or to too many? some conditions are worth of consideration for a table(regardless of hbase's configurations):-first ,keep the cluster more 'static' when u...

after a long long and slow slow study ,i have finished reading this hbase book!as learning some degree courses and optimizing the hbase cluster,it cost huge time  for me to do that,so less time for...

 一。流程图  二。原理在使用HTable前要建立一个HTablePool实例。明白这个可以考虑为table的factory：get 或close,或close pool都可以。这个实例会同时建立一个内部object:PoolMap,其实不是真正的map，只是一个wrapper而已。这个map包含以table为key，相对应key为values的Pool，这种pool三种类型，详细见上...

     Ref:hbase HTablePool 实现原理 -1

现在有时间，有需求进行详细阅览大牛写的代码，这无疑是无比的愉悦。计划是１个月内搞个7,8成的。下面是阅读顺序：１。hbase启动/停止流程　　认识hbase基本运作２。hbase CRUD　　这是任何一个general project不可或缺的３。hbase rpc/ipc/proxy通信机制　　数据通信４。hbase memstore/blockcache;h...

一。RPC VS IPC (relationship/difference)IPC  inter-process communicationas [1] said ,there are two types ipc by now:1.LPC  like RPC,but this is a 'epitome' of it,that is in general it will be us...

1.principle    2.note-as is hbase-0.94.2,the table .meta. is not splittable,therefore,there is only ONE region in table -root-.that is if you try to split the root you will do it w/o err...

flow:    FAQ:-why META table can not be splited?if u try to split the table 'meta',u will see the warn log :  Cannot split meta regions in HBase 0.20 and abovei dont know how this case a...

flow:   some conclusions:--there is  a mutation process mudel interacts Memstore with HLog,  1.MVCC insert 'memStoreWriter' number,then write back these edits to Memstore(s) with this numb...

todo,todo........

 read    Note:-Gets will be converted to scan per Get in RS-scan is needless to use offset for retrieving ranged rows.this is different from common RMDBS.and this is implemented by RS ...

   just recovered from a disease,i should finish the retain part of work now...  yes,as u can see,the Scan/Get oper from hbase is some more tricky,as the kvs multi-dimensions and related to stor...

  * table disabled is NOT different from region,when all regions have been closed,then the table 's disabled finally.* region closing state is set on zk from client,and transition to closed by...

 1.What is Leasein general,between the communication of client and Region Server,there are RPCs in there.Lease is a mechanism to hold a reference object updated each client rpc. so Lease is si...

  here is a byte flow of mutationlevelformatusagetop(abstract,user facing)[Put,Put…]HTable#put(list)encapsulation[HLogKey,WALEdit] WALEdit:kv1,kv2 || v[t...