hbase实现快速行统计

1. Enable AggregationClient coprocessor

You have two choices :

You can enable aggregation coprocessor on all your tables by adding the following lines tohbase-site.xml :

 <property>
   <name>hbase.coprocessor.user.region.classes</name>
   <value>org.apache.hadoop.hbase.coprocessor.AggregateImplementation</value>
 </property>

or ...you can enable coprocessor only on a table throught the HBase shell :

1. disable the table
hbase> disable 'mytable'

2. add the coprocessor
hbase> alter 'mytable', METHOD => 'table_att','coprocessor'=>'|org.apache.hadoop.hbase.coprocessor.AggregateImplementation||'

3. re-enable the table
hbase> enable 'mytable'

2. Increase RPC timeout (opt)

In some cases the following exception could be raised : 
java.net.SocketTimeoutException: Call to node2/55.37.68.154:60020 failed on socket timeout exception
On large table or if you are expecting slow I/O this might be necessary:

 <property>
   <name>hbase.rpc.timeout</name>
   <value>300000</value>
 </property>

n.b. : you can also specify this property directly in the client source code, see next section

3. ''RowCount' Snippet

[java] view plain copy print ?

1. public class MyAggregationClient {  
2.   
3.     private static final byte[] TABLE_NAME = Bytes.toBytes("mytable");  
4.     private static final byte[] CF = Bytes.toBytes("d");  
5.   
6.     public static void main(String[] args) throws Throwable {  
7.   
8.         Configuration customConf = new Configuration();  
9.         customConf.setStrings("hbase.zookeeper.quorum",  
10.                 "node0,node1,node2");  
11.         // Increase RPC timeout, in case of a slow computation  
12.         customConf.setLong("hbase.rpc.timeout", 600000);  
13.         // Default is 1, set to a higher value for faster scanner.next(..)  
14.         customConf.setLong("hbase.client.scanner.caching", 1000);  
15.         Configuration configuration = HBaseConfiguration.create(customConf);  
16.         AggregationClient aggregationClient = new AggregationClient(  
17.                 configuration);  
18.         Scan scan = new Scan();  
19.         scan.addFamily(CF);  
20.         long rowCount = aggregationClient.rowCount(TABLE_NAME, null, scan);  
21.         System.out.println("row count is " + rowCount);  
22.   
23.     }  
24. }