hbase行键过滤器RowFilter

最新推荐文章于 2022-10-11 13:44:13 发布

转载最新推荐文章于 2022-10-11 13:44:13 发布 · 8k 阅读

文章标签：

#hbase #filter #数据

Hadoop开发专栏收录该内容

24 篇文章

订阅专栏

本文介绍了HBase中RowFilter的使用方法，包括各种比较符的含义及其应用场景，并提供了具体的Java代码示例，展示了如何利用RowFilter进行精确的行键过滤。

转至http://blog.chinaunix.net/uid-77311-id-4617954.html

hbase行键过滤器RowFilter 2014-11-13 09:57:00

分类： HADOOP

RowFilter是用来对rowkey进行过滤的,比较符如下:

Operator	Description
LESS	小于
LESS_OR_EQUAL	小于等于
EQUAL	等于
NOT_EQUAL	不等于
GREATER_OR_EQUAL	大于等于
GREATER	大于
NO_OP	排除所有

Comparator	Description
Bytes.compareTo()比较BinaryPrefixComparator	和
Does not compare against an actual value but whether a given one is null, or not null.
Performs a bitwise comparison, providing a BitwiseOp class with AND, OR, and XOR operators.

contains()来判断<span "="" style="word-wrap: break-word; font-size: 9pt;">

下面是相关比较符的例子

点击(此处)折叠或打开

 
     package com.hxl;
 
 import java.io.IOException;
 
 import org.apache.hadoop.conf.Configuration;
 
 import org.apache.hadoop.hbase.Cell;
 
 import org.apache.hadoop.hbase.CellUtil;
 
 import org.apache.hadoop.hbase.KeyValue;
 
 import org.apache.hadoop.hbase.client.HTable;
 
 import org.apache.hadoop.hbase.client.Result;
 
 import org.apache.hadoop.hbase.client.ResultScanner;
 
 import org.apache.hadoop.hbase.client.Scan;
 
 import org.apache.hadoop.hbase.filter.BinaryComparator;
 
 import org.apache.hadoop.hbase.filter.CompareFilter;
 
 import org.apache.hadoop.hbase.filter.Filter;
 
 import org.apache.hadoop.hbase.filter.RowFilter;
 
 import org.apache.hadoop.hbase.util.Bytes;
 
 import com.hxl.ConnectDB;
 
 public class RowFilterTest {
 
     public void rowfilter(String tablename, String rowkeyvalue) {
 
         Configuration configuration = null;
 
         configuration = new ConnectDB().getConf();
 
         try {
 
             HTable table = new HTable(configuration, tablename);
 
             Filter filter1 = new RowFilter(CompareFilter.CompareOp.EQUAL,
 
                     new BinaryComparator(Bytes.toBytes(rowkeyvalue)));
 
             // EQUAL =
 
             Scan s = new Scan();
 
             s.setFilter(filter1);
 
             ResultScanner rs = table.getScanner(s);
 
             for (Result r : rs) {
 
                 System.out.println("rowkey:" + new String(r.getRow()));
 
                 for (KeyValue keyValue : r.raw()) {
 
                     System.out.println("列族:" + new String(keyValue.getFamily())
 
                             + " 列:" + new String(keyValue.getQualifier()) + ":"
 
                             + new String(keyValue.getValue()));
 
                 }
 
             }
 
         } catch (IOException e) {
 
             // TODO Auto-generated catch block
 
             e.printStackTrace();
 
         }
 
     }
 
 }

相关的过滤方法使用:
提取rowkey以01结尾数据
Filter filter = new RowFilter(CompareFilter.CompareOp.EQUAL,new RegexStringComparator(".*01$"));

提取rowkey以包含201407的数据
Filter filter = new RowFilter(CompareFilter.CompareOp.EQUAL,new SubstringComparator("201407"));

提取rowkey以123开头的数据
Filter filter = new RowFilter(CompareFilter.CompareOp.EQUAL,new BinaryPrefixComparator("123".getBytes()));

-- The End --