flume hbase sink 分隔符为竖线|

##########agent1 conf
##$ bin/flume-ng agent --conf conf --conf-file example.conf --name a1 -Dflume.root.logger=INFO,console
#agent1
agent1.sources = filesrc
agent1.channels = filechan
agent1.sinks = hbasesk

#sources
agent1.sources.filesrc.type = spooldir
agent1.sources.filesrc.spoolDir = /home/abc/logfile/query
agent1.sources.filesrc.fileHeader = true
#agent1.sources.filesrc.deletePolicy = immediate

#channels
agent1.channels.filechan.type = file
agent1.channels.filechan.checkpointDir = /home/bdtestdatas/flume/checkpoint
agent1.channels.filechan.dataDirs = /home/bdtestdatas/flume/data

#sinks
agent1.sinks.hbasesk.type = hbase
agent1.sinks.hbasesk.table = logstore:homelogquery
agent1.sinks.hbasesk.columnFamily = cf
agent1.sinks.hbasesk.serializer = org.apache.flume.sink.hbase.RegexHbaseEventSerializer
agent1.sinks.hbasesk.serializer.colNames=Length,Local Province,Local City
#agent1.sinks.hbasesk.serializer.depositHeaders=false
agent1.sinks.hbasesk.serializer.regex=([^\\|]*)\\|([^\\|]*)\\|([^\\|]*)


#agent1 bind src and sink to channel
agent1.sources.filesrc.channels=filechan
agent1.sinks.hbasesk.channel = filechan

###############agent2 conf

 

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值