flume配置文件说明

一 通用配置说明

#配置agent的source
agent.sources = seqGenSrc

#配置agent的通道
agent.channels = memoryChannel

#配置agent的sink
agent.sinks = loggerSink

# source
agent.sources.seqGenSrc.type = seq
agent.sources.seqGenSrc.channels = memoryChannel

#sink
agent.sinks.loggerSink.type = logger
agent.sinks.loggerSink.channel = memoryChannel

#channel
agent.channels.memoryChannel.type = memory
agent.channels.memoryChannel.capacity = 100

二 简单配置

a1.sources = r1
a1.sinks = k1
a1.channels = c1

a1.sources.r1.type = netcat
#需要修改为本机名
a1.sources.r1.bind = localhost           
a1.sources.r1.port = 8888

a1.sinks.k1.type = logger

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

三 启动方法

$ bin/flume-ng agent --conf conf --conf-file example.conf --name a1 -Dflume.root.logger=INFO,console

四 测试方法

telnet localhost 8888
Trying 127.0.0.1...
Connected to localhost.localdomain (127.0.0.1).
Escape character is '^]'.
Hello world! <ENTER>
OK