flume复制和多路复用

命令容易忘
bin/flume-ng agent -n a1 -c conf/ -f job/f1.conf -Dflume.root.logger=INFO,console

flume1配置：
1.定义agent，source，channel，sink的名称
a1.sources=r1
a1.channels=c1 c2
a1.sinks=k1 k2
2描述source
a1.source.r1.type=exec
a1.source.r1.command=tail -F /opt/module/flume/datas/a.txt
a1.source.r1.batchSize=100
3.描述channel
a1.channel.c1.type=memory
a1.channel.c1.capacity=1000
a1.channel.c1.transactionCapacity=1000

a1.channel.c2.type=memory
a1.channel.c2.capacity=1000
a1.channel.c2.transactionCapacity=1000
4.描述sink
a1.sinks.k1.type=avro
a1.sinks.k1.hostname=hadoop103
a1.sinks.k1.port=9999
a1.sinks.k1.type=avro
a1.sinks.k1.hostname=hadoop104
a1.sinks.k1.port=9999
5.关联source->channel->sink
a1.sources.r1.channels=c1 c2
a1.sinks.k1.channel=c1
a1.sinks.k2.channel=c2

flume2,flume3配置文件的差别:
sink的差别，一个为hdfs,一个为file_roll