flume对接RabbitMQ附带flume插件包

1、配置文件 flume-conf-rabbitmq-netcat.properties

a1.sources = r1
a1.sinks = k1
a1.channels = c1
a1.sources.r1.type = netcat
a1.sources.r1.bind = 0.0.0.0
a1.sources.r1.port = 5140
a1.channels.c1.type = memory
a1.channels.c1.capacity = 10000
a1.channels.c1.transactionCapacity = 1000

a1.sinks.k1.channels = c1
a1.sinks.k1.type = com.aweber.flume.sink.rabbitmq.RabbitMQSink
a1.sinks.k1.host = xx.xx
a1.sinks.k1.port = 5672
a1.sinks.k1.virtual-host = /
a1.sinks.k1.username = xxx
a1.sinks.k1.password = xxx
a1.sinks.k1.exchange = amq.topic
a1.sinks.k1.routing-key = flume.event
a1.sinks.k1.publisher-confirms = true

a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

2、将插件rabbitmq-flume-plugin-standalone-1.1.0.jar上传到flume/lib/目录下面

3、启动命令

bin/flume-ng agent -c conf/ -f conf/flume-conf-rabbitmq-netcat.properties -n a1 -Dflume.root.logger=INFO,console

4、插件地址
https://download.csdn.net/download/u012228523/85467502

5、参数说明

host	连接地址
port	rabbitmq端口号
ssl	false	是否支持SSL
virtual-host	虚拟主机
username	用户名
password	密码
exchange	交换机主题
routing-key		路由键
auto-properties	是否自动填充AMQP消息属性，  后面设置消息头等配置信息需要设置
mandatory-publish	是否启动强制发布
publisher-confirms	是否启动发布者消息确认