将A服务器上的日志采集到B服务器
技术选型:
(1)exec source +memory channel +avro sink
(2) avro source +memory channgel+logger sink
需要写两个配置文档
写配置文档
A服务器:exec-memory-avro.conf
exec-memory-avro.sources = exec-source #a1代表agent名称,r1:数据源的名称
exec-memory-avro.sinks = avro-sink #k1 sink名称
exec-memory-avro.channels = memory-channel #c1 channel名称
exec-memory-avro.sources.exec-source.type = exec
exec-memory-avro.sources.exec-source.command = tail -F /home/hadoop/data/data.log
exec-memory-avro.sources.exec_source.shell = /bin/sh -c
exec-memory-avro.sinks.avro-sink.type = logger
exec-memory-avro.sinks.avro-sink.hostname = 192.168.199.150
exec-memory-avro.sinks.avro-sink.port = 44444
exec-memory-avro.channel