flume监控日志上传到kafka

安装

1. 安装1.8版本对应jdk1.8
2. 修改后缀是template的文件

连接kafka source为exec

1. 配置flume-conf.properties

agent.sources = s1
agent.channels = c1
agent.sinks = k1

# For each one of the sources, the type is defined
agent.sources.s1.type = exec
agent.sources.s1.channels = c1
# tail整个文件夹  失败 无法发送至kafka
agent.sources.s1.command = tail -fn 400 /home/joy/test/abc.log

# Each sink's type must be defined
agent.sinks.loggerSink.type = logger

#Specify the channel the sink should use
agent.sinks.loggerSink.channel = c1

# Each channel's type is defined.
agent.channels.c1.type = memory
agent.channels.c1.capacity=10000
agent.channels.c1.transactionCapacity=100

# Other config values specific to each type of channel(sink or source)
# can be defined as well
# In this case, it specifies the capacity of the memory channel
agent.