flume
瓦力冫
喜欢看点书,跑跑步,热爱游戏编程
展开
-
flume 环境部署
1. 下载解压略2. 设置环境变量略3. 修改配置conf/flume-env.sh.template 复制一份flume-env.sh,然后修改下JAVA_HOME即可4. 例子# Define a memory channel called ch1 on agent1 agent1.channels.ch1.type = memory agent1.channels.ch1.capacit...原创 2018-06-16 19:07:42 · 283 阅读 · 0 评论 -
flume exec 监听log文件修改
# Define a memory channel called ch1 on agent1 agent1.channels.ch1.type = memory agent1.channels.ch1.capacity = 1000 agent1.channels.ch1.transactionCapacity = 100 # Define an Avro source called avro...原创 2018-06-16 19:08:37 · 1093 阅读 · 0 评论 -
flume 搜集A 服务器 的日志到B 服务器
就是服务器A的Sink 类型是AVRO, 而 服务器 B的Source 是AVRO 1.服务器A的配置# Define a memory channel called ch1 on agent1 agent1.channels.ch1.type = memory agent1.channels.ch1.capacity = 1000 agent1.channels.ch1.transaction...原创 2018-06-16 19:09:23 · 541 阅读 · 0 评论 -
flume 收集日志到 kafka 整合
就是服务器B的Sink要换成kafka 的sink即可服务器A还是不变:# Define a memory channel called ch1 on agent1 agent1.channels.ch1.type = memory agent1.channels.ch1.capacity = 1000 agent1.channels.ch1.transactionCapacity = 100 ...原创 2018-06-19 17:48:14 · 362 阅读 · 0 评论