虚拟机上安装flume

1.首先找到你的flume安装包

2.上传文件到opt目录下

3.tar -zxf flume-ng-1.6.0-cdh5.14.2.tar.gz

4.mv apache-flume-1.6.0-cdh5.14.2-bin/ soft/flume160

5.yum install -y nc 

6.cd soft/flume160/conf/

7.cp flume-env.sh.template flume-env.sh

8.vim flume-env.sh

 9.vim /etc/profile

#flume environment
export FLUME_HOME=/opt/soft/flume160
export PATH=$PATH:$FLUME_HOME/bin

10.source /etc/profile

11.flume-ng version

12.

启动成功

13.编写文件

 

test01

a1.channels = c1
a1.sources = s1
a1.sinks = k1

a1.sources.s1.type = spooldir
a1.sources.s1.spoolDir = /opt/fconf/test

a1.channels.c1.type = memory

a1.sinks.k1.type = logger

a1.sinks.k1.channel = c1
a1.sources.s1.channels = c1

14.flume-ng agent --name a1 -f /opt/fconf/test01.conf -Dflume.root.logger=INFO,console
切分2个linux屏幕 实现实时读取输入数据 一般不用flume实现这种功能

15.编写配置文件 test.conf

test02.conf  文件

a1.channels = c1
a1.sources = s1
a1.sinks = k1

a1.sources.s1.type = spooldir
a1.sources.s1.spoolDir = /opt/fconf/test

a1.channels.c1.type = file
a1.channels.c1.checkpointDir = /opt/flumeckp/checkpoint
a1.channels.c1.dataDirs = /opt/flumeckp/data

a1.sinks.k1.type = logger

a1.sinks.k1.channel = c1
a1.sources.s1.channels = c1

16.linux 上输入

flume-ng agent --name a1 -f /opt/fconf/test02.conf -Dflume.root.logger=INFO,console

离线读取文件