Flume--Flume安装+nc测试

Flume安装教程

1.获取资源

链接: https://pan.baidu.com/s/10fpZ0Iq2G96Z6PdEgzTAHw

提取码: gx8b

2.解压并移动 flume 安装包

tar -zxf flume-ng-1.6.0-cdh5.14.2.tar.gz
mv apache-flume-1.6.0-cdh5.14.2-bin/ soft/flume160

3.修改包下相关配置文件

#进入conf目录
cd /opt/soft/flume160/conf

#复制env备份文件，形成正式文件
cp flume-env.sh.template flume-env.sh

#进入env文件，修改配置信息
vi flume-env.sh
==>（添加信息）
export JAVA_HOME=/opt/soft//opt/soft/jdk180	//注意核对自己jdk的地址

4.测试 flume版本信息

#进入bin目录
cd ../bin
./flume-ng version
==>（命令反馈信息）
Flume 1.6.0-cdh5.14.2
Source code repository: https://git-wip-us.apache.org/repos/asf/flume.git
Revision: 50436774fa1c7eaf0bd9c89ac6ee845695fbb687
Compiled by jenkins on Tue Mar 27 13:55:10 PDT 2018
From source with checksum 30217fe2b34097676ff5eabb51f4a11d

5.修改环境变量配置文件,并初始化（使命令可以全局使用）

#添加环境变量
vi /etc/profile
==>（添加信息）
export FLUME_HOME=/opt/soft/flume160
export PATH=$PATH:$FLUME_HOME/bin	//注意核对自己的相关地址

#激活环境变量
source /etc/profile

6.全局变量测试

#任意目录下测试命令
flume-ng version
==>（命令反馈）
Flume 1.6.0-cdh5.14.2
Source code repository: https://git-wip-us.apache.org/repos/asf/flume.git
Revision: 50436774fa1c7eaf0bd9c89ac6ee845695fbb687
Compiled by jenkins on Tue Mar 27 13:55:10 PDT 2018
From source with checksum 30217fe2b34097676ff5eabb51f4a11d

7.恭喜你安装成功！！！

Flume数据收集测试（想要测试的可以继续）

1.下载 ncat （模拟输入端的小程序）
yum install nmap-ncat.x86_64 -y

2.新建配置文件目录，并添加Agent参数（配置信息可以去官网上复制）
mkdir /opt/flumeconf
cd /opt/flumeconf/
vi conf_0804_simple.properties
==>
# example.conf: A single-node Flume configuration

# Name the components on this agent
a1.sources = r1
a1.sinks = k1
a1.channels = c1

# Describe/configure the source
a1.sources.r1.type = netcat
a1.sources.r1.bind = 192.168.56.104	//一定要修改成主机ip
a1.sources.r1.port = 6666	//设置一个数据监控的端口号，注意端口号不能重复，并且不能超过65536

# Describe the sink
a1.sinks.k1.type = logger

# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

3.启动flume
flume-ng agent -n a1 -c conf -f /opt/flumeconf/conf_0804_simple.properties -Dflume.root.logger=INFO,console

4.另起窗口，启动nc
nc 192.168.56.104 6666

5.随意在nc窗口输入字符，回车，查看flume窗口是否可以监控到数据