![](https://img-blog.csdnimg.cn/20201014180756927.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
flume
flume的安装使用
呆痞ys
恰同学少年,风华正茂,挥斥方遒
展开
-
flume--的安装部署
1.flume–的安装部署1)将apache-flume-1.7.0-bin.tar.gz上传到linux的/opt/software目录下2)解压apache-flume-1.7.0-bin.tar.gz到/opt/module/目录下[kmu@kmmaster software]$ tar -zxf apache-flume-1.7.0-bin.tar.gz -C /opt/module/3)修改apache-flume-1.7.0-bin的名称为flume[kmu@kmmaster mod原创 2020-06-20 14:28:42 · 161 阅读 · 0 评论 -
flume实时抓取案例---exec
1.flume实时抓取案列—execag1.sources = source1ag1.sinks = sink1ag1.channels = channel1ag1.sources.source1.type = execag1.sources.source1.command = tail -F /root/log/access.logag1.sinks.sink1.type = hdfsag1.sinks.sink1.hdfs.path =hdfs://kmmaster:8020/acce原创 2020-06-20 14:03:04 · 495 阅读 · 0 评论 -
flume的文件跟踪配置 文件夹-----hdfs
1.创建配置文件vim dir-hdfs.conf#spooldir:flume中自带的读取目录的source,只要出现新文件就会被读走#定义三大组件的名称ag1.sources = source1ag1.sinks = sink1ag1.channels = channel1# 配置source组件ag1.sources.source1.type = spooldirag1.sources.source1.spoolDir =/root/log/ag1.sources.source原创 2020-06-20 11:03:07 · 329 阅读 · 0 评论