![](https://img-blog.csdnimg.cn/20201014180756922.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
大数据之flume
Felix_CB
我总高高在上,但却走不出这人生低谷
展开
-
flume安装
下载并解压wget http://mirrors.hust.edu.cn/apache/flume/1.8.0/apache-flume-1.8.0-bin.tar.gz#可指定目录解压 -C /xxx/xxxtar -zxvf apache-flume-1.8.0-bin.tar.gz修改flume-env.sh#修改目录名(看起来舒服点)mv apache-flume-1.8.0...原创 2018-12-25 23:38:06 · 184 阅读 · 0 评论 -
flume http sink
# 指定Agent的组件名称a1.sources = r1a1.sinks = k1a1.channels = c1 # 指定Flume source(要监听的路径)a1.sources.r1.type = spooldira1.sources.r1.spoolDir = /opt/bigdata/FtpDir1/a1.sources.r1.deserializer.maxLi...原创 2019-01-28 11:47:50 · 1567 阅读 · 0 评论 -
flume kafka sink
# 指定Agent的组件名称a1.sources = r1a1.sinks = k1a1.channels = c1 # 指定Flume source(要监听的路径)a1.sources.r1.type = spooldira1.sources.r1.spoolDir = /opt/dir#每行读取的大小限制a1.sources.r1.deserializer.maxLine...原创 2019-03-09 16:03:59 · 1056 阅读 · 0 评论