![](https://img-blog.csdnimg.cn/20201014180756922.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
大数据之flume
Felix_CB
我总高高在上,但却走不出这人生低谷
展开
-
flume安装
下载并解压 wget http://mirrors.hust.edu.cn/apache/flume/1.8.0/apache-flume-1.8.0-bin.tar.gz #可指定目录解压 -C /xxx/xxx tar -zxvf apache-flume-1.8.0-bin.tar.gz 修改flume-env.sh #修改目录名(看起来舒服点) mv apache-flume-1.8.0...原创 2018-12-25 23:38:06 · 183 阅读 · 0 评论 -
flume http sink
# 指定Agent的组件名称 a1.sources = r1 a1.sinks = k1 a1.channels = c1 # 指定Flume source(要监听的路径) a1.sources.r1.type = spooldir a1.sources.r1.spoolDir = /opt/bigdata/FtpDir1/ a1.sources.r1.deserializer.maxLi...原创 2019-01-28 11:47:50 · 1561 阅读 · 0 评论 -
flume kafka sink
# 指定Agent的组件名称 a1.sources = r1 a1.sinks = k1 a1.channels = c1 # 指定Flume source(要监听的路径) a1.sources.r1.type = spooldir a1.sources.r1.spoolDir = /opt/dir #每行读取的大小限制 a1.sources.r1.deserializer.maxLine...原创 2019-03-09 16:03:59 · 1046 阅读 · 0 评论