flume
上等猪头肉
hadoop,hive,hbase,sqoop,flume.spark,kafka
展开
-
使用flume采集linux本地文件至kafka
编写配置文件vim dir_kafka.confa1.sources = r1a1.sinks = k1a1.channels = c1#对于source的配置描述 监听avroa1.sources.r1.type = spooldira1.sources.r1.spoolDir =/opt/access.loga1.sources.r1.fileSuffix=.FINISHED...原创 2019-04-03 17:27:48 · 768 阅读 · 0 评论 -
Flume中agent的启动命令
写好agent配置文件,配置文件名为flume-app.conf(指定source、channel和sink)启动agent配置文件命令如下:bin/flume-ng agent-c /opt/module/flume/conf-f ~/work/flume-job/flume-app.conf-n ag1-Dflume.root.logger=info,console 在flum...原创 2019-05-13 10:47:49 · 7138 阅读 · 0 评论