![](https://img-blog.csdnimg.cn/20190927151132530.png?x-oss-process=image/resize,m_fixed,h_224,w_224)
Flume
Flume
马鹏森
这个作者很懒,什么都没留下…
展开
-
Flume将A服务器上的日志实时采集到B服务器
# exec-memory-avro.confexec-memory-avro.sources = exec-sourceexec-memory-avro.sinks = avro-sinkexec-memory-avro.channels = memory-channel# Describe/configure the sourceexec-memory-avro.sources.exec-source.type = execexec-memory-avro.sources.exec-so.原创 2020-08-16 09:44:03 · 7993 阅读 · 0 评论 -
flume监控一个文件实时采集新增的数据输出到控制台
Agent选型:exec source + memory channel + logger sink# Name the components on this agenta1.sources = r1a1.sinks = k1a1.channels = c1# Describe/configure the sourcea1.sources.r1.type = exec a1.sources.r1.command = -F /home/hadoop/data/data.loga1.sourc原创 2020-08-16 09:00:52 · 7914 阅读 · 0 评论 -
bash: telnet: command not found...
解决办法是安装telnet,但是需要在root权限下安装:①yum list telnet* – 列出telnet相关的安装包②sudo yum install telnet-server --安装telnet服务③sudo yum install telnet.* --安装telnet客户端...原创 2020-08-15 11:46:40 · 7937 阅读 · 0 评论 -
flume从指定网络端口采集数据输出到控制台
a1:agent的名称r1:source的名称k1:sink的名称c1:channel的名称# Name the components on this agenta1.sources = r1a1.sinks = k1a1.channels = c1# Describe/configure the sourcea1.sources.r1.type = netcata1.sources.r1.bind = hadoop000a1.sources.r1.port = 44444# D原创 2020-08-15 11:35:02 · 7932 阅读 · 0 评论 -
flume环境部署
[hadoop@hadoop000 app]$ cd $FLUME_HOME[hadoop@hadoop000 apache-flume-1.6.0-cdh5.7.0-bin]$ cd conf[hadoop@hadoop000 conf]$ cp flume-env.sh.template flume-env.sh原创 2020-08-15 10:01:39 · 7808 阅读 · 0 评论 -
Flume核心组件
Flume is a distributed, reliable, and available service for efficiently collecting(收集), aggregating(聚合), and moving(移动) large amounts of log data.原创 2020-08-15 09:50:34 · 7914 阅读 · 0 评论