filebeat接入kafka

1.下载 Filebeat

#cd  /opt/filebeat-6.3.2-linux-x86_64

filebeat.inputs:
- type: log
  enabled: true
  paths:
#    - /var/log/*.log
     - /home/kexin/out.log            #监听的日志文件
filebeat.config.modules:
  path: ${path.config}/modules.d/*.yml
  reload.enabled: false
setup.template.settings:
  index.number_of_shards: 3
output.kafka:
  enabled: true
  hosts: ["10.10.100.215:9092","10.10.100.216:9092","10.10.100.217:9092"]     # kafka集群配置
  topic: "caolihua01"   #kafka 订阅的主题

 2.启动Filebeat 

#  ./filebeat -c filebeat.yml 启动Filebeat 

向监听的文件out.log 写入数据

#echo "别瞎搞3" >> out.log 

 

3. 通过kafka-eagle查看写入kafka的消息

 

查看消息：