filebeat接入数据kafka

官方最新下载filebeat  

https://www.elastic.co/products/beats

tar -zxvf  filebeat-5.5.2-linux-x86_64.tar.gz

cd  filebeat-5.5.2-linux-x86_64

filebeat主要是对配置文件filebeat.yml  进行修改

#================================  input  =====================================

filebeat.prospectors:

# Each - is a prospector. Most options can be set at the prospector level, so
# you can use different prospectors for various configurations.
# Below are the prospector specific configurations.


- input_type: log


  # Paths that should be crawled and fetched. Glob based paths.
  paths:
    #- /var/log/*.log
    #- c:\programdata\elasticsearch\logs\*
    - /home/luffy/aaa.log

#================================ Kafka output =====================================
output.kafka:
  enabled: true
  hosts: ["192.1.1.208:9092"]
  topic: luffy_test09

注释:filebeat对格式要求严格，空格不可多不可少。而且。topic如果不存在，则会自己创建