kafka与elk对接

1 kafka集群环境搭建部署完毕

2 安装部署logstash，可以参考elk环境部署

修改logstash的相关配置文件，修改内容如下所示

修改/etc/logstash/conf.d/logstash.conf配置文件

[root@logstash-4 conf.d]# cat logstash.conf

input {

  kafka {

    bootstrap_servers => "192.168.101.25:9092,192.168.101.15:9092,192.168.101.31:9092"

    topics => ["credit"]

    decorate_events => true

    codec => json

 }

}

output {

  elasticsearch {

    hosts => ["192.168.101.17:9200","192.168.101.23:9200","192.168.101.16:9200"]

    index => "kafka-%{+YYYY.MM.dd}"

  }

}

启动logstash服务

3 通过elk查看相关是否正确收集到日志信息