一、logstash-input-kafka介绍
二、举例
分析:利用 decorate_events 参数,将 kafka的元信息(如:topic,group,offset等)全部输出,根据不同的topic即可输出到不同的es索引。
input{
kafka{
bootstrap_servers => ["55.0.10.19:9092,55.0.10.20:9092,55.0.10.21:9092"]
group_id => "kafkaToes5"
auto_offset_reset => "earliest"
consumer_threads => 5
decorate_events => true
topics => ["a1","a2"]
//security_protocol => "SASL_PLAINTEXT" #sasl认证使用
//sasl_mechanism => "PLAIN"