logstash多个output时type判断不起作用

logstash多个input,使用type指定多个output

conf配置文件

// An highlighted block
input {
      jdbc {
        jdbc_connection_string => "jdbc:mysql://10.136.220.35:3306/test?characterEncoding=UTF-8&useSSL=false&autoReconnect=true"
        jdbc_user => "root"
        jdbc_password => "root"
        jdbc_driver_library => "/root/logstash/logstash/lib/mysql-connector-java-5.1.44.jar"
        jdbc_driver_class => "com.mysql.jdbc.Driver"
        jdbc_paging_enabled => "true"
        jdbc_page_size => "50000"
        codec => plain { charset => "UTF-8"}
        tracking_column => update_time
        record_last_run => true
        last_run_metadata_path => "/root/logstash/logstash/lastrun/.logstash_jdbc_last_run"
        jdbc_default_timezone => "Asia/Shanghai" 
        statement_filepath => "/root/logstash/logstash/jdbcsql/jdbc.sql"
        clean_run => false
        schedule => "* * * * *"
        type => "user"
     }
   jdbc {
        jdbc_connection_string => "jdbc:mysql://10.136.220.35:3306/test?characterEncoding=UTF-8&useSSL=false&autoReconnect=true"
        jdbc_user => "root"
        jdbc_password => "root"
        jdbc_driver_library => "/root/logstash/logstash/lib/mysql-connector-java-5.1.44.jar"
        jdbc_driver_class => "com.mysql.jdbc.Driver"
        jdbc_paging_enabled => "true"
        jdbc_page_size => "50000"
        codec => plain { charset => "UTF-8"}
        jdbc_default_timezone => "Asia/Shanghai" 
        statement_filepath => "/root/logstash/logstash/jdbcsql/jdbc2.sql"
        clean_run => false
        schedule => "* * * * *"
        type => "my_role"
     }

 }

filter {
    json {
        source => "message"
        remove_field => ["message"]
    }
}

output {
  
   if[type] == "user"{
      elasticsearch {
        hosts => "127.0.0.1:9200"
        index => "user"
        document_id => "%{id}"
      }
    }

    if[type] == "my_role"{
      elasticsearch {
        hosts => "127.0.0.1:9200"
        index => "role"
        document_id => "%{id}"
      }
    }

    stdout {
        codec => json_lines
    }
}

jdbc.sql配置

select id,name, type as role_type from sys_role

注意表中如果有type字段,需要给个别名,否则和logstash的默认type冲突,导致output中的type判断有误。

  • 4
    点赞
  • 7
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值