elk日志收集到redis中

最新推荐文章于 2022-01-19 17:36:12 发布

weixin_33978044

最新推荐文章于 2022-01-19 17:36:12 发布

阅读量246

点赞数

文章标签：数据库操作系统大数据

原文链接：http://blog.51cto.com/5776643/2385584

版权

apache_log------>logstash----->redis---->logstash----->es

日志写到redis中

redis安装配置略

input{

  path => "/var/log/access_log"
        type => "acccess_log"
        start_postition => "beginning"

}
output{
       redis{
                        host => "ip"
                         port => 6379
                         db => "2"
                         data_type => "list"
                         key => "access_log"

            }
}

logstash从redis中读取日志

input{
     redis{
                        host => "ip"
                         port => 6379
                         db => "2"
                         data_type => "list"
                         key => "access_log"
                         type => "access_log"
            }
}
filter{
 grok{
     match => { "message" => "%{COMBINEDAPACHELOG}"}  #logstash 默认组件
     }
}
output{
    elasticsearch {
                                hosts => ["ip:9200"]
                                 index => "access_log-%{+YYYY.MM.dd}"

            }

}

    ab -n 100 -c 10 http://ip:port/index.jsp   100个请求，10个并发

转载于:https://blog.51cto.com/5776643/2385584