centos 7 EFK安装部署监控nginx

最新推荐文章于 2024-05-21 10:41:23 发布

RoninLJH

最新推荐文章于 2024-05-21 10:41:23 发布

阅读量289

点赞数

分类专栏： ELK 文章标签： linux

本文链接：https://blog.csdn.net/RoninLJH/article/details/107163972

版权

ELK 专栏收录该内容

4 篇文章 0 订阅

订阅专栏

本文档详述了如何在CentOS 7系统上安装并配置EFK（Elasticsearch、Fluentd、Kibana）监控工具，以监控Nginx的日志。首先，通过链接分别介绍了安装Kafka、Filebeat的步骤，接着重点讲述了安装ELK（Elasticsearch、Logstash、Kibana）的过程，并提及了在部署过程中，需要对Filebeat和Nginx配置文件进行相应的调整。

摘要由CSDN通过智能技术生成

搭建EFK架构
安装kafka：
https://blog.csdn.net/RoninLJH/article/details/107028599
安装filebeat：
https://blog.csdn.net/RoninLJH/article/details/107111943
安装ELK：
https://blog.csdn.net/RoninLJH/article/details/107006273

需要修改filebeat

[root@kafka01 ~]# vim /etc/filebeat/filebeat.yml
filebeat.inputs:
- type: log
  enabled: true
  paths:
    - /var/log/messages
  fields:
    log_topics: messages
####
- type: log
  enabled: true
  paths:
    - /var/log/nginx/access.log
  fields:
    log_topics: nginx
output.kafka:
  enabled: true
  hosts: ["192.168.33.143:9092","192.168.33.144:9092","192.168.33.145:9092"]
  topic: '%{[fields][log_topics]}'

需要修改nginx.conf

[root@kafka01 ~]# vim /etc/logstash/conf.d/nginx.conf
input {
        kafka{
        bootstrap_servers => ["192.168.33.143:9092,192.168.33.144:9092,192.168.33.145:9092"]
        group_id => "logstash"
        topics => "nginx"
         consumer_threads => 5
        }
}
filter {
        json {
                source => "message"
        }
        mutate {
                remove_field => ["fields","prospector","host","log"]
        }
        grok {
                match => {"message" => "%{NGINXACCESS}"}
        }
}
output {
        elasticsearch {
                hosts => "192.168.33.144:9200"
                index => "nginx_log-%{+YYYY.MM.dd}"
        }
#       stdout {
#               codec => rubydebug
#       }
}