Kubernetes部署Logstash

集群均采用helm进行的安装部署,如果helm尚未部署,可参考helm安装

 

获取Logstash包

helm fetch stable/logstash --version 2.1.0

 

配置文件

在包同级目录下创建配置文件logstash-settings.yaml,内容如下

persistence:
  enabled: false
  #storageClass: managed-nfs-storage
  #accessMode: ReadWriteOnce
  #size: 2Gi
​
image:
  repository: 10.16.200.119/base/logstash           // 它自带的镜像有点难下，下载完后推送到harbor
  tag: latest
  pullPolicy: IfNotPresent
inputs:
  main: |-
    input {     
      kafka {       // 输入来自kafka
        bootstrap_servers => "kafka:9092"   
        codec => json { charset => "UTF-8" }
        consumer_threads => 5
        topics_pattern => "beat-.*"         // topic名称
        type => "example"
      }
​
    }
outputs:
  main: |-
    output {
​
      #stdout { codec => rubydebug }            // 开启debug模式，可在控制台输出
​
      elasticsearch {       // 输出到es
        hosts => ["${ELASTICSEARCH_HOST}:${ELASTICSEARCH_PORT}"]    // es主机配置
        manage_template => false
        index => "%{[@metadata][topic]}-%{+YYYY.MM.dd}" // 创建索引
      }
​
      }
​
elasticsearch:  // es主机定义
  host: elasticsearch-master.default.svc.cluster.local
  port: 9200

 

启动

helm install --name logstash -f logstash-settings.yaml logstash

 

更新配置

helm upgrade logstash -f logstash-settings.yaml logstash

 

停止服务

helm delete logstash --purge

上一篇《Kubernetes部署Kafka》  下一篇《Kubernetes部署Kibana》