elasticsearch和kibana部署代码

最新推荐文章于 2023-09-22 14:03:06 发布
最新推荐文章于 2023-09-22 14:03:06 发布
阅读量277 收藏
点赞数
分类专栏： # k8s
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/goodlife111/article/details/100740642
版权

es-client-deployment.yaml

apiVersion: apps/v1beta1
kind: Deployment
metadata:
  name: es-client
  namespace: ops
  labels:
    component: elasticsearch
    role: client
spec:
  replicas: 2
  template:
    metadata:
      labels:
        component: elasticsearch
        role: client
    spec:
      affinity:
        podAntiAffinity:
          preferredDuringSchedulingIgnoredDuringExecution:
          - weight: 100
            podAffinityTerm:
              labelSelector:
                matchExpressions:
                - key: role
                  operator: In
                  values:
                  - client
              topologyKey: kubernetes.io/hostname
      initContainers:
      - name: init-sysctl
        image: docker.idc.cedu.cn/.../busybox
        command:
        - sysctl
        - -w
        - vm.max_map_count=262144
        securityContext:
          privileged: true
      containers:
      - name: es-client
        image: docker.idc.cedu.cn/.../elasticsearch:6.7.1_v3
        env:
        - name: NAMESPACE
          valueFrom:
            fieldRef:
              fieldPath: metadata.namespace
        - name: NODE_NAME
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: CLUSTER_NAME
          value: "k8s_elasticsearch_cluster"
        - name: NUMBER_OF_MASTERS
          value: "2"
        - name: HTTP_CORS_ALLOW_ORIGIN
          value: "*"
        - name: HTTP_CORS_ENABLE
          value: "true"
        - name: NETWORK_HOST
          value: "0.0.0.0"
        - name: MAX_LOCAL_STORAGE_NODES
          value: "1"
        - name: NODE_INGEST
          value: "false"
        - name: NODE_MASTER
          value: "false"
        - name: NODE_DATA
          value: "false"
        - name: HTTP_ENABLE
          value: "true"
        - name: ES_JAVA_OPTS
          value: -Xms1024m -Xmx1024m
        - name: NETWORK_HOST
          value: _site_,_lo_
        ports:
        - containerPort: 9200
          name: http
        - containerPort: 9300
          name: transport
        livenessProbe:
          tcpSocket:
            port: transport
        readinessProbe:
          httpGet:
            path: /_cluster/health
            port: http
          initialDelaySeconds: 20
          timeoutSeconds: 5
        volumeMounts:
        - name: storage
          mountPath: /usr/share/elasticsearch/data 
      volumes:
          - emptyDir:
              medium: ""
            name: storage

es-data-stateful.yaml

apiVersion: apps/v1beta2
kind: StatefulSet
metadata:
  name: es-data-stateful
  namespace: ops
  labels:
    component: elasticsearch
    role: data
spec:
  serviceName: elasticsearch-data
  selector:
    matchLabels:
      component: elasticsearch
      role: data
  replicas: 3
  updateStrategy:
    type: RollingUpdate
  template:
    metadata:
      labels:
        component: elasticsearch
        role: data
    spec:
      affinity:
        podAntiAffinity:
          preferredDuringSchedulingIgnoredDuringExecution:
          - weight: 100
            podAffinityTerm:
              labelSelector:
                matchExpressions:
                - key: role
                  operator: In
                  values:
                  - data
              topologyKey: kubernetes.io/hostname
      terminationGracePeriodSeconds: 10
      initContainers:
      - name: init-sysctl
        image: docker.idc.cedu.cn/.../busybox
        command:
        - sysctl
        - -w
        - vm.max_map_count=262144
        securityContext:
          privileged: true
      containers:
      - name: es-data
        image: docker.idc.cedu.cn/.../elasticsearch:6.7.1_v3
        env:
        - name: NAMESPACE
          valueFrom:
            fieldRef:
              fieldPath: metadata.namespace
        - name: NODE_NAME
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: CLUSTER_NAME
          value: "k8s_elasticsearch_cluster"
        - name: NODE_MASTER
          value: "false"
        - name: NODE_INGEST
          value: "false"
        - name: HTTP_ENABLE
          value: "false"
        - name: NODE_DATA
          value: "true"
        - name: ES_JAVA_OPTS
          value: -Xms1024m -Xmx1024m
        - name: NUMBER_OF_MASTERS
          value: "2"
        - name: HTTP_CORS_ALLOW_ORIGIN
          value: "*"
        - name: HTTP_CORS_ENABLE
          value: "false"
        - name: NETWORK_HOST
          value: "0.0.0.0"
        - name: MAX_LOCAL_STORAGE_NODES
          value: "1"
        ports:
        - containerPort: 9300
          name: transport
        livenessProbe:
          tcpSocket:
            port: transport
          initialDelaySeconds: 20
          periodSeconds: 10
        volumeMounts:
        - name: storage
          mountPath: /usr/share/elasticsearch/data
      #volumes:
      #- name: storage
      #  emptyDir: {}
  volumeClaimTemplates:
  - metadata:
      name: storage
    spec:
      storageClassName: local-storage
      accessModes: [ ReadWriteOnce ]
      resources:
        requests:
          storage: 150Gi

es-master-stateful.yaml

apiVersion: apps/v1beta1
kind: StatefulSet
metadata:
  name: es-master-stateful
  namespace: ops
  labels:
    component: elasticsearch
    role: master
spec:
  serviceName: elasticsearch-master
  selector:
    matchLabels:
      component: elasticsearch
      role: master
  replicas: 3
  template:
    metadata:
      labels:
        component: elasticsearch
        role: master
    spec:
      affinity:
        podAntiAffinity:
          preferredDuringSchedulingIgnoredDuringExecution:
          - weight: 100
            podAffinityTerm:
              labelSelector:
                matchExpressions:
                - key: role
                  operator: In
                  values:
                  - master
              topologyKey: kubernetes.io/hostname
      initContainers:
      - name: init-sysctl
        image: docker.idc.cedu.cn/.../busybox
        command:
        - sysctl
        - -w
        - vm.max_map_count=262144
        securityContext:
          privileged: true
      containers:
      - name: es-master
        image: docker.idc.cedu.cn/.../elasticsearch:6.7.1_v3
        env:
        - name: NAMESPACE
          valueFrom:
            fieldRef:
              fieldPath: metadata.namespace
        - name: NODE_NAME
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: CLUSTER_NAME
          value: "k8s_elasticsearch_cluster"
        - name: NUMBER_OF_MASTERS
          value: "2"
        - name: HTTP_CORS_ALLOW_ORIGIN
          value: "*"
        - name: HTTP_CORS_ENABLE
          value: "false"
        - name: NETWORK_HOST
          value: "0.0.0.0"
        - name: MAX_LOCAL_STORAGE_NODES
          value: "1"
        - name: NODE_MASTER
          value: "true"
        - name: NODE_INGEST
          value: "false"
        - name: NODE_DATA
          value: "false"
        - name: HTTP_ENABLE
          value: "false"
        - name: ES_JAVA_OPTS
          value: -Xms1024m -Xmx1024m
        ports:
        - containerPort: 9300
          name: transport
        livenessProbe:
          tcpSocket:
            port: transport
        volumeMounts:
        - name: storage
          mountPath: /usr/share/elasticsearch/data
      volumes:
      - name: storage
        emptyDir: {}
  #volumeClaimTemplates:
  #- metadata:
  #    name: storage
  #  spec:
  #    storageClassName: local-storage
  #    accessModes: [ ReadWriteOnce ]
  #    resources:
  #      requests:
  #       storage: 10Gi

es-svc.yaml

apiVersion: v1
kind: Service
metadata:
  name: elasticsearch-discovery
  namespace: ops
  labels:
    component: elasticsearch
    role: master
spec:
  selector:
    component: elasticsearch
    role: master
  ports:
  - name: transport
    port: 9300
    protocol: TCP
---
apiVersion: v1
kind: Service
metadata:
  name: elasticsearch-client
  namespace: ops
  labels:
    component: elasticsearch
    role: client
spec:
  selector:
    component: elasticsearch
    role: client
  ports:
  - name: http
    port: 9200
#type: LoadBalancer
---
apiVersion: v1
kind: Service
metadata:
  name: elasticsearch-master
  namespace: ops
  labels:
    component: elasticsearch
    role: master
spec:
  ports:
  - port: 9300
    name: transport
  clusterIP: None
  selector:
    component: elasticsearch
    role: master
---
apiVersion: v1
kind: Service
metadata:
  name: elasticsearch-data
  namespace: ops
  labels:
    component: elasticsearch
    role: data
spec:
  ports:
  - port: 9300
    name: transport
  clusterIP: None
  selector:
    component: elasticsearch
    role: data

kibana_deployment.yaml

apiVersion: v1
kind: Service
metadata:
  name: kibana
  namespace: ops
  labels:
    app: kibana
spec:
  ports:
  - port: 5601
  selector:
    app: kibana

---
apiVersion: apps/v1
kind: Deployment
metadata:
  name: kibana
  namespace: ops
  labels:
    app: kibana
spec:
  selector:
    matchLabels:
      app: kibana
  template:
    metadata:
      labels:
        app: kibana
    spec:
      containers:
      - name: kibana
        image: docker.idc.cedu.cn/.../kibana:6.7.1_v1
        resources:
          limits:
            cpu: 1000m
          requests:
            cpu: 100m
        env:
          - name: elasticsearch.url
            value: http://elasticsearch-client.ops.svc.idc.cedu.cn:9200
        ports:
        - containerPort: 5601
        readinessProbe:
          tcpSocket:
            port: 5601
          timeoutSeconds: 10
          initialDelaySeconds: 5
        livenessProbe:
          tcpSocket:
            port: 5601
          timeoutSeconds: 10
          initialDelaySeconds: 5
        volumeMounts:
        - name: kibana
          mountPath: "/usr/share/kibana/config" 
      volumes:
      - name: kibana
        configMap:
          name: kibana-config

elasticsearch.yaml

# 生成configmap，进行配置热加载
cluster:
  name: ${CLUSTER_NAME}

node:
  master: ${NODE_MASTER}
  data: ${NODE_DATA}
  name: ${NODE_NAME}
  ingest: ${NODE_INGEST}
  max_local_storage_nodes: ${MAX_LOCAL_STORAGE_NODES}

network.host: ${NETWORK_HOST}

path:
  data: /usr/share/elasticsearch/data
  logs: /usr/share/elasticsearch/logs

bootstrap:
  memory_lock: ${MEMORY_LOCK}

http:
  enabled: ${HTTP_ENABLE}
  compression: true
  cors:
    enabled: ${HTTP_CORS_ENABLE}
    allow-origin: ${HTTP_CORS_ALLOW_ORIGIN}

discovery:
  zen:
    ping.unicast.hosts: ${DISCOVERY_SERVICE}
    minimum_master_nodes: ${NUMBER_OF_MASTERS}

kibana.yaml

# 生成configmap，进行配置热加载
server.name: "kibana"
server.host: "0"
elasticsearch.hosts: [ "http://elasticsearch-client.ops.svc.idc.cedu.cn:9200" ]
xpack.monitoring.ui.container.elasticsearch.enabled: true
孔小发
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
Elasticsearch集群模式部署
06-30
学习总结资料
Elasticsearch学习（二）使用Kibana实现对es的增删改查
一天不写代码难受的博客
02-14 2398
目录使用Kibana支持的命令1 GET _cat/health?v2 创建索引2.1创建索引时指定分片3 修改索引4 删除索引5 查看索引信息5 往索引里面存数据（新增Document）5.1PUT语法 使用Kibana 支持的命令 1 GET _cat/health?v 这个命令的意思是看这个软件的运行状态，也就是看这个软件的健康状态 Epoch（编号） timestamp（时间戳） cluster（集群名称） status（健康状态） node.total（节点总
ES与 Kibana安装部署
weixin_42796403的博客
02-22 891
ES与 Kibana安装部署 一、ElasticSearch安装部署 1.1 安装包下载 1）ElasticSearch官网： https://www.elastic.co/cn/downloads/elasticsearch 1.2 ElasticSearch安装 1.2.1 解压安装ElasticSearch 1）解压elasticsearch-6.6.0.tar.gz到/opt/module目录下 [hadoop@hadoop102 software]$ tar -zxvf elasticsearc
ES集群+Kibana部署
edutech_wang的博客
08-17 7557
ES8集群+kibana
ELK生态圈（es、logstash、kibana）的介绍和安装部署
PAyy_413的博客
09-22 980
​ELK生态圈的三大组件介绍和安装部署！
部署ElasticSearch与kibana（持续更新）
Vae的黑粉
04-13 508
文章目录一、ElasticSearch介绍二、安装ElasticSearch三、部署kibana四、IK分词器 一、ElasticSearch介绍 ElasticSearch是一款强大的开源搜索引擎，可以用来实现搜索、日志统计、分析、系统监控等功能。 ElasticSearch底层是基于lucene实现的，他是Apache的开源搜索引擎类库，他具有易拓展，高性能等优势，但是其只限于java语言开发和不支持水平拓展也造成了一定的局限性。 ElasticSearch擅长海量的数据搜索，分析计算。mysql擅长事
Kubernetes持久化部署elasticsearch7.15.0分布式集群
02-21
原文链接：https://blog.csdn.net/m0_37814112/article/details/122965720 说明：包含elasticsearch7.15.0集群3节点、5节点、7节点等三种方式的K8S部署yaml文件、镜像文件，里面有详细的README.txt部署参考
elasticsearch超详细安装部署手册
11-03
本文将详细介绍在Linux和Windows系统上安装和部署Elasticsearch的详细步骤。 **Windows安装部署** 1. **下载与解压**：首先从官方渠道获取Elasticsearch的zip安装包，例如`elasticsearch-6.6.1.zip`，并将其解压到...
es docker 部署 elasticsearch.yml
03-19
docker run --name elasticsearch7.16.3 -p 127.0.0.1:9200:9200 -p 127.0.0.1:9300:9300 -e "discovery.type=single-node" -v /Users/xingyue/Home/xingyue/学习/工程化/es/elasticsearch.yml:/usr/share/elastic...
安装部署 elasticsearch kibana 资源
11-05
安装部署 elasticsearch kibana 资源 如果有不会的伙伴 可以参考安装部署专栏《安装部署 elasticsearch kibana IK分词器》文章 其中会有较为详细的部署步奏 如果有不足之处,朢大神评论区指点 感谢您的支持, ღ( ´･...
如何在Kubernetes上部署高可用和可扩展的Elasticsearch？ ...
测试0901-1
12-18 868
先决条件 Elasticsearch的基本知识，其Node类型及角色 运行至少有3个节点的Kubernetes集群（至少4Cores 4GB） Kibana的相关知识 部署架构图 Elasticsearch Data Node的Pod被部署为具有Headless Service的StatefulSets，以提供稳定的网络ID。 Elasticsea...
记一次K8s EFK(elasticsearch+fluentd+kibana)搭建排错经历
xjaixj9293的博客
02-20 881
部署教程：https://qhh.me/2019/09/05/Kubernetes-%E5%9F%BA%E4%BA%8E-EFK-%E6%8A%80%E6%9C%AF%E6%A0%88%E7%9A%84%E6%97%A5%E5%BF%97%E6%94%B6%E9%9B%86%E5%AE%9E%E8%B7%B5/ yaml地址：https://github.com/kubernetes/kuber...
完整K8S日志系统解决方案：fluentd+elasticsearch+kibana，网上坑太多，研究3整天，望一文章解决所有问题
LegendHonor的博客
04-21 2855
1、环境准备 k8s环境: master:10.XX.XX.XX, node: 10.XX.XX.XX,10.XX.XX.XX,10.XX.XX.XX 对外发布地址：10.41.10.60 ceph环境： manage:10.41.10.81,node: 10.41.10.XX,XX,XX docker 镜像仓库环境： 10.41.10.81 以上环境在看本文时，应该是全部完成。 2、下载dock...
Elastic：运用 Elastic Stack 对 Kubernetes 进行监控 （二）
Elastic 中国社区官方博客
05-02 1285
在今天的文章中，我们将描述如何在Kubernetes中安装Elasticsearch及Kibana，并利用它们来存储数据并可视化被监控的数据。 Elasticsearch集群 如上一篇文章中所述，要使用Elastic技术设置监视堆栈，我们首先需要部署Elasticsearch，它将充当数据库来存储所有数据（指标，日志和跟踪）。 该数据库将由三个可扩展的节点组成，这些节点按照建议的生产方式...
K8S里给nginx配置带认证的http代理（示例：配置安全访问kibana)
LegendHonor的博客
05-21 1034
1、创建一个nginx.conf配置文件nginx.conf #user nginx; worker_processes 1; error_log /var/log/nginx/error.log warn; #pid /var/run/nginx.pid; events { worker_connections 1024; } http { #include /etc/nginx/mime.types; default_type appli
elasticsearch kibana使用说明
weixin_43931625的博客
01-10 939
elasticsearchkibana使用说明 kibana是一个开源的可视化分析平台，常用于处理elasticsearch中的数据，可用图表等形式直观地展现数据 **************************** 配置文件 server.name: kibana server.port: 5601 #连接的elasticsearch信息 elasticsea...
Elasticsearch的部署和应用
最新发布
06-14
以下是Elasticsearch部署和应用的一些基本步骤和应用场景： 1. **部署**: - **安装**: Elasticsearch支持多种操作系统（如Linux、macOS、Windows），可以从官方网站下载并按照说明进行安装。 - **配置**: 配置...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值