k8s学习 — （运维）第十一章 ELK 日志管理，二本学渣考研失败

先自我介绍一下，小编浙江大学毕业，去过华为、字节跳动等大厂，目前阿里P7

深知大多数程序员，想要提升技能，往往是自己摸索成长，但自己不成体系的自学效果低效又漫长，而且极易碰到天花板技术停滞不前！

因此收集整理了一份《2024年最新Linux运维全套学习资料》，初衷也很简单，就是希望能够帮助到想自学提升又不知道该从何学起的朋友。

既有适合小白学习的零基础资料，也有适合3年以上经验的小伙伴深入学习提升的进阶课程，涵盖了95%以上运维知识点，真正体系化！

由于文件比较多，这里只是将部分目录截图出来，全套包含大厂面经、学习笔记、源码讲义、实战项目、大纲路线、讲解视频，并且后续会持续更新

如果你需要这些资料，可以添加V获取：vip1024b （备注运维）

正文

  - effect: NoSchedule 
    operator: Exists 
  # Elasticsearch requires vm.max\_map\_count to be at least 262144. 
  # If your OS already sets up this number to a higher value, feel free 
  # to remove this init container. 
  initContainers: #容器初始化前的操作 
  - name: elasticsearch-logging-init 
    image: alpine:3.6 
    command: ["/sbin/sysctl", "-w", "vm.max\_map\_count=262144"] #添加mmap计数限制，太低可能造成内存不足的错误 
    securityContext:  #仅应用到指定的容器上，并且不会影响Volume 
      privileged: true #运行特权容器 
  - name: increase-fd-ulimit 
    image: busybox 
    imagePullPolicy: IfNotPresent 
    command: ["sh", "-c", "ulimit -n 65536"] #修改文件描述符最大数量 
    securityContext: 
      privileged: true 
  - name: elasticsearch-volume-init #es数据落盘初始化，加上777权限 
    image: alpine:3.6 
    command: 
      - chmod 
      - -R 
      - "777" 
      - /usr/share/elasticsearch/data/ 
    volumeMounts: 
    - name: elasticsearch-logging 
      mountPath: /usr/share/elasticsearch/data/

创建命名空间

kubectl create ns kube-logging

创建服务

kubectl create -f es.yaml

查看 pod 启用情况

kubectl get pod -n kube-logging

### 2.2 部署 logstash 数据清洗

创建 logstash.yaml 并部署服务

---

apiVersion: v1
kind: Service
metadata:
name: logstash
namespace: kube-logging
spec:
ports:

• port: 5044
  targetPort: beats
  selector:
  type: logstash
  clusterIP: None

---

apiVersion: apps/v1
kind: Deployment
metadata:
name: logstash
namespace: kube-logging
spec:
selector:
matchLabels:
type: logstash
template:
metadata:
labels:
type: logstash
srv: srv-logstash
spec:
containers:
- image: docker.io/kubeimages/logstash:7.9.3 #该镜像支持arm64和amd64两种架构
name: logstash
ports:
- containerPort: 5044
name: beats
command:
- logstash
- ‘-f’
- ‘/etc/logstash_c/logstash.conf’
env:
- name: “XPACK_MONITORING_ELASTICSEARCH_HOSTS”
value: “http://elasticsearch-logging:9200”
volumeMounts:
- name: config-volume
mountPath: /etc/logstash_c/
- name: config-yml-volume
mountPath: /usr/share/logstash/config/
- name: timezone
mountPath: /etc/localtime
resources: #logstash一定要加上资源限制，避免对其他业务造成资源抢占影响
limits:
cpu: 1000m
memory: 2048Mi
requests:
cpu: 512m
memory: 512Mi
volumes:
- name: config-volume
configMap:
name: logstash-conf
items:
- key: logstash.conf
path: logstash.conf
- name: timezone
hostPath:
path: /etc/localtime
- name: config-yml-volume
configMap:
name: logstash-yml
items:
- key: logstash.yml
path: logstash.yml