Kubernetes应用部署-Kafka3.1.1

Felix_XY

已于 2024-03-25 09:52:48 修改

阅读量425

点赞数 10

分类专栏： Kubernetes部署应用 Kubernetes 文章标签： kubernetes 容器云原生

于 2024-03-25 09:49:16 首次发布

本文链接：https://blog.csdn.net/qq_32060101/article/details/137004592

版权

Kubernetes 同时被 2 个专栏收录

15 篇文章 0 订阅

订阅专栏

Kubernetes部署应用

2 篇文章 0 订阅

订阅专栏

部署文件

提示：在部署Kakfa之前需要先部署Zookeeper

kafka.yaml

# 部署 Headless Service, 用于Kafka间相互通信
apiVersion: v1
kind: Service
metadata:
  name: kafka-headless
  labels:
    app: kafka
spec:
  type: ClusterIP
  clusterIP: None
  ports:
  - name: kafka
    port: 9092
    targetPort: kafka
  selector:
    app: kafka


---
# 部署 Service，用于外部访问 Kafka
apiVersion: v1
kind: Service
metadata:
  name: kafka
  labels:
    app: kafka
spec:
  type: ClusterIP
  ports:
  - name: kafka
    port: 9092
    targetPort: kafka
  selector:
    app: kafka


---
# StatefulSet 有状态部署 Kafka
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: kafka
  labels:
    app: kafka
spec:
  selector:
    matchLabels:
      app: kafka
  serviceName: kafka-headless
  podManagementPolicy: Parallel
  replicas: 3
  updateStrategy:
    type: RollingUpdate
  template:
    metadata:
      name: kafka
      labels:
        app: kafka
    spec:      
      securityContext:
        fsGroup: 0
        runAsUser: 0
      containers:
      - name: kafka
        image: docker.io/bitnami/kafka:3.1.1
        imagePullPolicy: IfNotPresent
        resources:
          limits:
            cpu: 500m
            memory: 512Mi
          requests:
            cpu: 250m
            memory: 256Mi
        securityContext:
          runAsUser: 0
        command:
         - bash
         - -ec
         - |
            HOSTNAME="$(hostname -s)"
            if [[ $HOSTNAME =~ (.*)-([0-9]+)$ ]]; then
                ORD=${BASH_REMATCH[2]}
                export KAFKA_BROKER_ID="$((ORD + 1 ))"
            else
                echo "Failed to get index from hostname $HOST"
                exit 1
            fi
            exec /entrypoint.sh /run.sh
        env:
        - name: MY_POD_IP
          valueFrom:
            fieldRef:
              fieldPath: status.podIP
        - name: MY_POD_NAME
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: KAFKA_CFG_ZOOKEEPER_CONNECT
          # 指定zookeeper service地址
          value: "zookeeper:2181"
        - name: KAFKA_CFG_ZOOKEEPER_CONNECTION_TIMEOUT_MS
          value: "18000"
        - name: KAFKA_PORT_NUMBER
          value: "9092"
        - name: KAFKA_CFG_LISTENERS
          value: "PLAINTEXT://:$(KAFKA_PORT_NUMBER)"
        - name: KAFKA_CFG_ADVERTISED_LISTENERS
          value: 'PLAINTEXT://$(MY_POD_NAME).kafka-headless:$(KAFKA_PORT_NUMBER)'
        - name: ALLOW_PLAINTEXT_LISTENER
          value: "yes"
        - name: KAFKA_HEAP_OPTS
          value: "-Xmx512m -Xms512m"
        - name: KAFKA_CFG_DELETE_TOPIC_ENABLE
          value: "true"
        - name: KAFKA_CFG_LOGS_DIRS
          value: /opt/bitnami/kafka/data
        - name: TZ
          value: "Asia/Shanghai"
        ports:
        - name: kafka
          containerPort: 9092
        livenessProbe:
          tcpSocket:
            port: kafka
          initialDelaySeconds: 10
          periodSeconds: 10
          timeoutSeconds: 5
          successThreshold: 1
          failureThreshold: 2
        readinessProbe:
          tcpSocket:
            port: kafka
          initialDelaySeconds: 60
          periodSeconds: 10
          timeoutSeconds: 5
          successThreshold: 1
          failureThreshold: 6
#        volumeMounts:
#        - name: data
#          mountPath: /bitnami/kafka
#  volumeClaimTemplates:
#    - metadata:
#        name: data
#      spec:
#        storageClassName: common-storage    # 指定 storageclass
#        accessModes:
#          - "ReadWriteOnce"
#        resources:
#          requests:
#            storage: 20Gi