kafka集群 kubernetes_Kubernetes部署Kafka集群

一、单节点Kafka

要搭建Kafka集群，还是要从单节点开始。

1.创建Zookeeper服务zookeeper-svc.yaml和zookeeper-deployment.yaml，用kubectl create -f创建：

apiVersion: v1

kind: Service

metadata:

labels:

app: zookeeper-service

name: zookeeper-service

spec:

ports:

- name: zookeeper-port

port: 2181

targetPort: 2181

selector:

app: zookeeper

apiVersion: extensions/v1beta1

kind: Deployment

metadata:

labels:

app: zookeeper

name: zookeeper

spec:

replicas: 1

template:

metadata:

labels:

app: zookeeper

spec:

containers:

- image: wurstmeister/zookeeper

imagePullPolicy: IfNotPresent

name: zookeeper

ports:

- containerPort: 2181

2.等pod跑起来，service的endpoint配置成功后，就可以继续创建kafka的kafka-svc.yaml和kafka-deployment.yaml了：

apiVersion: v1

kind: Service

metadata:

name: kafka-service

labels:

app: kafka

spec:

type: NodePort

ports:

- port: 9092

name: kafka-port

targetPort: 9092

nodePort: 30092

protocol: TCP

selector:

app: kafka

kind: Deployment

apiVersion: extensions/v1beta1

metadata:

name: kafka-deployment

spec:

replicas: 1

selector:

matchLabels:

name: kafka

template:

metadata:

labels:

name: kafka

app: kafka

spec:

containers:

- name: kafka

image: wurstmeister/kafka

imagePullPolicy: IfNotPresent

ports:

- containerPort: 9092

env:

- name: KAFKA_ADVERTISED_PORT

value: "9092"

- name: KAFKA_ADVERTISED_HOST_NAME

value: "[kafka的service的clusterIP]"

- name: KAFKA_ZOOKEEPER_CONNECT

value: [zookeeper的service的clusterIP]:2181

- name: KAFKA_BROKER_ID

value: "1"

clusterIP通过kubectl get svc进行查看。KAFKA_ZOOKEEPER_CONNECT的值也可以改为zookeeper-service:2181。

在此之前，针对虚拟化的Kafka，需要先执行下面的命令以进入容器：

kubec