kafka集群 kubernetes_使用kubernetes安装Kafka和Zookeeper集群

Can anyone share me the yaml file for creating kafka cluster with two kafka broker and zookeeper cluster with 3 servers.I'm new to kubernetes.

解决方案

I recommend you to try Strimzi Kafka Operator. Using it you can define a Kafka cluster just like other Kubernetes object - writing a yaml file. Moreover, also users, topics and Kafka Connect cluster are just a k8s objects. Some (by not all!) features of Strimzi Kafka Operator:

Secure communication between brokers and between brokers and zookeeper with TLS

Ability to expose the cluster outside k8s cluster

Deployable as a helm chart (it simplifies things a lot)

Rolling updates when changing cluster configuration

Smooth scaling out

Ready to monitor the cluster using Prometheus and Grafana.

It's worth to mention a great documentation.

Creating a Kafka cluster is as simple as applying a Kubernetes manifest like this:

apiVersion: kafka.strimzi.io/v1beta1

kind: Kafka

metadata:

name: my-cluster

spec:

kafka:

version: 2.2.0

replicas: 3

listeners:

plain: {}

tls: {}

config:

offsets.topic.replication.factor: 3

transaction.state.log.replication.factor: 3

transaction.state.log.min.isr: 2

log.message.format.version: "2.2"

storage:

type: jbod

volumes:

- id: 0

type: persistent-claim

size: 100Gi

deleteClaim: false

zookeeper:

replicas: 3

storage:

type: persistent-claim

size: 100Gi

deleteClaim: false

entityOperator:

topicOperator: {}

userOperator: {}