Kafka & ZooKeeper Docker镜像
landoop/fast-data-dev
提供了一整套包括Kafka,ZooKeeper,Schema Registry,,Kafka-Connect等在内的多种开发工具和Web UI监视系统。基本上是我见过的最强大的开发环境。尤其是对于Kafka Connect的支持,包含了MongoDB,ElasticSearch,Twitter等超过20种Connector,并且提供了通过REST API提交Connector配置的Web UI。
基本是我测试Kafka Connect的首选。
wurstmeister/kafka
维护较为频繁的一个Kafka镜像。只包含了Kafka,因此需要另行提供ZooKeeper,推荐使用同一作者提交的wurstmeister/zookeeper。
一.镜像拉取
docker pull wurstmeister/zookeeper
docker pull wurstmeister/kafka
二.定义docker-compose.yml
1个zookpeer 1个kafka
version: '3'
services:
zoo1:
image: wurstmeister/zookeeper
ports:
- "2181:2181"
hostname: zoo1
container_name: zookeeper
kafka:
image: wurstmeister/kafka
depends_on:
- zoo1
ports:
- "9092:9092"
environment:
KAFKA_ADVERTISED_HOST_NAME: localhost
KAFKA_CREATE_TOPICS: "sun:1:1"
KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
KAFKA_BROKER_ID: 1
KAFKA_ZOOKEEPER_CONNECT: zoo1:2181
volumes:
- /Users/xushuainan/docker_kafka/docker.sock:/var/run/docker.sock
container_name: kafka
1个zookpeer 3个kafka 1个kafka-manager
version: '3.3'
services:
zookeeper:
image: wurstmeister/zookeeper
ports:
- 2181:2181
container_name: zookeeper
networks:
extnetwork:
ipv4_address: 172.19.0.11
kafka1:
image: wurstmeister/kafka
depends_on:
- zookeeper
container_name: kafka1
ports:
- 9092:9092
environment:
KAFKA_ADVERTISED_HOST_NAME: localhost
#KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka1:9092
#KAFKA_LISTENERS: PLAINTEXT://kafka1:9092
KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
KAFKA_BROKER_ID: 1
volumes:
- /Users/xushuainan/docker_kafka/data/kafka1/data:/data
- /Users/xushuainan/docker_kafka/data/kafka1/log:/datalog
- /Users/xushuainan/docker_kafka/docker.sock:/var/run/docker.sock
networks:
extnetwork:
ipv4_address: 172.19.0.12
kafka2:
image: wurstmeister/kafka
depends_on:
- zookeeper
container_name: kafka2
ports:
- 9093:9093
environment:
KAFKA_ADVERTISED_HOST_NAME: localhost
#KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafk