Docker搭建 zk集群和kafka集群

福利网址：261.67.48709.%68ost/7/33/5.05

下载Docker：yum -y install docker
启动命令：service docker start
如果需要用到 docker-compose 安装步骤如下（本文基于这种方式）

1、centos使用命令yum -y install python-pip安装pip
2、yum -y install python-pip docker-compose
查看安装的版本
docker-compose --version　
Docker-compose卸载
pip uninstall docker-compose

准备工作：

#创建两个文件夹分别存放docker-compose.yml文件，方便管理
cd /usr/local
mkdir docker
cd docker
mkdir zookeper
mkdir kafka

一、搭建zookeeper集群

1、创建 docker-compose.yml文件

cd /usr/local/docker/zookeeper
vim docker-compose.yml

docker-compose.yml文件内容

version: '3.3'

services:

  zoo1:

    image: zookeeper

    restart: always

    hostname: zoo1

    ports:

      - 2181:2181

    environment:

      ZOO_MY_ID: 1

      ZOO_SERVERS: server.1=0.0.0.0:2888:3888;2181 server.2=zoo2:2888:3888;2181 server.3=zoo3:2888:3888;2181

  zoo2:

    image: zookeeper

    restart: always

    hostname: zoo2

    ports:

      - 2182:2181

    environment:

      ZOO_MY_ID: 2

      ZOO_SERVERS: server.1=zoo1:2888:3888;2181 server.2=0.0.0.0:2888:3888;2181 server.3=zoo3:2888:3888;2181

  zoo3:

    image: zookeeper

    restart: always

    hostname: zoo3

    ports:

      - 2183:2181

    environment:

      ZOO_MY_ID: 3

      ZOO_SERVERS: server.1=zoo1:2888:3888;2181 server.2=zoo2:2888:3888;2181 server.3=0.0.0.0:2888:3888;2181

启动命令：

# :wq 保存退出之后

cd /usr/local/docker/zookeeper #确保docker-compose.yml在当前目录，且自己目前也在当前目录

docker-compose up -d

#等待安装和启动

docker ps #查看容器状态

#参考命令

docker-compose ps #查看集群容器状态

docker-compose stop #停止集群容器

docker-compose restart #重启集群容器

如图代表zookeeper已经安装以及启动成功，可自行使用端口扫描工具扫描，等待kafka安装成功以后集中测试

二、Kafka集群搭建

1、确保已经搭建完成zookeeper环境

cd /usr/local/docker/kafka
vim dokcer-compose.yml

2、 docker-compose.yml内容：（请记住宿主机就是物理机本机ip）

version: '2'

services:

  kafka1:

    image: wurstmeister/kafka

    ports:

      - "9093:9092"

    environment:

      KAFKA_ADVERTISED_HOST_NAME: 172.31.120.xx                    ## 修改:宿主机IP

      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://172.31.120.xx:9093    ## 修改:宿主机IP

      KAFKA_ZOOKEEPER_CONNECT: 172.31.120.xx:2183, 172.31.120.xx:2184, 172.31.120.xx:2185 #刚刚安装的zookeeper宿主机IP以及端口

      KAFKA_ADVERTISED_PORT: 9093

    container_name: kafka1

  kafka2:

    image: wurstmeister/kafka

    ports:

      - "9094:9092"

    environment:

      KAFKA_ADVERTISED_HOST_NAME: 172.31.120.xx                  ## 修改:宿主机IP

      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://172.31.120.xx:9094        ## 修改:宿主机IP

      KAFKA_ZOOKEEPER_CONNECT: 172.31.120.xx:2183, 172.31.120.xx:2184, 172.31.120.xx:2185 #刚刚安装的zookeeper宿主机IP以及端口

      KAFKA_ADVERTISED_PORT: 9094

    container_name: kafka2
	
  kafka3:

    image: wurstmeister/kafka

    ports:

      - "9095:9092"

    environment:

      KAFKA_ADVERTISED_HOST_NAME: 172.31.120.xx                  ## 修改:宿主机IP

      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://172.31.120.xx:9095       ## 修改:宿主机IP

      KAFKA_ZOOKEEPER_CONNECT: 172.31.120.xx:2183, 172.31.120.xx:2184, 172.31.120.xx:2185 #刚刚安装的zookeeper宿主机IP以及端口

      KAFKA_ADVERTISED_PORT: 9095

    container_name: kafka3	

  kafka-manager:

    image: sheepkiller/kafka-manager              ## 镜像：开源的web管理kafka集群的界面

    environment:

        ZK_HOSTS: 172.31.120.xx                ## 修改:宿主机IP

    ports:

      - "9020:9000"                              ## 暴露端口

kafka-manager可以自行选择是否安装，不需要安装去除即可

# :wq 保存退出之后

cd /usr/local/docker/kafka#确保docker-compose.yml在当前目录，且自己目前也在当前目录

docker-compose up -d
docker-compose  -f   xxx.yml文件名

#等待安装和启动

docker ps #查看容器状态

#参考命令

docker-compose ps #查看集群容器状态

docker-compose stop #停止集群容器

docker-compose restart #重启集群容器

docker ps 检查zk集群、kafka集群是否启动成功