kafka集群配置记录

先安装zookeeper
        docker run --name zookeeper \
        -p 42181:2181 \
        --restart=always \
        -d zookeeper

在安装kafka
   

docker run --name kafka_1 \
    -e KAFKA_ZOOKEEPER_CONNECT=172.168.1.5:42181 \
    -e KAFKA_ZOOKEEPER_CONNECT_TIME_MS=6000 \
    -e KAFKA_LOG_CLEANUP_POLICY=delete \
    -e KAFKA_LOG_RETENTION_HOURS=72 \
    -e KAFKA_LOG_SEGMENT_BYTES=1073741824 \
    -e KAFKA_LOG_RETENTION_CHECK_INTERVAL_MS=300000 \
    -e KAFKA_DELETE_TOPIC_ENABLE=true \
    -e KAFKA_NUM_PARTITIONS=3 \
    -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:49091 \
    -e KAFKA_ADVERTISED_HOST_NAME=172.168.1.5 \
    -e KAFKA_ADVERTISED_PORT=49091 \
    -e KAFKA_BROKER_ID=1 \
    -p 49091:49091 \
    --restart=always \
    -d wurstmeister/kafka

docker run --name kafka_2 \
    -e KAFKA_ZOOKEEPER_CONNECT=172.168.1.5:42181 \
    -e KAFKA_ZOOKEEPER_CONNECT_TIME_MS=6000 \
    -e KAFKA_LOG_CLEANUP_POLICY=delete \
    -e KAFKA_LOG_RETENTION_HOURS=72 \
    -e KAFKA_LOG_SEGMENT_BYTES=1073741824 \
    -e KAFKA_LOG_RETENTION_CHECK_INTERVAL_MS=300000 \
    -e KAFKA_DELETE_TOPIC_ENABLE=true \
    -e KAFKA_NUM_PARTITIONS=3 \
    -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:49092 \
    -e KAFKA_ADVERTISED_HOST_NAME=172.168.1.5 \
    -e KAFKA_ADVERTISED_PORT=49092 \
    -e KAFKA_BROKER_ID=2 \
    -p 49092:49092 \
    --restart=always \
    -d wurstmeister/kafka

docker run --name kafka_3 \
    -e KAFKA_ZOOKEEPER_CONNECT=172.168.1.5:42181 \
    -e KAFKA_ZOOKEEPER_CONNECT_TIME_MS=6000 \
    -e KAFKA_LOG_CLEANUP_POLICY=delete \
    -e KAFKA_LOG_RETENTION_HOURS=72 \
    -e KAFKA_LOG_SEGMENT_BYTES=1073741824 \
    -e KAFKA_LOG_RETENTION_CHECK_INTERVAL_MS=300000 \
    -e KAFKA_DELETE_TOPIC_ENABLE=true \
    -e KAFKA_NUM_PARTITIONS=3 \
    -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:49093 \
    -e KAFKA_ADVERTISED_HOST_NAME=172.168.1.5 \
    -e KAFKA_ADVERTISED_PORT=49093 \
    -e KAFKA_BROKER_ID=3 \
    -p 49093:49093 \
    --restart=always \
    -d wurstmeister/kafka

都安装好以后，利用一下命令查看集群是否成功

查看kafka的topics列表 ./bin/kafka-topics.sh --list --zookeeper localhost:2181
建立生产者./bin/kafka-console-producer.sh --broker-list 172.168.1.5:49092 --topic topic
建立消费者./bin/kafka-console-consumer.sh --bootstrap-server 172.168.1.5:49092 --topic topic --from-beginning