【Kafka】3 Docker部署Kafka+ZooKeeper

最新推荐文章于 2022-11-26 14:56:13 发布
最新推荐文章于 2022-11-26 14:56:13 发布
阅读量1.4k 收藏 1
点赞数
分类专栏： 运维实战踩坑系列 文章标签： docker kafka
本文为博主原创文章，未经博主允许不得转载。
本文链接：https://blog.csdn.net/diandianxiyu_geek/article/details/112556618
版权

Docker

推荐使用docker-compose构建环境脚本，方便修改以及同步。

新建文件 docker-compse.yml

1 安装 ZooKeeper

version: "3"
services:
  zoo1:
      image: zookeeper
      restart: always
      hostname: zoo1
      ports:
        - 2181:2181

diandianxiyu_geek@bogon kafka % docker-compose up
Creating network "kafka_default" with the default driver
Pulling zoo1 (zookeeper:)...
latest: Pulling from library/zookeeper
6ec7b7d162b2: Pull complete
177617b11d13: Pull complete
10273812b9e3: Pull complete
ac553cdb1df6: Pull complete
ad2343433791: Pull complete
b5eb0bf88a7c: Pull complete
4650505930d7: Pull complete
2dbba1d515b1: Pull complete
Digest: sha256:d7951bb2594c7d40d3e4e193ee1a9ad09cb4ab0d7aa5ce08756a734ac8498ac0
Status: Downloaded newer image for zookeeper:latest
Creating kafka_zoo1_1 ... done
Attaching to kafka_zoo1_1
zoo1_1  | ZooKeeper JMX enabled by default
zoo1_1  | Using config: /conf/zoo.cfg
zoo1_1  | 2021-01-13 03:38:40,796 [myid:] - INFO  [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg
zoo1_1  | 2021-01-13 03:38:40,801 [myid:] - INFO  [main:QuorumPeerConfig@451] - clientPort is not set
zoo1_1  | 2021-01-13 03:38:40,802 [myid:] - INFO  [main:QuorumPeerConfig@464] - secureClientPort is not set
zoo1_1  | 2021-01-13 03:38:40,802 [myid:] - INFO  [main:QuorumPeerConfig@480] - observerMasterPort is not set
zoo1_1  | 2021-01-13 03:38:40,803 [myid:] - INFO  [main:QuorumPeerConfig@497] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider
zoo1_1  | 2021-01-13 03:38:40,809 [myid:] - ERROR [main:QuorumPeerConfig@722] - Invalid configuration, only one server specified (ignoring)
zoo1_1  | 2021-01-13 03:38:40,813 [myid:1] - INFO  [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
zoo1_1  | 2021-01-13 03:38:40,813 [myid:1] - INFO  [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
zoo1_1  | 2021-01-13 03:38:40,813 [myid:1] - INFO  [main:DatadirCleanupManager@101] - Purge task is not scheduled.
zoo1_1  | 2021-01-13 03:38:40,813 [myid:1] - WARN  [main:QuorumPeerMain@138] - Either no config or no quorum defined in config, running in standalone mode
zoo1_1  | 2021-01-13 03:38:40,817 [myid:1] - INFO  [main:ManagedUtil@44] - Log4j 1.2 jmx support found and enabled.
zoo1_1  | 2021-01-13 03:38:40,826 [myid:1] - INFO  [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg
zoo1_1  | 2021-01-13 03:38:40,826 [myid:1] - INFO  [main:QuorumPeerConfig@451] - clientPort is not set
zoo1_1  | 2021-01-13 03:38:40,827 [myid:1] - INFO  [main:QuorumPeerConfig@464] - secureClientPort is not set
zoo1_1  | 2021-01-13 03:38:40,827 [myid:1] - INFO  [main:QuorumPeerConfig@480] - observerMasterPort is not set
zoo1_1  | 2021-01-13 03:38:40,827 [myid:1] - INFO  [main:QuorumPeerConfig@497] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider
zoo1_1  | 2021-01-13 03:38:40,828 [myid:1] - ERROR [main:QuorumPeerConfig@722] - Invalid configuration, only one server specified (ignoring)
zoo1_1  | 2021-01-13 03:38:40,829 [myid:1] - INFO  [main:ZooKeeperServerMain@122] - Starting server
zoo1_1  | 2021-01-13 03:38:40,845 [myid:1] - INFO  [main:ServerMetrics@62] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@11fc564b
zoo1_1  | 2021-01-13 03:38:40,849 [myid:1] - INFO  [main:FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : false
zoo1_1  | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] - 
zoo1_1  | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] -   ______                  _                                          
zoo1_1  | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] -  |___  /                 | |                                         
zoo1_1  | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] -     / /    ___     ___   | | __   ___    ___   _ __     ___   _ __   
zoo1_1  | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] -    / /    / _ \   / _ \  | |/ /  / _ \  / _ \ | '_ \   / _ \ | '__|
zoo1_1  | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] -   / /__  | (_) | | (_) | |   <  |  __/ |  __/ | |_) | |  __/ | |    
zoo1_1  | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] -  /_____|  \___/   \___/  |_|\_\  \___|  \___| | .__/   \___| |_|
zoo1_1  | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] -                                               | |                     
zoo1_1  | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] -                                               |_|                     
zoo1_1  | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] - 
zoo1_1  | 2021-01-13 03:38:40,861 [myid:1] - INFO  [main:Environment@98] - Server environment:zookeeper.version=3.6.2--803c7f1a12f85978cb049af5e4ef23bd8b688715, built on 09/04/2020 12:44 GMT
zoo1_1  | 2021-01-13 03:38:40,861 [myid:1] - INFO  [main:Environment@98] - Server environment:host.name=zoo1
zoo1_1  | 2021-01-13 03:38:40,862 [myid:1] - INFO  [main:Environment@98] - Server environment:java.version=11.0.9.1
zoo1_1  | 2021-01-13 03:38:40,862 [myid:1] - INFO  [main:Environment@98] - Server environment:java.vendor=Oracle Corporation
zoo1_1  | 2021-01-13 03:38:40,862 [myid:1] - INFO  [main:Environment@98] - Server environment:java.home=/usr/local/openjdk-11
zoo1_1  | 2021-01-13 03:38:40,862 [myid:1] - INFO  [main:Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.6.2-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.6.2-bin/bin/../build/classes:/apache-zookeeper-3.6.2-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.6.2-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/zookeeper-prometheus-metrics-3.6.2.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/zookeeper-jute-3.6.2.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/zookeeper-3.6.2.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/snappy-java-1.1.7.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/slf4j-log4j12-1.7.25.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/slf4j-api-1.7.25.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/simpleclient_servlet-0.6.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/simpleclient_hotspot-0.6.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/simpleclient_common-0.6.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/simpleclient-0.6.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-transport-native-unix-common-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-transport-native-epoll-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-transport-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-resolver-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-handler-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-common-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-codec-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-buffer-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/metrics-core-3.2.5.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/log4j-1.2.17.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/json-simple-1.1.1.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-util-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-servlet-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-server-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-security-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-io-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-http-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jackson-databind-2.10.3.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jackson-core-2.10.3.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jackson-annotations-2.10.3.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/commons-lang-2.6.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/commons-cli-1.2.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/audience-annotations-0.5.0.jar:/apache-zookeeper-3.6.2-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.6.2-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf:
zoo1_1  | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib
zoo1_1  | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:java.io.tmpdir=/tmp
zoo1_1  | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:java.compiler=<NA>
zoo1_1  | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:os.name=Linux
zoo1_1  | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:os.arch=amd64
zoo1_1  | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:os.version=4.19.121-linuxkit
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:user.name=zookeeper
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:user.home=/home/zookeeper
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:user.dir=/apache-zookeeper-3.6.2-bin
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:os.memory.free=80MB
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:os.memory.max=1000MB
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:os.memory.total=94MB
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:ZooKeeperServer@129] - zookeeper.enableEagerACLCheck = false
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:ZooKeeperServer@137] - zookeeper.digest.enabled = true
zoo1_1  | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:ZooKeeperServer@141] - zookeeper.closeSessionTxn.enabled = true
zoo1_1  | 2021-01-13 03:38:40,865 [myid:1] - INFO  [main:ZooKeeperServer@1444] - zookeeper.flushDelay=0
zoo1_1  | 2021-01-13 03:38:40,865 [myid:1] - INFO  [main:ZooKeeperServer@1453] - zookeeper.maxWriteQueuePollTime=0
zoo1_1  | 2021-01-13 03:38:40,865 [myid:1] - INFO  [main:ZooKeeperServer@1462] - zookeeper.maxBatchSize=1000
zoo1_1  | 2021-01-13 03:38:40,865 [myid:1] - INFO  [main:ZooKeeperServer@243] - zookeeper.intBufferStartingSizeBytes = 1024
zoo1_1  | 2021-01-13 03:38:40,866 [myid:1] - INFO  [main:BlueThrottle@141] - Weighed connection throttling is disabled
zoo1_1  | 2021-01-13 03:38:40,868 [myid:1] - INFO  [main:ZooKeeperServer@1256] - minSessionTimeout set to 4000
zoo1_1  | 2021-01-13 03:38:40,868 [myid:1] - INFO  [main:ZooKeeperServer@1265] - maxSessionTimeout set to 40000
zoo1_1  | 2021-01-13 03:38:40,870 [myid:1] - INFO  [main:ResponseCache@45] - Response cache size is initialized with value 400.
zoo1_1  | 2021-01-13 03:38:40,870 [myid:1] - INFO  [main:ResponseCache@45] - Response cache size is initialized with value 400.
zoo1_1  | 2021-01-13 03:38:40,871 [myid:1] - INFO  [main:RequestPathMetricsCollector@111] - zookeeper.pathStats.slotCapacity = 60
zoo1_1  | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@112] - zookeeper.pathStats.slotDuration = 15
zoo1_1  | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@113] - zookeeper.pathStats.maxDepth = 6
zoo1_1  | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@114] - zookeeper.pathStats.initialDelay = 5
zoo1_1  | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@115] - zookeeper.pathStats.delay = 5
zoo1_1  | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@116] - zookeeper.pathStats.enabled = false
zoo1_1  | 2021-01-13 03:38:40,875 [myid:1] - INFO  [main:ZooKeeperServer@1481] - The max bytes for all large requests are set to 104857600
zoo1_1  | 2021-01-13 03:38:40,876 [myid:1] - INFO  [main:ZooKeeperServer@1495] - The large request threshold is set to -1
zoo1_1  | 2021-01-13 03:38:40,876 [myid:1] - INFO  [main:ZooKeeperServer@339] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 clientPortListenBacklog -1 datadir /datalog/version-2 snapdir /data/version-2
zoo1_1  | 2021-01-13 03:38:40,918 [myid:1] - INFO  [main:Log@169] - Logging initialized @489ms to org.eclipse.jetty.util.log.Slf4jLog
zoo1_1  | 2021-01-13 03:38:40,982 [myid:1] - WARN  [main:ContextHandler@1520] - o.e.j.s.ServletContextHandler@2dfaea86{/,null,UNAVAILABLE} contextPath ends with /*
zoo1_1  | 2021-01-13 03:38:40,983 [myid:1] - WARN  [main:ContextHandler@1531] - Empty contextPath
zoo1_1  | 2021-01-13 03:38:41,000 [myid:1] - INFO  [main:Server@359] - jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.9.1+1
zoo1_1  | 2021-01-13 03:38:41,047 [myid:1] - INFO  [main:DefaultSessionIdManager@333] - DefaultSessionIdManager workerName=node0
zoo1_1  | 2021-01-13 03:38:41,048 [myid:1] - INFO  [main:DefaultSessionIdManager@338] - No SessionScavenger set, using defaults
zoo1_1  | 2021-01-13 03:38:41,052 [myid:1] - INFO  [main:HouseKeeper@140] - node0 Scavenging every 660000ms
zoo1_1  | 2021-01-13 03:38:41,059 [myid:1] - WARN  [main:ConstraintSecurityHandler@757] - ServletContext@o.e.j.s.ServletContextHandler@2dfaea86{/,null,STARTING} has uncovered http methods for path: /*
zoo1_1  | 2021-01-13 03:38:41,069 [myid:1] - INFO  [main:ContextHandler@825] - Started o.e.j.s.ServletContextHandler@2dfaea86{/,null,AVAILABLE}
zoo1_1  | 2021-01-13 03:38:41,087 [myid:1] - INFO  [main:AbstractConnector@330] - Started ServerConnector@35dab4eb{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
zoo1_1  | 2021-01-13 03:38:41,090 [myid:1] - INFO  [main:Server@399] - Started @666ms
zoo1_1  | 2021-01-13 03:38:41,090 [myid:1] - INFO  [main:JettyAdminServer@182] - Started AdminServer on address 0.0.0.0, port 8080 and command URL /commands
zoo1_1  | 2021-01-13 03:38:41,118 [myid:1] - INFO  [main:ServerCnxnFactory@169] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory
zoo1_1  | 2021-01-13 03:38:41,121 [myid:1] - WARN  [main:ServerCnxnFactory@309] - maxCnxns is not configured, using default value 0.
zoo1_1  | 2021-01-13 03:38:41,124 [myid:1] - INFO  [main:NIOServerCnxnFactory@666] - Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 10 worker threads, and 64 kB direct buffers.
zoo1_1  | 2021-01-13 03:38:41,126 [myid:1] - INFO  [main:NIOServerCnxnFactory@674] - binding to port /0.0.0.0:2181
zoo1_1  | 2021-01-13 03:38:41,143 [myid:1] - INFO  [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager
zoo1_1  | 2021-01-13 03:38:41,143 [myid:1] - INFO  [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager
zoo1_1  | 2021-01-13 03:38:41,145 [myid:1] - INFO  [main:ZKDatabase@132] - zookeeper.snapshotSizeFactor = 0.33
zoo1_1  | 2021-01-13 03:38:41,145 [myid:1] - INFO  [main:ZKDatabase@152] - zookeeper.commitLogCount=500
zoo1_1  | 2021-01-13 03:38:41,151 [myid:1] - INFO  [main:SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED
zoo1_1  | 2021-01-13 03:38:41,152 [myid:1] - INFO  [main:FileTxnSnapLog@470] - Snapshotting: 0x0 to /data/version-2/snapshot.0
zoo1_1  | 2021-01-13 03:38:41,155 [myid:1] - INFO  [main:ZKDatabase@289] - Snapshot loaded in 10 ms, highest zxid is 0x0, digest is 1371985504
zoo1_1  | 2021-01-13 03:38:41,156 [myid:1] - INFO  [main:FileTxnSnapLog@470] - Snapshotting: 0x0 to /data/version-2/snapshot.0
zoo1_1  | 2021-01-13 03:38:41,156 [myid:1] - INFO  [main:ZooKeeperServer@529] - Snapshot taken in 1 ms
zoo1_1  | 2021-01-13 03:38:41,167 [myid:1] - INFO  [main:RequestThrottler@74] - zookeeper.request_throttler.shutdownTimeout = 10000
zoo1_1  | 2021-01-13 03:38:41,167 [myid:1] - INFO  [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@136] - PrepRequestProcessor (sid:0) started, reconfigEnabled=false
zoo1_1  | 2021-01-13 03:38:41,182 [myid:1] - INFO  [main:ContainerManager@83] - Using checkIntervalMs=60000 maxPerMinute=10000 maxNeverUsedIntervalMs=0
zoo1_1  | 2021-01-13 03:38:41,184 [myid:1] - INFO  [main:ZKAuditProvider@42] - ZooKeeper audit is disabled.

2 安装Kafka

添加下面配置

  kafka01:
      image: wurstmeister/kafka
      ports:
        - 9092:9092  
      environment:
        KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://:9092
        KAFKA_LISTENERS: PLAINTEXT://:9092
        KAFKA_ZOOKEEPER_CONNECT: zoo1:2181

启动Kafka

diandianxiyu_geek@bogon kafka % docker-compose up
Recreating kafka_kafka01_1 ... 
Recreating kafka_kafka01_1 ... done
Attaching to kafka_zoo1_1, kafka_kafka01_1
kafka01_1  | Excluding KAFKA_HOME from broker config
kafka01_1  | [Configuring] 'port' in '/opt/kafka/config/server.properties'
zoo1_1     | ZooKeeper JMX enabled by default
zoo1_1     | Using config: /conf/zoo.cfg
zoo1_1     | 2021-01-13 03:38:40,796 [myid:] - INFO  [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg
zoo1_1     | 2021-01-13 03:38:40,801 [myid:] - INFO  [main:QuorumPeerConfig@451] - clientPort is not set
zoo1_1     | 2021-01-13 03:38:40,802 [myid:] - INFO  [main:QuorumPeerConfig@464] - secureClientPort is not set
zoo1_1     | 2021-01-13 03:38:40,802 [myid:] - INFO  [main:QuorumPeerConfig@480] - observerMasterPort is not set
zoo1_1     | 2021-01-13 03:38:40,803 [myid:] - INFO  [main:QuorumPeerConfig@497] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider
zoo1_1     | 2021-01-13 03:38:40,809 [myid:] - ERROR [main:QuorumPeerConfig@722] - Invalid configuration, only one server specified (ignoring)
zoo1_1     | 2021-01-13 03:38:40,813 [myid:1] - INFO  [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
zoo1_1     | 2021-01-13 03:38:40,813 [myid:1] - INFO  [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
zoo1_1     | 2021-01-13 03:38:40,813 [myid:1] - INFO  [main:DatadirCleanupManager@101] - Purge task is not scheduled.
zoo1_1     | 2021-01-13 03:38:40,813 [myid:1] - WARN  [main:QuorumPeerMain@138] - Either no config or no quorum defined in config, running in standalone mode
zoo1_1     | 2021-01-13 03:38:40,817 [myid:1] - INFO  [main:ManagedUtil@44] - Log4j 1.2 jmx support found and enabled.
zoo1_1     | 2021-01-13 03:38:40,826 [myid:1] - INFO  [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg
zoo1_1     | 2021-01-13 03:38:40,826 [myid:1] - INFO  [main:QuorumPeerConfig@451] - clientPort is not set
zoo1_1     | 2021-01-13 03:38:40,827 [myid:1] - INFO  [main:QuorumPeerConfig@464] - secureClientPort is not set
zoo1_1     | 2021-01-13 03:38:40,827 [myid:1] - INFO  [main:QuorumPeerConfig@480] - observerMasterPort is not set
zoo1_1     | 2021-01-13 03:38:40,827 [myid:1] - INFO  [main:QuorumPeerConfig@497] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider
zoo1_1     | 2021-01-13 03:38:40,828 [myid:1] - ERROR [main:QuorumPeerConfig@722] - Invalid configuration, only one server specified (ignoring)
zoo1_1     | 2021-01-13 03:38:40,829 [myid:1] - INFO  [main:ZooKeeperServerMain@122] - Starting server
zoo1_1     | 2021-01-13 03:38:40,845 [myid:1] - INFO  [main:ServerMetrics@62] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@11fc564b
zoo1_1     | 2021-01-13 03:38:40,849 [myid:1] - INFO  [main:FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : false
zoo1_1     | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] - 
zoo1_1     | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] -   ______                  _                                          
zoo1_1     | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] -  |___  /                 | |                                         
zoo1_1     | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] -     / /    ___     ___   | | __   ___    ___   _ __     ___   _ __   
zoo1_1     | 2021-01-13 03:38:40,859 [myid:1] - INFO  [main:ZookeeperBanner@42] -    / /    / _ \   / _ \  | |/ /  / _ \  / _ \ | '_ \   / _ \ | '__|
zoo1_1     | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] -   / /__  | (_) | | (_) | |   <  |  __/ |  __/ | |_) | |  __/ | |    
zoo1_1     | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] -  /_____|  \___/   \___/  |_|\_\  \___|  \___| | .__/   \___| |_|
zoo1_1     | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] -                                               | |                     
zoo1_1     | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] -                                               |_|                     
zoo1_1     | 2021-01-13 03:38:40,860 [myid:1] - INFO  [main:ZookeeperBanner@42] - 
zoo1_1     | 2021-01-13 03:38:40,861 [myid:1] - INFO  [main:Environment@98] - Server environment:zookeeper.version=3.6.2--803c7f1a12f85978cb049af5e4ef23bd8b688715, built on 09/04/2020 12:44 GMT
zoo1_1     | 2021-01-13 03:38:40,861 [myid:1] - INFO  [main:Environment@98] - Server environment:host.name=zoo1
zoo1_1     | 2021-01-13 03:38:40,862 [myid:1] - INFO  [main:Environment@98] - Server environment:java.version=11.0.9.1
zoo1_1     | 2021-01-13 03:38:40,862 [myid:1] - INFO  [main:Environment@98] - Server environment:java.vendor=Oracle Corporation
zoo1_1     | 2021-01-13 03:38:40,862 [myid:1] - INFO  [main:Environment@98] - Server environment:java.home=/usr/local/openjdk-11
zoo1_1     | 2021-01-13 03:38:40,862 [myid:1] - INFO  [main:Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.6.2-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.6.2-bin/bin/../build/classes:/apache-zookeeper-3.6.2-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.6.2-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/zookeeper-prometheus-metrics-3.6.2.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/zookeeper-jute-3.6.2.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/zookeeper-3.6.2.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/snappy-java-1.1.7.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/slf4j-log4j12-1.7.25.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/slf4j-api-1.7.25.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/simpleclient_servlet-0.6.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/simpleclient_hotspot-0.6.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/simpleclient_common-0.6.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/simpleclient-0.6.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-transport-native-unix-common-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-transport-native-epoll-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-transport-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-resolver-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-handler-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-common-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-codec-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/netty-buffer-4.1.50.Final.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/metrics-core-3.2.5.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/log4j-1.2.17.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/json-simple-1.1.1.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-util-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-servlet-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-server-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-security-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-io-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jetty-http-9.4.24.v20191120.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jackson-databind-2.10.3.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jackson-core-2.10.3.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/jackson-annotations-2.10.3.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/commons-lang-2.6.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/commons-cli-1.2.jar:/apache-zookeeper-3.6.2-bin/bin/../lib/audience-annotations-0.5.0.jar:/apache-zookeeper-3.6.2-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.6.2-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf:
zoo1_1     | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib
zoo1_1     | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:java.io.tmpdir=/tmp
zoo1_1     | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:java.compiler=<NA>
zoo1_1     | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:os.name=Linux
zoo1_1     | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:os.arch=amd64
zoo1_1     | 2021-01-13 03:38:40,863 [myid:1] - INFO  [main:Environment@98] - Server environment:os.version=4.19.121-linuxkit
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:user.name=zookeeper
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:user.home=/home/zookeeper
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:user.dir=/apache-zookeeper-3.6.2-bin
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:os.memory.free=80MB
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:os.memory.max=1000MB
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:Environment@98] - Server environment:os.memory.total=94MB
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:ZooKeeperServer@129] - zookeeper.enableEagerACLCheck = false
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:ZooKeeperServer@137] - zookeeper.digest.enabled = true
zoo1_1     | 2021-01-13 03:38:40,864 [myid:1] - INFO  [main:ZooKeeperServer@141] - zookeeper.closeSessionTxn.enabled = true
zoo1_1     | 2021-01-13 03:38:40,865 [myid:1] - INFO  [main:ZooKeeperServer@1444] - zookeeper.flushDelay=0
zoo1_1     | 2021-01-13 03:38:40,865 [myid:1] - INFO  [main:ZooKeeperServer@1453] - zookeeper.maxWriteQueuePollTime=0
zoo1_1     | 2021-01-13 03:38:40,865 [myid:1] - INFO  [main:ZooKeeperServer@1462] - zookeeper.maxBatchSize=1000
zoo1_1     | 2021-01-13 03:38:40,865 [myid:1] - INFO  [main:ZooKeeperServer@243] - zookeeper.intBufferStartingSizeBytes = 1024
zoo1_1     | 2021-01-13 03:38:40,866 [myid:1] - INFO  [main:BlueThrottle@141] - Weighed connection throttling is disabled
zoo1_1     | 2021-01-13 03:38:40,868 [myid:1] - INFO  [main:ZooKeeperServer@1256] - minSessionTimeout set to 4000
zoo1_1     | 2021-01-13 03:38:40,868 [myid:1] - INFO  [main:ZooKeeperServer@1265] - maxSessionTimeout set to 40000
zoo1_1     | 2021-01-13 03:38:40,870 [myid:1] - INFO  [main:ResponseCache@45] - Response cache size is initialized with value 400.
zoo1_1     | 2021-01-13 03:38:40,870 [myid:1] - INFO  [main:ResponseCache@45] - Response cache size is initialized with value 400.
zoo1_1     | 2021-01-13 03:38:40,871 [myid:1] - INFO  [main:RequestPathMetricsCollector@111] - zookeeper.pathStats.slotCapacity = 60
zoo1_1     | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@112] - zookeeper.pathStats.slotDuration = 15
zoo1_1     | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@113] - zookeeper.pathStats.maxDepth = 6
zoo1_1     | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@114] - zookeeper.pathStats.initialDelay = 5
zoo1_1     | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@115] - zookeeper.pathStats.delay = 5
zoo1_1     | 2021-01-13 03:38:40,872 [myid:1] - INFO  [main:RequestPathMetricsCollector@116] - zookeeper.pathStats.enabled = false
zoo1_1     | 2021-01-13 03:38:40,875 [myid:1] - INFO  [main:ZooKeeperServer@1481] - The max bytes for all large requests are set to 104857600
zoo1_1     | 2021-01-13 03:38:40,876 [myid:1] - INFO  [main:ZooKeeperServer@1495] - The large request threshold is set to -1
zoo1_1     | 2021-01-13 03:38:40,876 [myid:1] - INFO  [main:ZooKeeperServer@339] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 clientPortListenBacklog -1 datadir /datalog/version-2 snapdir /data/version-2
zoo1_1     | 2021-01-13 03:38:40,918 [myid:1] - INFO  [main:Log@169] - Logging initialized @489ms to org.eclipse.jetty.util.log.Slf4jLog
zoo1_1     | 2021-01-13 03:38:40,982 [myid:1] - WARN  [main:ContextHandler@1520] - o.e.j.s.ServletContextHandler@2dfaea86{/,null,UNAVAILABLE} contextPath ends with /*
zoo1_1     | 2021-01-13 03:38:40,983 [myid:1] - WARN  [main:ContextHandler@1531] - Empty contextPath
zoo1_1     | 2021-01-13 03:38:41,000 [myid:1] - INFO  [main:Server@359] - jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.9.1+1
zoo1_1     | 2021-01-13 03:38:41,047 [myid:1] - INFO  [main:DefaultSessionIdManager@333] - DefaultSessionIdManager workerName=node0
zoo1_1     | 2021-01-13 03:38:41,048 [myid:1] - INFO  [main:DefaultSessionIdManager@338] - No SessionScavenger set, using defaults
zoo1_1     | 2021-01-13 03:38:41,052 [myid:1] - INFO  [main:HouseKeeper@140] - node0 Scavenging every 660000ms
zoo1_1     | 2021-01-13 03:38:41,059 [myid:1] - WARN  [main:ConstraintSecurityHandler@757] - ServletContext@o.e.j.s.ServletContextHandler@2dfaea86{/,null,STARTING} has uncovered http methods for path: /*
zoo1_1     | 2021-01-13 03:38:41,069 [myid:1] - INFO  [main:ContextHandler@825] - Started o.e.j.s.ServletContextHandler@2dfaea86{/,null,AVAILABLE}
zoo1_1     | 2021-01-13 03:38:41,087 [myid:1] - INFO  [main:AbstractConnector@330] - Started ServerConnector@35dab4eb{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
zoo1_1     | 2021-01-13 03:38:41,090 [myid:1] - INFO  [main:Server@399] - Started @666ms
zoo1_1     | 2021-01-13 03:38:41,090 [myid:1] - INFO  [main:JettyAdminServer@182] - Started AdminServer on address 0.0.0.0, port 8080 and command URL /commands
zoo1_1     | 2021-01-13 03:38:41,118 [myid:1] - INFO  [main:ServerCnxnFactory@169] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory
zoo1_1     | 2021-01-13 03:38:41,121 [myid:1] - WARN  [main:ServerCnxnFactory@309] - maxCnxns is not configured, using default value 0.
zoo1_1     | 2021-01-13 03:38:41,124 [myid:1] - INFO  [main:NIOServerCnxnFactory@666] - Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 10 worker threads, and 64 kB direct buffers.
zoo1_1     | 2021-01-13 03:38:41,126 [myid:1] - INFO  [main:NIOServerCnxnFactory@674] - binding to port /0.0.0.0:2181
zoo1_1     | 2021-01-13 03:38:41,143 [myid:1] - INFO  [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager
zoo1_1     | 2021-01-13 03:38:41,143 [myid:1] - INFO  [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager
zoo1_1     | 2021-01-13 03:38:41,145 [myid:1] - INFO  [main:ZKDatabase@132] - zookeeper.snapshotSizeFactor = 0.33
zoo1_1     | 2021-01-13 03:38:41,145 [myid:1] - INFO  [main:ZKDatabase@152] - zookeeper.commitLogCount=500
zoo1_1     | 2021-01-13 03:38:41,151 [myid:1] - INFO  [main:SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED
zoo1_1     | 2021-01-13 03:38:41,152 [myid:1] - INFO  [main:FileTxnSnapLog@470] - Snapshotting: 0x0 to /data/version-2/snapshot.0
zoo1_1     | 2021-01-13 03:38:41,155 [myid:1] - INFO  [main:ZKDatabase@289] - Snapshot loaded in 10 ms, highest zxid is 0x0, digest is 1371985504
zoo1_1     | 2021-01-13 03:38:41,156 [myid:1] - INFO  [main:FileTxnSnapLog@470] - Snapshotting: 0x0 to /data/version-2/snapshot.0
zoo1_1     | 2021-01-13 03:38:41,156 [myid:1] - INFO  [main:ZooKeeperServer@529] - Snapshot taken in 1 ms
zoo1_1     | 2021-01-13 03:38:41,167 [myid:1] - INFO  [main:RequestThrottler@74] - zookeeper.request_throttler.shutdownTimeout = 10000
zoo1_1     | 2021-01-13 03:38:41,167 [myid:1] - INFO  [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@136] - PrepRequestProcessor (sid:0) started, reconfigEnabled=false
zoo1_1     | 2021-01-13 03:38:41,182 [myid:1] - INFO  [main:ContainerManager@83] - Using checkIntervalMs=60000 maxPerMinute=10000 maxNeverUsedIntervalMs=0
zoo1_1     | 2021-01-13 03:38:41,184 [myid:1] - INFO  [main:ZKAuditProvider@42] - ZooKeeper audit is disabled.
kafka01_1  | [Configuring] 'advertised.listeners' in '/opt/kafka/config/server.properties'
kafka01_1  | [Configuring] 'broker.id' in '/opt/kafka/config/server.properties'
kafka01_1  | Excluding KAFKA_VERSION from broker config
kafka01_1  | [Configuring] 'listeners' in '/opt/kafka/config/server.properties'
kafka01_1  | [Configuring] 'zookeeper.connect' in '/opt/kafka/config/server.properties'
kafka01_1  | [Configuring] 'log.dirs' in '/opt/kafka/config/server.properties'
kafka01_1  | [2021-01-13 09:55:43,830] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$)
kafka01_1  | [2021-01-13 09:55:44,337] INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util)
kafka01_1  | [2021-01-13 09:55:44,429] INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler)
kafka01_1  | [2021-01-13 09:55:44,435] INFO starting (kafka.server.KafkaServer)
kafka01_1  | [2021-01-13 09:55:44,436] INFO Connecting to zookeeper on zoo1:2181 (kafka.server.KafkaServer)
kafka01_1  | [2021-01-13 09:55:44,469] INFO [ZooKeeperClient Kafka server] Initializing a new session to zoo1:2181. (kafka.zookeeper.ZooKeeperClient)
kafka01_1  | [2021-01-13 09:55:44,478] INFO Client environment:zookeeper.version=3.5.8-f439ca583e70862c3068a1f2a7d4d068eec33315, built on 05/04/2020 15:53 GMT (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,478] INFO Client environment:host.name=c4cfd066c4a0 (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,478] INFO Client environment:java.version=1.8.0_212 (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,478] INFO Client environment:java.vendor=IcedTea (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,478] INFO Client environment:java.home=/usr/lib/jvm/java-1.8-openjdk/jre (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,479] INFO Client environment:java.class.path=/opt/kafka/bin/../libs/activation-1.1.1.jar:/opt/kafka/bin/../libs/aopalliance-repackaged-2.6.1.jar:/opt/kafka/bin/../libs/argparse4j-0.7.0.jar:/opt/kafka/bin/../libs/audience-annotations-0.5.0.jar:/opt/kafka/bin/../libs/commons-cli-1.4.jar:/opt/kafka/bin/../libs/commons-lang3-3.8.1.jar:/opt/kafka/bin/../libs/connect-api-2.7.0.jar:/opt/kafka/bin/../libs/connect-basic-auth-extension-2.7.0.jar:/opt/kafka/bin/../libs/connect-file-2.7.0.jar:/opt/kafka/bin/../libs/connect-json-2.7.0.jar:/opt/kafka/bin/../libs/connect-mirror-2.7.0.jar:/opt/kafka/bin/../libs/connect-mirror-client-2.7.0.jar:/opt/kafka/bin/../libs/connect-runtime-2.7.0.jar:/opt/kafka/bin/../libs/connect-transforms-2.7.0.jar:/opt/kafka/bin/../libs/hk2-api-2.6.1.jar:/opt/kafka/bin/../libs/hk2-locator-2.6.1.jar:/opt/kafka/bin/../libs/hk2-utils-2.6.1.jar:/opt/kafka/bin/../libs/jackson-annotations-2.10.5.jar:/opt/kafka/bin/../libs/jackson-core-2.10.5.jar:/opt/kafka/bin/../libs/jackson-databind-2.10.5.1.jar:/opt/kafka/bin/../libs/jackson-dataformat-csv-2.10.5.jar:/opt/kafka/bin/../libs/jackson-datatype-jdk8-2.10.5.jar:/opt/kafka/bin/../libs/jackson-jaxrs-base-2.10.5.jar:/opt/kafka/bin/../libs/jackson-jaxrs-json-provider-2.10.5.jar:/opt/kafka/bin/../libs/jackson-module-jaxb-annotations-2.10.5.jar:/opt/kafka/bin/../libs/jackson-module-paranamer-2.10.5.jar:/opt/kafka/bin/../libs/jackson-module-scala_2.13-2.10.5.jar:/opt/kafka/bin/../libs/jakarta.activation-api-1.2.1.jar:/opt/kafka/bin/../libs/jakarta.annotation-api-1.3.5.jar:/opt/kafka/bin/../libs/jakarta.inject-2.6.1.jar:/opt/kafka/bin/../libs/jakarta.validation-api-2.0.2.jar:/opt/kafka/bin/../libs/jakarta.ws.rs-api-2.1.6.jar:/opt/kafka/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/opt/kafka/bin/../libs/javassist-3.25.0-GA.jar:/opt/kafka/bin/../libs/javassist-3.26.0-GA.jar:/opt/kafka/bin/../libs/javax.servlet-api-3.1.0.jar:/opt/kafka/bin/../libs/javax.ws.rs-api-2.1.1.jar:/opt/kafka/bin/../libs/jaxb-api-2.3.0.jar:/opt/kafka/bin/../libs/jersey-client-2.31.jar:/opt/kafka/bin/../libs/jersey-common-2.31.jar:/opt/kafka/bin/../libs/jersey-container-servlet-2.31.jar:/opt/kafka/bin/../libs/jersey-container-servlet-core-2.31.jar:/opt/kafka/bin/../libs/jersey-hk2-2.31.jar:/opt/kafka/bin/../libs/jersey-media-jaxb-2.31.jar:/opt/kafka/bin/../libs/jersey-server-2.31.jar:/opt/kafka/bin/../libs/jetty-client-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jetty-continuation-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jetty-http-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jetty-io-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jetty-security-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jetty-server-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jetty-servlet-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jetty-servlets-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jetty-util-9.4.33.v20201020.jar:/opt/kafka/bin/../libs/jopt-simple-5.0.4.jar:/opt/kafka/bin/../libs/kafka-clients-2.7.0.jar:/opt/kafka/bin/../libs/kafka-log4j-appender-2.7.0.jar:/opt/kafka/bin/../libs/kafka-raft-2.7.0.jar:/opt/kafka/bin/../libs/kafka-streams-2.7.0.jar:/opt/kafka/bin/../libs/kafka-streams-examples-2.7.0.jar:/opt/kafka/bin/../libs/kafka-streams-scala_2.13-2.7.0.jar:/opt/kafka/bin/../libs/kafka-streams-test-utils-2.7.0.jar:/opt/kafka/bin/../libs/kafka-tools-2.7.0.jar:/opt/kafka/bin/../libs/kafka_2.13-2.7.0-sources.jar:/opt/kafka/bin/../libs/kafka_2.13-2.7.0.jar:/opt/kafka/bin/../libs/log4j-1.2.17.jar:/opt/kafka/bin/../libs/lz4-java-1.7.1.jar:/opt/kafka/bin/../libs/maven-artifact-3.6.3.jar:/opt/kafka/bin/../libs/metrics-core-2.2.0.jar:/opt/kafka/bin/../libs/netty-buffer-4.1.51.Final.jar:/opt/kafka/bin/../libs/netty-codec-4.1.51.Final.jar:/opt/kafka/bin/../libs/netty-common-4.1.51.Final.jar:/opt/kafka/bin/../libs/netty-handler-4.1.51.Final.jar:/opt/kafka/bin/../libs/netty-resolver-4.1.51.Final.jar:/opt/kafka/bin/../libs/netty-transport-4.1.51.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-epoll-4.1.51.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-unix-common-4.1.51.Final.jar:/opt/kafka/bin/../libs/osgi-resource-locator-1.0.3.jar:/opt/kafka/bin/../libs/paranamer-2.8.jar:/opt/kafka/bin/../libs/plexus-utils-3.2.1.jar:/opt/kafka/bin/../libs/reflections-0.9.12.jar:/opt/kafka/bin/../libs/rocksdbjni-5.18.4.jar:/opt/kafka/bin/../libs/scala-collection-compat_2.13-2.2.0.jar:/opt/kafka/bin/../libs/scala-java8-compat_2.13-0.9.1.jar:/opt/kafka/bin/../libs/scala-library-2.13.3.jar:/opt/kafka/bin/../libs/scala-logging_2.13-3.9.2.jar:/opt/kafka/bin/../libs/scala-reflect-2.13.3.jar:/opt/kafka/bin/../libs/slf4j-api-1.7.30.jar:/opt/kafka/bin/../libs/slf4j-log4j12-1.7.30.jar:/opt/kafka/bin/../libs/snappy-java-1.1.7.7.jar:/opt/kafka/bin/../libs/zookeeper-3.5.8.jar:/opt/kafka/bin/../libs/zookeeper-jute-3.5.8.jar:/opt/kafka/bin/../libs/zstd-jni-1.4.5-6.jar (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,479] INFO Client environment:java.library.path=/usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server:/usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64:/usr/lib/jvm/java-1.8-openjdk/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,479] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,479] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:os.version=4.19.121-linuxkit (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:user.dir=/ (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:os.memory.free=974MB (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:os.memory.max=1024MB (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,480] INFO Client environment:os.memory.total=1024MB (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,487] INFO Initiating client connection, connectString=zoo1:2181 sessionTimeout=18000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@333291e3 (org.apache.zookeeper.ZooKeeper)
kafka01_1  | [2021-01-13 09:55:44,496] INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket)
kafka01_1  | [2021-01-13 09:55:44,508] INFO zookeeper.request.timeout value is 0. feature enabled= (org.apache.zookeeper.ClientCnxn)
kafka01_1  | [2021-01-13 09:55:44,551] INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient)
kafka01_1  | [2021-01-13 09:55:44,557] INFO Opening socket connection to server zoo1/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
kafka01_1  | [2021-01-13 09:55:44,566] INFO Socket connection established, initiating session, client: /172.18.0.3:43952, server: zoo1/172.18.0.2:2181 (org.apache.zookeeper.ClientCnxn)
zoo1_1     | 2021-01-13 09:55:45,052 [myid:1] - INFO  [SyncThread:0:FileTxnLog@284] - Creating new log file: log.1
kafka01_1  | [2021-01-13 09:55:45,190] INFO Session establishment complete on server zoo1/172.18.0.2:2181, sessionid = 0x100007b5a540000, negotiated timeout = 18000 (org.apache.zookeeper.ClientCnxn)
kafka01_1  | [2021-01-13 09:55:45,193] INFO [ZooKeeperClient Kafka server] Connected. (kafka.zookeeper.ZooKeeperClient)
kafka01_1  | [2021-01-13 09:55:45,401] INFO [feature-zk-node-event-process-thread]: Starting (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread)
kafka01_1  | [2021-01-13 09:55:45,427] INFO Feature ZK node at path: /feature does not exist (kafka.server.FinalizedFeatureChangeListener)
kafka01_1  | [2021-01-13 09:55:45,428] INFO Cleared cache (kafka.server.FinalizedFeatureCache)
kafka01_1  | [2021-01-13 09:55:45,650] INFO Cluster ID = CnK6so4xSr-xbQlG_9gCNQ (kafka.server.KafkaServer)
kafka01_1  | [2021-01-13 09:55:45,653] WARN No meta.properties file under dir /kafka/kafka-logs-c4cfd066c4a0/meta.properties (kafka.server.BrokerMetadataCheckpoint)
kafka01_1  | [2021-01-13 09:55:45,717] INFO KafkaConfig values: 
kafka01_1  |    advertised.host.name = null
kafka01_1  |    advertised.listeners = PLAINTEXT://:9092
kafka01_1  |    advertised.port = null
kafka01_1  |    alter.config.policy.class.name = null
kafka01_1  |    alter.log.dirs.replication.quota.window.num = 11
kafka01_1  |    alter.log.dirs.replication.quota.window.size.seconds = 1
kafka01_1  |    authorizer.class.name = 
kafka01_1  |    auto.create.topics.enable = true
kafka01_1  |    auto.leader.rebalance.enable = true
kafka01_1  |    background.threads = 10
kafka01_1  |    broker.id = -1
kafka01_1  |    broker.id.generation.enable = true
kafka01_1  |    broker.rack = null
kafka01_1  |    client.quota.callback.class = null
kafka01_1  |    compression.type = producer
kafka01_1  |    connection.failed.authentication.delay.ms = 100
kafka01_1  |    connections.max.idle.ms = 600000
kafka01_1  |    connections.max.reauth.ms = 0
kafka01_1  |    control.plane.listener.name = null
kafka01_1  |    controlled.shutdown.enable = true
kafka01_1  |    controlled.shutdown.max.retries = 3
kafka01_1  |    controlled.shutdown.retry.backoff.ms = 5000
kafka01_1  |    controller.quota.window.num = 11
kafka01_1  |    controller.quota.window.size.seconds = 1
kafka01_1  |    controller.socket.timeout.ms = 30000
kafka01_1  |    create.topic.policy.class.name = null
kafka01_1  |    default.replication.factor = 1
kafka01_1  |    delegation.token.expiry.check.interval.ms = 3600000
kafka01_1  |    delegation.token.expiry.time.ms = 86400000
kafka01_1  |    delegation.token.master.key = null
kafka01_1  |    delegation.token.max.lifetime.ms = 604800000
kafka01_1  |    delete.records.purgatory.purge.interval.requests = 1
kafka01_1  |    delete.topic.enable = true
kafka01_1  |    fetch.max.bytes = 57671680
kafka01_1  |    fetch.purgatory.purge.interval.requests = 1000
kafka01_1  |    group.initial.rebalance.delay.ms = 0
kafka01_1  |    group.max.session.timeout.ms = 1800000
kafka01_1  |    group.max.size = 2147483647
kafka01_1  |    group.min.session.timeout.ms = 6000
kafka01_1  |    host.name = 
kafka01_1  |    inter.broker.listener.name = null
kafka01_1  |    inter.broker.protocol.version = 2.7-IV2
kafka01_1  |    kafka.metrics.polling.interval.secs = 10
kafka01_1  |    kafka.metrics.reporters = []
kafka01_1  |    leader.imbalance.check.interval.seconds = 300
kafka01_1  |    leader.imbalance.per.broker.percentage = 10
kafka01_1  |    listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL
kafka01_1  |    listeners = PLAINTEXT://:9092
kafka01_1  |    log.cleaner.backoff.ms = 15000
kafka01_1  |    log.cleaner.dedupe.buffer.size = 134217728
kafka01_1  |    log.cleaner.delete.retention.ms = 86400000
kafka01_1  |    log.cleaner.enable = true
kafka01_1  |    log.cleaner.io.buffer.load.factor = 0.9
kafka01_1  |    log.cleaner.io.buffer.size = 524288
kafka01_1  |    log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
kafka01_1  |    log.cleaner.max.compaction.lag.ms = 9223372036854775807
kafka01_1  |    log.cleaner.min.cleanable.ratio = 0.5
kafka01_1  |    log.cleaner.min.compaction.lag.ms = 0
kafka01_1  |    log.cleaner.threads = 1
kafka01_1  |    log.cleanup.policy = [delete]
kafka01_1  |    log.dir = /tmp/kafka-logs
kafka01_1  |    log.dirs = /kafka/kafka-logs-c4cfd066c4a0
kafka01_1  |    log.flush.interval.messages = 9223372036854775807
kafka01_1  |    log.flush.interval.ms = null
kafka01_1  |    log.flush.offset.checkpoint.interval.ms = 60000
kafka01_1  |    log.flush.scheduler.interval.ms = 9223372036854775807
kafka01_1  |    log.flush.start.offset.checkpoint.interval.ms = 60000
kafka01_1  |    log.index.interval.bytes = 4096
kafka01_1  |    log.index.size.max.bytes = 10485760
kafka01_1  |    log.message.downconversion.enable = true
kafka01_1  |    log.message.format.version = 2.7-IV2
kafka01_1  |    log.message.timestamp.difference.max.ms = 9223372036854775807
kafka01_1  |    log.message.timestamp.type = CreateTime
kafka01_1  |    log.preallocate = false
kafka01_1  |    log.retention.bytes = -1
kafka01_1  |    log.retention.check.interval.ms = 300000
kafka01_1  |    log.retention.hours = 168
kafka01_1  |    log.retention.minutes = null
kafka01_1  |    log.retention.ms = null
kafka01_1  |    log.roll.hours = 168
kafka01_1  |    log.roll.jitter.hours = 0
kafka01_1  |    log.roll.jitter.ms = null
kafka01_1  |    log.roll.ms = null
kafka01_1  |    log.segment.bytes = 1073741824
kafka01_1  |    log.segment.delete.delay.ms = 60000
kafka01_1  |    max.connection.creation.rate = 2147483647
kafka01_1  |    max.connections = 2147483647
kafka01_1  |    max.connections.per.ip = 2147483647
kafka01_1  |    max.connections.per.ip.overrides = 
kafka01_1  |    max.incremental.fetch.session.cache.slots = 1000
kafka01_1  |    message.max.bytes = 1048588
kafka01_1  |    metric.reporters = []
kafka01_1  |    metrics.num.samples = 2
kafka01_1  |    metrics.recording.level = INFO
kafka01_1  |    metrics.sample.window.ms = 30000
kafka01_1  |    min.insync.replicas = 1
kafka01_1  |    num.io.threads = 8
kafka01_1  |    num.network.threads = 3
kafka01_1  |    num.partitions = 1
kafka01_1  |    num.recovery.threads.per.data.dir = 1
kafka01_1  |    num.replica.alter.log.dirs.threads = null
kafka01_1  |    num.replica.fetchers = 1
kafka01_1  |    offset.metadata.max.bytes = 4096
kafka01_1  |    offsets.commit.required.acks = -1
kafka01_1  |    offsets.commit.timeout.ms = 5000
kafka01_1  |    offsets.load.buffer.size = 5242880
kafka01_1  |    offsets.retention.check.interval.ms = 600000
kafka01_1  |    offsets.retention.minutes = 10080
kafka01_1  |    offsets.topic.compression.codec = 0
kafka01_1  |    offsets.topic.num.partitions = 50
kafka01_1  |    offsets.topic.replication.factor = 1
kafka01_1  |    offsets.topic.segment.bytes = 104857600
kafka01_1  |    password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding
kafka01_1  |    password.encoder.iterations = 4096
kafka01_1  |    password.encoder.key.length = 128
kafka01_1  |    password.encoder.keyfactory.algorithm = null
kafka01_1  |    password.encoder.old.secret = null
kafka01_1  |    password.encoder.secret = null
kafka01_1  |    port = 9092
kafka01_1  |    principal.builder.class = null
kafka01_1  |    producer.purgatory.purge.interval.requests = 1000
kafka01_1  |    queued.max.request.bytes = -1
kafka01_1  |    queued.max.requests = 500
kafka01_1  |    quota.consumer.default = 9223372036854775807
kafka01_1  |    quota.producer.default = 9223372036854775807
kafka01_1  |    quota.window.num = 11
kafka01_1  |    quota.window.size.seconds = 1
kafka01_1  |    replica.fetch.backoff.ms = 1000
kafka01_1  |    replica.fetch.max.bytes = 1048576
kafka01_1  |    replica.fetch.min.bytes = 1
kafka01_1  |    replica.fetch.response.max.bytes = 10485760
kafka01_1  |    replica.fetch.wait.max.ms = 500
kafka01_1  |    replica.high.watermark.checkpoint.interval.ms = 5000
kafka01_1  |    replica.lag.time.max.ms = 30000
kafka01_1  |    replica.selector.class = null
kafka01_1  |    replica.socket.receive.buffer.bytes = 65536
kafka01_1  |    replica.socket.timeout.ms = 30000
kafka01_1  |    replication.quota.window.num = 11
kafka01_1  |    replication.quota.window.size.seconds = 1
kafka01_1  |    request.timeout.ms = 30000
kafka01_1  |    reserved.broker.max.id = 1000
kafka01_1  |    sasl.client.callback.handler.class = null
kafka01_1  |    sasl.enabled.mechanisms = [GSSAPI]
kafka01_1  |    sasl.jaas.config = null
kafka01_1  |    sasl.kerberos.kinit.cmd = /usr/bin/kinit
kafka01_1  |    sasl.kerberos.min.time.before.relogin = 60000
kafka01_1  |    sasl.kerberos.principal.to.local.rules = [DEFAULT]
kafka01_1  |    sasl.kerberos.service.name = null
kafka01_1  |    sasl.kerberos.ticket.renew.jitter = 0.05
kafka01_1  |    sasl.kerberos.ticket.renew.window.factor = 0.8
kafka01_1  |    sasl.login.callback.handler.class = null
kafka01_1  |    sasl.login.class = null
kafka01_1  |    sasl.login.refresh.buffer.seconds = 300
kafka01_1  |    sasl.login.refresh.min.period.seconds = 60
kafka01_1  |    sasl.login.refresh.window.factor = 0.8
kafka01_1  |    sasl.login.refresh.window.jitter = 0.05
kafka01_1  |    sasl.mechanism.inter.broker.protocol = GSSAPI
kafka01_1  |    sasl.server.callback.handler.class = null
kafka01_1  |    security.inter.broker.protocol = PLAINTEXT
kafka01_1  |    security.providers = null
kafka01_1  |    socket.connection.setup.timeout.max.ms = 127000
kafka01_1  |    socket.connection.setup.timeout.ms = 10000
kafka01_1  |    socket.receive.buffer.bytes = 102400
kafka01_1  |    socket.request.max.bytes = 104857600
kafka01_1  |    socket.send.buffer.bytes = 102400
kafka01_1  |    ssl.cipher.suites = []
kafka01_1  |    ssl.client.auth = none
kafka01_1  |    ssl.enabled.protocols = [TLSv1.2]
kafka01_1  |    ssl.endpoint.identification.algorithm = https
kafka01_1  |    ssl.engine.factory.class = null
kafka01_1  |    ssl.key.password = null
kafka01_1  |    ssl.keymanager.algorithm = SunX509
kafka01_1  |    ssl.keystore.certificate.chain = null
kafka01_1  |    ssl.keystore.key = null
kafka01_1  |    ssl.keystore.location = null
kafka01_1  |    ssl.keystore.password = null
kafka01_1  |    ssl.keystore.type = JKS
kafka01_1  |    ssl.principal.mapping.rules = DEFAULT
kafka01_1  |    ssl.protocol = TLSv1.2
kafka01_1  |    ssl.provider = null
kafka01_1  |    ssl.secure.random.implementation = null
kafka01_1  |    ssl.trustmanager.algorithm = PKIX
kafka01_1  |    ssl.truststore.certificates = null
kafka01_1  |    ssl.truststore.location = null
kafka01_1  |    ssl.truststore.password = null
kafka01_1  |    ssl.truststore.type = JKS
kafka01_1  |    transaction.abort.timed.out.transaction.cleanup.interval.ms = 10000
kafka01_1  |    transaction.max.timeout.ms = 900000
kafka01_1  |    transaction.remove.expired.transaction.cleanup.interval.ms = 3600000
kafka01_1  |    transaction.state.log.load.buffer.size = 5242880
kafka01_1  |    transaction.state.log.min.isr = 1
kafka01_1  |    transaction.state.log.num.partitions = 50
kafka01_1  |    transaction.state.log.replication.factor = 1
kafka01_1  |    transaction.state.log.segment.bytes = 104857600
kafka01_1  |    transactional.id.expiration.ms = 604800000
kafka01_1  |    unclean.leader.election.enable = false
kafka01_1  |    zookeeper.clientCnxnSocket = null
kafka01_1  |    zookeeper.connect = zoo1:2181
kafka01_1  |    zookeeper.connection.timeout.ms = 18000
kafka01_1  |    zookeeper.max.in.flight.requests = 10
kafka01_1  |    zookeeper.session.timeout.ms = 18000
kafka01_1  |    zookeeper.set.acl = false
kafka01_1  |    zookeeper.ssl.cipher.suites = null
kafka01_1  |    zookeeper.ssl.client.enable = false
kafka01_1  |    zookeeper.ssl.crl.enable = false
kafka01_1  |    zookeeper.ssl.enabled.protocols = null
kafka01_1  |    zookeeper.ssl.endpoint.identification.algorithm = HTTPS
kafka01_1  |    zookeeper.ssl.keystore.location = null
kafka01_1  |    zookeeper.ssl.keystore.password = null
kafka01_1  |    zookeeper.ssl.keystore.type = null
kafka01_1  |    zookeeper.ssl.ocsp.enable = false
kafka01_1  |    zookeeper.ssl.protocol = TLSv1.2
kafka01_1  |    zookeeper.ssl.truststore.location = null
kafka01_1  |    zookeeper.ssl.truststore.password = null
kafka01_1  |    zookeeper.ssl.truststore.type = null
kafka01_1  |    zookeeper.sync.time.ms = 2000
kafka01_1  |  (kafka.server.KafkaConfig)
kafka01_1  | [2021-01-13 09:55:45,726] INFO KafkaConfig values: 
kafka01_1  |    advertised.host.name = null
kafka01_1  |    advertised.listeners = PLAINTEXT://:9092
kafka01_1  |    advertised.port = null
kafka01_1  |    alter.config.policy.class.name = null
kafka01_1  |    alter.log.dirs.replication.quota.window.num = 11
kafka01_1  |    alter.log.dirs.replication.quota.window.size.seconds = 1
kafka01_1  |    authorizer.class.name = 
kafka01_1  |    auto.create.topics.enable = true
kafka01_1  |    auto.leader.rebalance.enable = true
kafka01_1  |    background.threads = 10
kafka01_1  |    broker.id = -1
kafka01_1  |    broker.id.generation.enable = true
kafka01_1  |    broker.rack = null
kafka01_1  |    client.quota.callback.class = null
kafka01_1  |    compression.type = producer
kafka01_1  |    connection.failed.authentication.delay.ms = 100
kafka01_1  |    connections.max.idle.ms = 600000
kafka01_1  |    connections.max.reauth.ms = 0
kafka01_1  |    control.plane.listener.name = null
kafka01_1  |    controlled.shutdown.enable = true
kafka01_1  |    controlled.shutdown.max.retries = 3
kafka01_1  |    controlled.shutdown.retry.backoff.ms = 5000
kafka01_1  |    controller.quota.window.num = 11
kafka01_1  |    controller.quota.window.size.seconds = 1
kafka01_1  |    controller.socket.timeout.ms = 30000
kafka01_1  |    create.topic.policy.class.name = null
kafka01_1  |    default.replication.factor = 1
kafka01_1  |    delegation.token.expiry.check.interval.ms = 3600000
kafka01_1  |    delegation.token.expiry.time.ms = 86400000
kafka01_1  |    delegation.token.master.key = null
kafka01_1  |    delegation.token.max.lifetime.ms = 604800000
kafka01_1  |    delete.records.purgatory.purge.interval.requests = 1
kafka01_1  |    delete.topic.enable = true
kafka01_1  |    fetch.max.bytes = 57671680
kafka01_1  |    fetch.purgatory.purge.interval.requests = 1000
kafka01_1  |    group.initial.rebalance.delay.ms = 0
kafka01_1  |    group.max.session.timeout.ms = 1800000
kafka01_1  |    group.max.size = 2147483647
kafka01_1  |    group.min.session.timeout.ms = 6000
kafka01_1  |    host.name = 
kafka01_1  |    inter.broker.listener.name = null
kafka01_1  |    inter.broker.protocol.version = 2.7-IV2
kafka01_1  |    kafka.metrics.polling.interval.secs = 10
kafka01_1  |    kafka.metrics.reporters = []
kafka01_1  |    leader.imbalance.check.interval.seconds = 300
kafka01_1  |    leader.imbalance.per.broker.percentage = 10
kafka01_1  |    listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL
kafka01_1  |    listeners = PLAINTEXT://:9092
kafka01_1  |    log.cleaner.backoff.ms = 15000
kafka01_1  |    log.cleaner.dedupe.buffer.size = 134217728
kafka01_1  |    log.cleaner.delete.retention.ms = 86400000
kafka01_1  |    log.cleaner.enable = true
kafka01_1  |    log.cleaner.io.buffer.load.factor = 0.9
kafka01_1  |    log.cleaner.io.buffer.size = 524288
kafka01_1  |    log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
kafka01_1  |    log.cleaner.max.compaction.lag.ms = 9223372036854775807
kafka01_1  |    log.cleaner.min.cleanable.ratio = 0.5
kafka01_1  |    log.cleaner.min.compaction.lag.ms = 0
kafka01_1  |    log.cleaner.threads = 1
kafka01_1  |    log.cleanup.policy = [delete]
kafka01_1  |    log.dir = /tmp/kafka-logs
kafka01_1  |    log.dirs = /kafka/kafka-logs-c4cfd066c4a0
kafka01_1  |    log.flush.interval.messages = 9223372036854775807
kafka01_1  |    log.flush.interval.ms = null
kafka01_1  |    log.flush.offset.checkpoint.interval.ms = 60000
kafka01_1  |    log.flush.scheduler.interval.ms = 9223372036854775807
kafka01_1  |    log.flush.start.offset.checkpoint.interval.ms = 60000
kafka01_1  |    log.index.interval.bytes = 4096
kafka01_1  |    log.index.size.max.bytes = 10485760
kafka01_1  |    log.message.downconversion.enable = true
kafka01_1  |    log.message.format.version = 2.7-IV2
kafka01_1  |    log.message.timestamp.difference.max.ms = 9223372036854775807
kafka01_1  |    log.message.timestamp.type = CreateTime
kafka01_1  |    log.preallocate = false
kafka01_1  |    log.retention.bytes = -1
kafka01_1  |    log.retention.check.interval.ms = 300000
kafka01_1  |    log.retention.hours = 168
kafka01_1  |    log.retention.minutes = null
kafka01_1  |    log.retention.ms = null
kafka01_1  |    log.roll.hours = 168
kafka01_1  |    log.roll.jitter.hours = 0
kafka01_1  |    log.roll.jitter.ms = null
kafka01_1  |    log.roll.ms = null
kafka01_1  |    log.segment.bytes = 1073741824
kafka01_1  |    log.segment.delete.delay.ms = 60000
kafka01_1  |    max.connection.creation.rate = 2147483647
kafka01_1  |    max.connections = 2147483647
kafka01_1  |    max.connections.per.ip = 2147483647
kafka01_1  |    max.connections.per.ip.overrides = 
kafka01_1  |    max.incremental.fetch.session.cache.slots = 1000
kafka01_1  |    message.max.bytes = 1048588
kafka01_1  |    metric.reporters = []
kafka01_1  |    metrics.num.samples = 2
kafka01_1  |    metrics.recording.level = INFO
kafka01_1  |    metrics.sample.window.ms = 30000
kafka01_1  |    min.insync.replicas = 1
kafka01_1  |    num.io.threads = 8
kafka01_1  |    num.network.threads = 3
kafka01_1  |    num.partitions = 1
kafka01_1  |    num.recovery.threads.per.data.dir = 1
kafka01_1  |    num.replica.alter.log.dirs.threads = null
kafka01_1  |    num.replica.fetchers = 1
kafka01_1  |    offset.metadata.max.bytes = 4096
kafka01_1  |    offsets.commit.required.acks = -1
kafka01_1  |    offsets.commit.timeout.ms = 5000
kafka01_1  |    offsets.load.buffer.size = 5242880
kafka01_1  |    offsets.retention.check.interval.ms = 600000
kafka01_1  |    offsets.retention.minutes = 10080
kafka01_1  |    offsets.topic.compression.codec = 0
kafka01_1  |    offsets.topic.num.partitions = 50
kafka01_1  |    offsets.topic.replication.factor = 1
kafka01_1  |    offsets.topic.segment.bytes = 104857600
kafka01_1  |    password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding
kafka01_1  |    password.encoder.iterations = 4096
kafka01_1  |    password.encoder.key.length = 128
kafka01_1  |    password.encoder.keyfactory.algorithm = null
kafka01_1  |    password.encoder.old.secret = null
kafka01_1  |    password.encoder.secret = null
kafka01_1  |    port = 9092
kafka01_1  |    principal.builder.class = null
kafka01_1  |    producer.purgatory.purge.interval.requests = 1000
kafka01_1  |    queued.max.request.bytes = -1
kafka01_1  |    queued.max.requests = 500
kafka01_1  |    quota.consumer.default = 9223372036854775807
kafka01_1  |    quota.producer.default = 9223372036854775807
kafka01_1  |    quota.window.num = 11
kafka01_1  |    quota.window.size.seconds = 1
kafka01_1  |    replica.fetch.backoff.ms = 1000
kafka01_1  |    replica.fetch.max.bytes = 1048576
kafka01_1  |    replica.fetch.min.bytes = 1
kafka01_1  |    replica.fetch.response.max.bytes = 10485760
kafka01_1  |    replica.fetch.wait.max.ms = 500
kafka01_1  |    replica.high.watermark.checkpoint.interval.ms = 5000
kafka01_1  |    replica.lag.time.max.ms = 30000
kafka01_1  |    replica.selector.class = null
kafka01_1  |    replica.socket.receive.buffer.bytes = 65536
kafka01_1  |    replica.socket.timeout.ms = 30000
kafka01_1  |    replication.quota.window.num = 11
kafka01_1  |    replication.quota.window.size.seconds = 1
kafka01_1  |    request.timeout.ms = 30000
kafka01_1  |    reserved.broker.max.id = 1000
kafka01_1  |    sasl.client.callback.handler.class = null
kafka01_1  |    sasl.enabled.mechanisms = [GSSAPI]
kafka01_1  |    sasl.jaas.config = null
kafka01_1  |    sasl.kerberos.kinit.cmd = /usr/bin/kinit
kafka01_1  |    sasl.kerberos.min.time.before.relogin = 60000
kafka01_1  |    sasl.kerberos.principal.to.local.rules = [DEFAULT]
kafka01_1  |    sasl.kerberos.service.name = null
kafka01_1  |    sasl.kerberos.ticket.renew.jitter = 0.05
kafka01_1  |    sasl.kerberos.ticket.renew.window.factor = 0.8
kafka01_1  |    sasl.login.callback.handler.class = null
kafka01_1  |    sasl.login.class = null
kafka01_1  |    sasl.login.refresh.buffer.seconds = 300
kafka01_1  |    sasl.login.refresh.min.period.seconds = 60
kafka01_1  |    sasl.login.refresh.window.factor = 0.8
kafka01_1  |    sasl.login.refresh.window.jitter = 0.05
kafka01_1  |    sasl.mechanism.inter.broker.protocol = GSSAPI
kafka01_1  |    sasl.server.callback.handler.class = null
kafka01_1  |    security.inter.broker.protocol = PLAINTEXT
kafka01_1  |    security.providers = null
kafka01_1  |    socket.connection.setup.timeout.max.ms = 127000
kafka01_1  |    socket.connection.setup.timeout.ms = 10000
kafka01_1  |    socket.receive.buffer.bytes = 102400
kafka01_1  |    socket.request.max.bytes = 104857600
kafka01_1  |    socket.send.buffer.bytes = 102400
kafka01_1  |    ssl.cipher.suites = []
kafka01_1  |    ssl.client.auth = none
kafka01_1  |    ssl.enabled.protocols = [TLSv1.2]
kafka01_1  |    ssl.endpoint.identification.algorithm = https
kafka01_1  |    ssl.engine.factory.class = null
kafka01_1  |    ssl.key.password = null
kafka01_1  |    ssl.keymanager.algorithm = SunX509
kafka01_1  |    ssl.keystore.certificate.chain = null
kafka01_1  |    ssl.keystore.key = null
kafka01_1  |    ssl.keystore.location = null
kafka01_1  |    ssl.keystore.password = null
kafka01_1  |    ssl.keystore.type = JKS
kafka01_1  |    ssl.principal.mapping.rules = DEFAULT
kafka01_1  |    ssl.protocol = TLSv1.2
kafka01_1  |    ssl.provider = null
kafka01_1  |    ssl.secure.random.implementation = null
kafka01_1  |    ssl.trustmanager.algorithm = PKIX
kafka01_1  |    ssl.truststore.certificates = null
kafka01_1  |    ssl.truststore.location = null
kafka01_1  |    ssl.truststore.password = null
kafka01_1  |    ssl.truststore.type = JKS
kafka01_1  |    transaction.abort.timed.out.transaction.cleanup.interval.ms = 10000
kafka01_1  |    transaction.max.timeout.ms = 900000
kafka01_1  |    transaction.remove.expired.transaction.cleanup.interval.ms = 3600000
kafka01_1  |    transaction.state.log.load.buffer.size = 5242880
kafka01_1  |    transaction.state.log.min.isr = 1
kafka01_1  |    transaction.state.log.num.partitions = 50
kafka01_1  |    transaction.state.log.replication.factor = 1
kafka01_1  |    transaction.state.log.segment.bytes = 104857600
kafka01_1  |    transactional.id.expiration.ms = 604800000
kafka01_1  |    unclean.leader.election.enable = false
kafka01_1  |    zookeeper.clientCnxnSocket = null
kafka01_1  |    zookeeper.connect = zoo1:2181
kafka01_1  |    zookeeper.connection.timeout.ms = 18000
kafka01_1  |    zookeeper.max.in.flight.requests = 10
kafka01_1  |    zookeeper.session.timeout.ms = 18000
kafka01_1  |    zookeeper.set.acl = false
kafka01_1  |    zookeeper.ssl.cipher.suites = null
kafka01_1  |    zookeeper.ssl.client.enable = false
kafka01_1  |    zookeeper.ssl.crl.enable = false
kafka01_1  |    zookeeper.ssl.enabled.protocols = null
kafka01_1  |    zookeeper.ssl.endpoint.identification.algorithm = HTTPS
kafka01_1  |    zookeeper.ssl.keystore.location = null
kafka01_1  |    zookeeper.ssl.keystore.password = null
kafka01_1  |    zookeeper.ssl.keystore.type = null
kafka01_1  |    zookeeper.ssl.ocsp.enable = false
kafka01_1  |    zookeeper.ssl.protocol = TLSv1.2
kafka01_1  |    zookeeper.ssl.truststore.location = null
kafka01_1  |    zookeeper.ssl.truststore.password = null
kafka01_1  |    zookeeper.ssl.truststore.type = null
kafka01_1  |    zookeeper.sync.time.ms = 2000
kafka01_1  |  (kafka.server.KafkaConfig)
kafka01_1  | [2021-01-13 09:55:45,765] INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
kafka01_1  | [2021-01-13 09:55:45,766] INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
kafka01_1  | [2021-01-13 09:55:45,767] INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
kafka01_1  | [2021-01-13 09:55:45,775] INFO [ThrottledChannelReaper-ControllerMutation]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
kafka01_1  | [2021-01-13 09:55:45,796] INFO Log directory /kafka/kafka-logs-c4cfd066c4a0 not found, creating it. (kafka.log.LogManager)
kafka01_1  | [2021-01-13 09:55:45,805] INFO Loading logs from log dirs ArraySeq(/kafka/kafka-logs-c4cfd066c4a0) (kafka.log.LogManager)
kafka01_1  | [2021-01-13 09:55:45,807] INFO Attempting recovery for all logs in /kafka/kafka-logs-c4cfd066c4a0 since no clean shutdown file was found (kafka.log.LogManager)
kafka01_1  | [2021-01-13 09:55:45,812] INFO Loaded 0 logs in 7ms. (kafka.log.LogManager)
kafka01_1  | [2021-01-13 09:55:45,827] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager)
kafka01_1  | [2021-01-13 09:55:45,830] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager)
kafka01_1  | [2021-01-13 09:55:46,694] INFO Created ConnectionAcceptRate sensor, quotaLimit=2147483647 (kafka.network.ConnectionQuotas)
kafka01_1  | [2021-01-13 09:55:46,698] INFO Created ConnectionAcceptRate-PLAINTEXT sensor, quotaLimit=2147483647 (kafka.network.ConnectionQuotas)
kafka01_1  | [2021-01-13 09:55:46,701] INFO Updated PLAINTEXT max connection creation rate to 2147483647 (kafka.network.ConnectionQuotas)
kafka01_1  | [2021-01-13 09:55:46,706] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor)
kafka01_1  | [2021-01-13 09:55:46,746] INFO [SocketServer brokerId=1001] Created data-plane acceptor and processors for endpoint : ListenerName(PLAINTEXT) (kafka.network.SocketServer)
kafka01_1  | [2021-01-13 09:55:46,779] INFO [ExpirationReaper-1001-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
kafka01_1  | [2021-01-13 09:55:46,780] INFO [ExpirationReaper-1001-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
kafka01_1  | [2021-01-13 09:55:46,780] INFO [ExpirationReaper-1001-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
kafka01_1  | [2021-01-13 09:55:46,783] INFO [ExpirationReaper-1001-ElectLeader]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
kafka01_1  | [2021-01-13 09:55:46,797] INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler)
kafka01_1  | [2021-01-13 09:55:46,798] INFO [broker-1001-to-controller-send-thread]: Starting (kafka.server.BrokerToControllerRequestThread)
kafka01_1  | [2021-01-13 09:55:46,828] INFO Creating /brokers/ids/1001 (is it secure? false) (kafka.zk.KafkaZkClient)
kafka01_1  | [2021-01-13 09:55:46,851] INFO Stat of the created znode at /brokers/ids/1001 is: 25,25,1610531746844,1610531746844,1,0,0,72058123834359808,208,0,25
kafka01_1  |  (kafka.zk.KafkaZkClient)
kafka01_1  | [2021-01-13 09:55:46,852] INFO Registered broker 1001 at path /brokers/ids/1001 with addresses: PLAINTEXT://c4cfd066c4a0:9092, czxid (broker epoch): 25 (kafka.zk.KafkaZkClient)
kafka01_1  | [2021-01-13 09:55:46,926] INFO [ExpirationReaper-1001-topic]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
kafka01_1  | [2021-01-13 09:55:46,932] INFO [ExpirationReaper-1001-Heartbeat]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
kafka01_1  | [2021-01-13 09:55:46,933] INFO [ExpirationReaper-1001-Rebalance]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
kafka01_1  | [2021-01-13 09:55:46,936] INFO Successfully created /controller_epoch with initial epoch 0 (kafka.zk.KafkaZkClient)
kafka01_1  | [2021-01-13 09:55:46,962] INFO [GroupCoordinator 1001]: Starting up. (kafka.coordinator.group.GroupCoordinator)
kafka01_1  | [2021-01-13 09:55:46,963] INFO [GroupCoordinator 1001]: Startup complete. (kafka.coordinator.group.GroupCoordinator)
kafka01_1  | [2021-01-13 09:55:46,963] INFO Feature ZK node created at path: /feature (kafka.server.FinalizedFeatureChangeListener)
kafka01_1  | [2021-01-13 09:55:46,979] INFO [ProducerId Manager 1001]: Acquired new producerId block (brokerId:1001,blockStartProducerId:0,blockEndProducerId:999) by writing to Zk with path version 1 (kafka.coordinator.transaction.ProducerIdManager)
kafka01_1  | [2021-01-13 09:55:47,015] INFO [TransactionCoordinator id=1001] Starting up. (kafka.coordinator.transaction.TransactionCoordinator)
kafka01_1  | [2021-01-13 09:55:47,017] INFO [TransactionCoordinator id=1001] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator)
kafka01_1  | [2021-01-13 09:55:47,017] INFO [Transaction Marker Channel Manager 1001]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager)
kafka01_1  | [2021-01-13 09:55:47,066] INFO Updated cache from existing <empty> to latest FinalizedFeaturesAndEpoch(features=Features{}, epoch=0). (kafka.server.FinalizedFeatureCache)
kafka01_1  | [2021-01-13 09:55:47,083] INFO [ExpirationReaper-1001-AlterAcls]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
kafka01_1  | [2021-01-13 09:55:47,125] INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread)
kafka01_1  | [2021-01-13 09:55:47,137] INFO [SocketServer brokerId=1001] Starting socket server acceptors and processors (kafka.network.SocketServer)
kafka01_1  | [2021-01-13 09:55:47,146] INFO [SocketServer brokerId=1001] Started data-plane acceptor and processor(s) for endpoint : ListenerName(PLAINTEXT) (kafka.network.SocketServer)
kafka01_1  | [2021-01-13 09:55:47,147] INFO [SocketServer brokerId=1001] Started socket server acceptors and processors (kafka.network.SocketServer)
kafka01_1  | [2021-01-13 09:55:47,152] INFO Kafka version: 2.7.0 (org.apache.kafka.common.utils.AppInfoParser)
kafka01_1  | [2021-01-13 09:55:47,152] INFO Kafka commitId: 448719dc99a19793 (org.apache.kafka.common.utils.AppInfoParser)
kafka01_1  | [2021-01-13 09:55:47,152] INFO Kafka startTimeMs: 1610531747147 (org.apache.kafka.common.utils.AppInfoParser)
kafka01_1  | [2021-01-13 09:55:47,153] INFO [KafkaServer id=1001] started (kafka.server.KafkaServer)
kafka01_1  | [2021-01-13 09:55:47,309] INFO [broker-1001-to-controller-send-thread]: Recorded new controller, from now on will use broker 1001 (kafka.server.BrokerToControllerRequestThread)

我们可以看到ZooKeeper和Kafka都运行起来了。

在这里插入图片描述

总结

最基本的doocker-compose方式运行的脚本如下

version: "3"
services:
  zoo1:
      image: zookeeper
      restart: always
      hostname: zoo1
      ports:
        - 2181:2181
  kafka01:
      image: wurstmeister/kafka
      ports:
        - 9092:9092  
      environment:
        KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://:9092
        KAFKA_LISTENERS: PLAINTEXT://:9092
        KAFKA_ZOOKEEPER_CONNECT: zoo1:2181

参考资料

  • https://hub.docker.com/_/zookeeper
  • http://wurstmeister.github.io/kafka-docker/
小雨青年
关注
  • 0
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论
专栏目录
docker搭建zookeeper和kafka 集群
hfthxfhjy的博客
11-03 1267
docker-compose 部署kafka 集群，配置文件记录
macos docker搭建kafka实践
猕猴桃的博客
10-29 806
参考博文：Docker案例：MacOS搭建单节点Kafka服务_Crane的博客-CSDN博客 拉取镜像 $ docker pull zookeeper $ docker pull wurstmeister/kafka $ docker images REPOSITORY TAG IMAGE ID CREATED SIZE zookeeper latest .
kafka 的docker镜像
12-03
kafka的docker镜像包含了kafka，zookeeper 和kafkamanager，可以通过docker 来load 安装
bitnami版本的zookeeper和kafka的docker-compose配置
02-15
这个Docker Compose 文件定义了一个包含Zookeeper和三个Kafka节点的服务集群。通过指定镜像、端口映射、环境变量和依赖关系等配置，实现了Zookeeper和Kafka的快速部署和集成。同时，在定义了一个名为"mynetwork"的网络来连接这些服务，确保它们可以相互通信。整体而言，这个Docker Compose 文件提供了一个简单且可扩展的方式来搭建和管理Zookeeper和Kafka的集群环境。 对了，这个集群配置是支持外部访问的。
【解决】zookeeper启动时一直报 ： Starting zookeeper ... FAILED TO START
王一横的个人博客
06-21 1万+
环境 CentOS 8.3 64位 zookeeper-3.7.0 问题描述 在搭建zookeeper集群的的时候一直报如下错误： [root@iZwz zookeeper]# ./bin/zkServer.sh start /opt/mydata/zkdata1/zoo.cfg ZooKeeper JMX enabled by default Using config: /opt/mydata/zkdata1/zoo.cfg Starting zookeeper ... FAILED TO START
Zookeeper已经设置了myid文件但是依然报错myid file is missing
微电子学与固体电子学-俞驰
05-16 6108
完整报错: (Python3.6) appleyuchi@Desktop:logs$ cat zookeeper-appleyuchi-server-Desktop.out SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/appleyuchi/bigdata/apache-zookeeper-3.6.0-bin/lib/slf4j-log4j12-1.7.25.jar!
ZooKeeper 在 Windows 操作系统中的安装、配置与运行
brian_keepwalking的博客
08-12 876
本文介绍在 Windows 操作系统上安装 ZooKeeper 的方法与过程。 目录 版本说明 安装 配置 运行 测试 连接 ZooKeeper 服务 查看帮助 创建 znode 查看所有 znode 查看指定 znode 的值 版本说明 Windows 10 ZooKeeper 3.6.0 JDK 8 安装 因为 ZooKeeper 依赖 Java 环境运行，所以首先需要下载、安装和配置 JDK（本示例使用 JDK 8）。 下载 ZooKeeper
Docker 部署kafka遇到的问题
weixin_40750633的博客
05-13 1337
启动容器之后，状态为`Exited 如图， 查看日志 docker logs 1e1a55aa8d21 日志详细信息： [root@iZwz9geewjuo2sogidqn50Z ~]# docker logs 1e1a55aa8d21 [Configuring] 'advertised.listeners' in '/opt/kafka/config/server.properties' [Configuring] 'port' in '/opt/kafka/config/server.pro.
Docker安装Kafka（docker-compose.yml）
YunWisdom
04-16 5657
Docker安装Kafka（docker-compose.yml） 前置条件 请先安装Docker 创建docker-compose.yml文件 version: '2' services: zookeeper: image: wurstmeister/zookeeper ports: - "2181:2181" restart:...
如何使用JMX监控Kafka
朱小厮的博客
12-08 5万+
使用kafka做消息队列中间件时，为了实时监控其性能时，免不了要使用jmx调取kafka broker的内部数据，不管是自己重新做一个kafka集群的监控系统，还是使用一些开源的产品，比如yahoo的kafka manager, 其都需要使用jmx来监控一些敏感的数据。在kafka官网中 http://kafka.apache.org/082/documentation.html#monitori...
部署zookeeper+kafka
最新发布
04-25
一、二进制安装 1.安装jdk，二进制安装以及yum安装 ...3.部署kafka 二、docker安装 1.搭建zookeeper集群 2.搭建kafka集群 3.测试Zookeeper中Kafka节点信息 4.测试Kafka中创建Topic，Zookeeper中的接受情况
Docker部署Kafka以及Spring Kafka实现
01-11
这篇文章主要介绍了Docker部署Kafka以及Spring Kafka实现,文中通过示例代码介绍的非常详细，对大家的学习或者工作具有一定的参考学习价值,需要的朋友可以参考下 从https://hub.docker.com/查找kafka 第三个活跃并...
利用docker和docker-compose部署单机kafka
01-20
docker部署kafka非常简单，只需要两条命令即可完成kafka服务器的部署。 docker run -d --name zookeeper -p 2181:2181 wurstmeister/zookeeper docker run -d --name kafka -p 9092:9092 -e KAFKA_BROKER_ID=0 -e ...
报错：Connection to node -1 (localhost/127.0.0.1:9092) could not be established.
你今天真好看呀
11-26 9744
kafka启动后会在zookeeper的/brokers/ids下注册监听协议，包括IP和端口号，客户端连接的时候，会取得这个IP和端口号。原理是因为listeners和advertised.listeners的区别，advertised.listeners才是真正暴露给外部使用的连接地址，会写入到zookeeper节点中的。
对kafka中zookeeper启动过程解析
代码菜鸟旺仔
05-14 1万+
首先kafka中zookeeper启动的命令是： /usr/local/kafka/bin/zookeeper-server-start.sh /usr/local/kafka/config/zookeeper.properties & 查看zookeeper-server-start.sh里面最后一行是： exec $base_dir/kafka-run-class.sh $EXTRA
Kafka连接服务器出现:Connection to node 1 (localhost/127.0.0.1:9092) could not be established.
热门推荐
程序员不鸣的博客
12-09 27万+
文章目录1.安全组是否开放&防火墙是否拦截请求2.登陆服务器查看Kafka broker是否可用3.查看Kafka运行日志4.在网上找资料5.解决问题 今天遇到个很奇怪的问题，是关于外网连接Kafka的。 在服务器本地可以使用命令行参数连接并且进行发布订阅操作，但是在外网环境就不可以了，SpringBoot连接报错： Connection to node 1 (localhost/127....
2021-05-16
qq_37632025的博客
05-16 699
./bin/kafka-topics.sh --list [root@chengzhiqiang kafka_2.11-2.4.1]# ./bin/kafka-topics.sh --list Exception in thread "main" java.lang.IllegalArgumentException: Only one of --bootstrap-server or --zookeeper must be specified at kafka.admin.TopicCom...
kafka常用命令
qq_25073261的博客
10-22 2074
集群搭建https://www.cnblogs.com/linyouyi/p/11369015.html Only one of --bootstrap-server or --zookeeper must be specified –bootstrap-server spark01:9092 –zookeeper spark01:2181 创建topic bin/kafka-topics.sh --create --bootstrap-server spark01:9092 --replication-f
【OCR】CentOS7下编译安装tesseract-ocr
Code Metaverse
01-15 1万+
什么是tesseract-ocrOCR(Optical Character Recognition):光学字符识别,是指对图片文件中的文字进行分析识别，获取的过程。Tesseract：开源的OCR识别引擎，初期Tesseract引擎由HP实验室研发，后来贡献给了开源软件业，后经由Google进行改进，消除bug，优化，重新发布。现在托管在GitHub中~源代码位置托管于 http://code.go
docker部署zookeeper和kafka的docker-compose.yml文件内容
03-31
以下是一个简单的docker-compose.yml文件，用于在Docker上部署Zookeeper和Kafka： ```yaml version: '3' services: zookeeper: image: zookeeper:3.5 container_name: zookeeper ports: - "2181:2181" ...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

小雨青年

程序员可以把咖啡转化成代码~

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值