kafka 2.12-2.5集群搭建（三台物理机）

kafka 2.12-2.5集群搭建（三台物理机）

三台机器IP

196.170.177.48
196.170.177.49
196.170.177.50

1. 修改每个broker zookeeper配置

vi /usr/local/kafka/config/zookeeper.properties

---

# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#    http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# the directory where the snapshot is stored.
#dataDir=/tmp/zookeeper
tickTime=2000
initLimit=10
syncLimit=5
# the port at which the clients will connect
clientPort=2181
# disable the per-ip limit on the number of connections since this is a non-production config
maxClientCnxns=0
# Disable the adminserver by default to avoid port conflicts.
# Set the port to something non-conflicting if choosing to enable this
admin.enableServer=false
# admin.serverPort=8080
#dataDir
dataDir=/usr/local/zookeeper/data
#server list
server.1=196.170.177.48:2888:3888
server.2=196.170.177.49:2888:3888
server.3=196.170.177.50:2888:3888

2. 修改每个broker server.properties配置

#每台机器唯一id
broker.id=1
listeners=PLAINTEXT://10.170.177.48:9092 
zookeeper.connect=10.170.177.48:2181,10.170.177.49:2181,10.170.177.50:2181

3. 启动每台broker zookeeper服务

> bin/zookeeper-server-start.sh config/zookeeper.properties

4. 启动kafka broker服务

> bin/kafka-server-start.sh config/server.properties  

5. 创建Topic

1.创建Topic
> bin/kafka-topics.sh --create --bootstrap-server 10.170.177.48:9092 --replication-factor 2 --partitions 3 --topic my-replicated-topic
------------
2.查看topic
> bin/kafka-topics.sh --describe --bootstrap-server localhost:9092 --topic my-replicated-topic
Topic: my-replicated-topic      PartitionCount: 3       ReplicationFactor: 2    Configs: segment.bytes=1073741824
    Topic: my-replicated-topic      Partition: 0    Leader: 3       Replicas: 3,1   Isr: 3,1
    Topic: my-replicated-topic      Partition: 1    Leader: 1       Replicas: 1,2   Isr: 1,2
    Topic: my-replicated-topic      Partition: 2    Leader: 2       Replicas: 2,3   Isr: 2,3
3.生产消息
> bin/kafka-console-producer.sh --bootstrap-server 10.170.177.48:9092 --topic my-replicated-topic
4.消费消息
> bin/kafka-console-consumer.sh --bootstrap-server 10.170.177.49:9092 --from-beginning --topic my-replicated-topic