Kafka环境搭建以及服务封装

一、安装前准备

1、kafka版本：kafka_2.10-0.10.1.0.tgz
2、zookeeper版本：zookeeper-3.4.3.tar.gz
3、zookeeper集群：
192.168.1.108:2181,192.168.1.109:2181,192.168.1.110:2181

4、hosts文件中主机与ip映射关系

192.168.1.108 master
192.168.1.109 slave1
192.168.1.110 slave2

二、zookeeper环境搭建

具体的zookeeper环境搭建请参考：

http://blog.csdn.net/liuchuanhong1/article/details/53192618

三、Kafka环境搭建

1、下载tar包

下载地址如下：

https://www.apache.org/dyn/closer.cgi?path=/kafka/0.10.1.0/kafka_2.10-0.10.1.0.tgz

2、解压到/usr/kafka目录下

解压命令如下：

tar -zxvf kafka_2.10-0.10.1.0.tgz

3、解压后目录结构

 

四、修改配置文件

1、修改server.properties

修改配置文件如下：

broker.id=0
host.name=192.168.1.108
zookeeper.connect=slave1:2181,master:2181,slave2:2181

五、启动kafka服务

1、启动zookeeper集群

2、进入/bin目录下，输入如下命令，启动kafka服务

 ./kafka-server-start.sh ../config/server.properties

启动之后，可以看到如下的配置信息：

[root@192 bin]# ./kafka-server-start.sh ../config/server.properties 

[2016-11-18 10:50:51,067] INFO KafkaConfig values: 
        advertised.host.name = null
        advertised.listeners = null
        advertised.port = null
        authorizer.class.name = 
        auto.create.topics.enable = true
        auto.leader.rebalance.enable = true
        background.threads = 10
        broker.id = 0
        broker.id.generation.enable = true
        broker.rack = null
        compression.type = producer
        connections.max.idle.ms = 600000
        controlled.shutdown.enable = true
        controlled.shutdown.max.retries = 3
        controlled.shutdown.retry.backoff.ms = 5000
        controller.socket.timeout.ms = 30000
        default.replication.factor = 1
        delete.topic.enable = false
        fetch.purgatory.purge.interval.requests = 1000
        group.max.session.timeout.ms = 300000
        group.min.session.timeout.ms = 6000
        host.name = 
        inter.broker.protocol.version = 0.10.1-IV2
        leader.imbalance.check.interval.seconds = 300
        leader.imbalance.per.broker.percentage = 10
        listeners &