Kafka安装

1. zookeeper安装
2. 解压kafka

tar -zxvf kafka_2.11-0.10.0.0.tgz

3. 配置server

cd config

vi server.properties

broker.id=0

listeners=PLAINTEXT://jokeros1:9092

log.dirs=/tmp/kafka-logs-0

zookeeper.connect=jokeros1:2181,jokeros2:2181,jokeros3:2181

保存

cp server.properties server1.properties

cp server.properties server2.properties

vi server1.properties

broker.id=1

listeners=PLAINTEXT://jokeros1:9093

log.dirs=/tmp/kafka-logs-1

保存

vi server2.properties

broker.id=2

listeners=PLAINTEXT://jokeros1:9094

log.dirs=/tmp/kafka-logs-2

保存

4. 复制kafka到其他节点

scp -r kafka_2.11-0.10.0.0 root@jokeros2:/usr/tools

scp -r kafka_2.11-0.10.0.0 root@jokeros3:/usr/tools

分别编辑另外两个节点上的 serverX. Properties

修改 broker.id 和 listeners 的 hostname

每个 broker.id 不可相同，每个 hostename 为当前服务器的 hostname

5. 启动kafka服务

先启动 zookeeper

zkServer.sh start

bin/kafka-server-start.sh config/server.properties

bin/kafka-topics.sh --create --zookeeper jokeros1:2181,jokeros2:2181 --replication-factor 1 --partitions 1 --topic testfirst

bin/kafka-console-producer.sh --broker-list jokeros1:9092 --topic testfirst

bin/kafka-console-consumer.sh --zookeeper jokeros1:2181,jokeros2:2181 --topic testfirst --from-beginning

集群启动，后台运行命令

nohup bin/kafka-server-start.sh config/server.properties &

nohup bin/kafka-server-start.sh config/server1.properties &