kafka笔记NO.5 kafka 安装

1. 下载kafka
   下载地址https://www.apache.org/dyn/closer.cgi?path=/kafka/1.1.0/kafka_2.12-1.1.0.tgz

2. 解压Kafka

    > tar -xzf kafka_2.11-1.1.0.tgz
    > cd kafka_2.11-1.1.0

1. 启动Kafka

    >nohup bin/kafka-server-start.sh config/server.properties >>/dev/null &

1. 创建topic

    >bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

1. 发送数据

    >bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
    hello world
    this is a test message

1. 消费数据

    >bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning

1. 设置多个broker集群

> cp config/server.properties config/server-1.properties 
> cp config/server.properties config/server-2.properties

config/server-1.properties: 
    broker.id=1 
    listeners=PLAINTEXT://:9093 
    log.dir=/tmp/kafka-logs-1

config/server-2.properties: 
    broker.id=2 
    listeners=PLAINTEXT://:9094 
    log.dir=/tmp/kafka-logs-2

> bin/kafka-server-start.sh config/server-1.properties &
> bin/kafka-server-start.sh config/server-2.properties &

>bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 3 --partitions 1 --topic my-replicated-topic

>bin/kafka-console-producer.sh --broker-list localhost:9092 --topic my-replicated-topic

>ps | grep server-1.properties

>bin/kafka-topics.sh --describe --zookeeper localhost:2181 --topic my-replicated-topic
>bin/kafka-console-consumer.sh --zookeeper localhost:2181 --from-beginning --topic my-replicated-topic