kafka入门

1 安装  https://www.jianshu.com/p/2b209d74139c

2 详细教程 https://blog.csdn.net/csolo/article/details/52389646

3 官网 https://kafka.apache.org/quickstart

cd /usr/local/Cellar/kafka/1.1.0

1.安装kafka

执行命令:brew install kafka

2.修改server.properties

执行命令:vi /usr/local/etc/kafka/server.properties
增加一行配置如下:
#listeners = PLAINTEXT://your.host.name:9092
listeners=PLAINTEXT://localhost:9092

3.启动zookeeper

执行命令: zkServer start

4. 以server.properties的配置,启动kafka

在kafka的bin目录下:
执行命令:./kafka-server-start /usr/local/etc/kafka/server.properties

5.新建session,查看kafka的topic

在kafka的bin目录下:
执行命令:./kafka-topics --list --zookeeper localhost:2181

6.启动kafka生产者

在kafka的bin目录下:

执行命令:./kafka-console-producer --topic [topic-name]  --broker-listlocalhost:9092(第2步修改的listeners)
7.启动kafka消费者

在kafka的bin目录下:
执行命令:./kafka-console-consumer --bootstrap-serverlocalhost:9092 —topic [topic-name]


Step 2: Start the server

Kafka uses ZooKeeper so you need to first start a ZooKeeper server if you don't already have one. You can use the convenience script packaged with kafka to get a quick-and-dirty single-node ZooKeeper instance.

1
2
3
> bin/zookeeper-server-start.sh config/zookeeper.properties
[2013-04-22 15:01:37,495] INFO Reading configuration from: config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
...

Now start the Kafka server:

1
2
3
4
> bin/kafka-server-start.sh config/server.properties
[2013-04-22 15:01:47,028] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2013-04-22 15:01:47,051] INFO Property socket.send.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
...

Step 3: Create a topic

Let's create a topic named "test" with a single partition and only one replica:

1
> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

We can now see that topic if we run the list topic command:

1
2
> bin/kafka-topics.sh --list --zookeeper localhost:2181
test

Alternatively, instead of manually creating topics you can also configure your brokers to auto-create topics when a non-existent topic is published to.

Step 4: Send some messages

Kafka comes with a command line client that will take input from a file or from standard input and send it out as messages to the Kafka cluster. By default, each line will be sent as a separate message.

Run the producer and then type a few messages into the console to send to the server.

1
2
3
> bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
This is a message
This is another message

Step 5: Start a consumer

Kafka also has a command line consumer that will dump out messages to standard output.

1
2
3
> bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning
This is a message
This is another message




阅读更多
想对作者说点什么?

博主推荐

换一批

没有更多推荐了,返回首页