php rdkafka 偏移量,php-rdkafka 扩展安装

php有两种方式调用kafka

一、php-rdkafka

文档地址：https://arnaud-lb.github.io/php-rdkafka/phpdoc/book.rdkafka.html

rdkafka安装需要依赖librdkafka所以我们需要先安装librdkafka

下载地址http://pecl.php.net/package/rdkafka

git clone https://github.com/edenhill/librdkafka.git

cd librdkafka

./configure

make && make install

安装php-rdkafka扩展

git clone https://github.com/arnaud-lb/php-rdkafka.git

cd php-rdkafka

phpize

./configure --with-php-config=/usr/local/php7.0/bin/php-config

make && make install

然后在php.ini写入

extension = rdkafka.so

image.png

image.png

二、kafka-php 扩展包

文档地址：https://github.com/weiboad/kafka-php

三、简单示例

生成者

setLogLevel(LOG_DEBUG);

$rk->addBrokers("192.168.2.152");

$topic = $rk->newTopic("shop");

for ($i = 0; $i < 10; $i++) {

$topic->produce(RD_KAFKA_PARTITION_UA, 0, "发送信息： $i");

$rk->poll(0);

}

while ($rk->getOutQLen() > 0) {

$rk->poll(50);

}

?>

消费者

set('group.id', 'myConsumerGroup');

$rk = new RdKafka\Consumer($conf);

$rk->addBrokers("192.168.2.150:9092");

$topicConf = new RdKafka\TopicConf();

$topicConf->set('auto.commit.interval.ms', 100);

$topicConf->set('offset.store.method', 'file');

$topicConf->set('offset.store.path', sys_get_temp_dir());

$topicConf->set('auto.offset.reset', 'smallest');

$topic = $rk->newTopic("shop", $topicConf);

// Start consuming partition 0

$topic->consumeStart(0, RD_KAFKA_OFFSET_STORED);

while (true) {

$message = $topic->consume(0, 120*10000);

switch ($message->err) {

case RD_KAFKA_RESP_ERR_NO_ERROR:

//没有错误打印信息

var_dump($message);

break;

case RD_KAFKA_RESP_ERR__PARTITION_EOF:

echo "等待接收信息\n";

break;

case RD_KAFKA_RESP_ERR__TIMED_OUT:

echo "超时\n";

break;

default:

throw new \Exception($message->errstr(), $message->err);

break;

}

}

?>

image.png