linux kafka离线安装,centos 离线安装confluent_kafka 模块

centos 离线安装confluent_kafka 模块

背景：需要安装Python模块的机子不能上网，只能下载源码进行安装

说明：如果可以上网直接pip install confluent_kafka 即可

需安装模块：

confluent_kafka #confluent_kafka 依赖librdkafka 模块：

librdkafka

安装包下载：

https://pypi.org/project/confluent-kafka/

https://github.com/edenhill/librdkafka

安装：

先安装librdkafka 模块：

cd librdkafka

./configure --prefix=/usr

make

make install

ldconfig

再安装confluent_kafka 模块：

cd confluent_kafka

python setup.py install

测试：

import confluent_kafka

如果出现错误：

from .cimpl import (Consumer, # noqa

ImportError: librdkafka.so.1: cannot open shared object file: No such file or directory

解决办法：

ldconfig

如果出现错误：

confluent_kafka/src/confluent_kafka.h:21:32: fatal error: librdkafka/rdkafka.h: No such file or directory

#include

^

compilation terminated.

error: command 'gcc' failed with exit status 1

解决办法：

./configure --prefix=/usr #增加前缀

make

make -j

make install

ldconfig

#如果仍报错，在本机搜索librdkafka/rdkafka.h是否存在，如果已经存在，那么退出或者新建一个终端重新尝试即可

如果出现错误：

In file included from confluent_kafka/src/confluent_kafka.c:17:0:

confluent_kafka/src/confluent_kafka.h:17:20: fatal error: Python.h: No such file or directory

#include

^

compilation terminated.

error: command 'gcc' failed with exit status 1

解决办法：

yum install python-dev

参考链接：

https://blog.csdn.net/qq_35887983/article/details/79308723

https://github.com/confluentinc/confluent-kafka-python/issues/184

https://github.com/confluentinc/confluent-kafka-python/issues/65