MAC Pro Python3无法使用PyKafka连接kafka 问题

错误日志(日志已经经过脱敏处理)

{"logid": "24856050293032", "level": "INFO", "human_time": "2020-12-03 11:41:25,474", "timestamp": 1606966885, "millisecond": 1606966885474, "product": "kazoo.client", "module": "connection", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Connecting to 127.0.0.1:2181", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24855916507464", "level": "INFO", "human_time": "2020-12-03 11:41:25,496", "timestamp": 1606966885, "millisecond": 1606966885496, "product": "kazoo.client", "module": "client", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Zookeeper connection established, state: CONNECTED", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24858077980760", "level": "INFO", "human_time": "2020-12-03 11:41:25,578", "timestamp": 1606966885, "millisecond": 1606966885578, "product": "kazoo.client", "module": "connection", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Closing connection to 127.0.0.1:2181", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24853552015516", "level": "INFO", "human_time": "2020-12-03 11:41:25,579", "timestamp": 1606966885, "millisecond": 1606966885579, "product": "kazoo.client", "module": "client", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Zookeeper session lost, state: CLOSED", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24855508875096", "level": "INFO", "human_time": "2020-12-03 11:41:25,580", "timestamp": 1606966885, "millisecond": 1606966885580, "product": "pykafka.cluster", "module": "cluster", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Broker version is too old to use automatic API version discovery. Falling back to hardcoded versions list.", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24853540030536", "level": "INFO", "human_time": "2020-12-03 11:41:25,693", "timestamp": 1606966885, "millisecond": 1606966885693, "product": "pykafka.handlers", "module": "handlers", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "RequestHandler.stop: about to flush requests queue", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24851583187912", "level": "INFO", "human_time": "2020-12-03 11:41:25,693", "timestamp": 1606966885, "millisecond": 1606966885693, "product": "pykafka.cluster", "module": "cluster", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Discovered 7 brokers", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24859493409792", "level": "INFO", "human_time": "2020-12-03 11:41:25,759", "timestamp": 1606966885, "millisecond": 1606966885759, "product": "pykafka.cluster", "module": "cluster", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Discovered 345 topics", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24859809297576", "level": "INFO", "human_time": "2020-12-03 11:41:25,785", "timestamp": 1606966885, "millisecond": 1606966885785, "product": "pykafka.handlers", "module": "handlers", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "RequestHandler.stop: about to flush requests queue", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24855137464700", "level": "INFO", "human_time": "2020-12-03 11:41:25,786", "timestamp": 1606966885, "millisecond": 1606966885786, "product": "pykafka.topic", "module": "topic", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Adding 6 partitions", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24859688123172", "level": "INFO", "human_time": "2020-12-03 11:41:25,792", "timestamp": 1606966885, "millisecond": 1606966885792, "product": "kazoo.client", "module": "connection", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Connecting to 192.168.100.13:2181", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24855555096104", "level": "INFO", "human_time": "2020-12-03 11:41:25,814", "timestamp": 1606966885, "millisecond": 1606966885814, "product": "kazoo.client", "module": "client", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Zookeeper connection established, state: CONNECTED", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24854156856760", "level": "INFO", "human_time": "2020-12-03 11:41:25,882", "timestamp": 1606966885, "millisecond": 1606966885882, "product": "pykafka.balancedconsumer", "module": "balancedconsumer", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Rebalancing consumer \"b'MacBook-Pro.local:c71642a6-0946-4e9a-b6e9-b3c6530dabd8'\" for topic \"b'abouts'\".", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24850340149516", "level": "INFO", "human_time": "2020-12-03 11:41:25,914", "timestamp": 1606966885, "millisecond": 1606966885914, "product": "pykafka.membershipprotocol", "module": "membershipprotocol", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "b'MacBook-Pro.local:c71642a6-0946-4e9a-b6e9-b3c6340dabd7': Balancing 2 participants for 6 partitions. Owning 3 partitions.", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24863888850236", "level": "INFO", "human_time": "2020-12-03 11:41:26,020", "timestamp": 1606966886, "millisecond": 1606966886020, "product": "pykafka.cluster", "module": "cluster", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Attempting to discover offset manager for consumer group 'b'pykafka_radar-test_service''", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24862368946328", "level": "INFO", "human_time": "2020-12-03 11:41:26,031", "timestamp": 1606966886, "millisecond": 1606966886031, "product": "pykafka.cluster", "module": "cluster", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Found coordinator broker with id 4", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24869039653320", "level": "INFO", "human_time": "2020-12-03 11:41:26,049", "timestamp": 1606966886, "millisecond": 1606966886049, "product": "pykafka.simpleconsumer", "module": "simpleconsumer", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Starting 1 fetcher threads", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24862159101772", "level": "INFO", "human_time": "2020-12-03 11:41:26,051", "timestamp": 1606966886, "millisecond": 1606966886051, "product": "pykafka.balancedconsumer", "module": "balancedconsumer", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "Rebalancing Complete.", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24861614242160", "level": "INFO", "human_time": "2020-12-03 11:41:26,640", "timestamp": 1606966886, "millisecond": 1606966886640, "product": "pykafka.handlers", "module": "handlers", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "RequestHandler worker: exiting cleanly", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}
{"logid": "24862006538404", "level": "INFO", "human_time": "2020-12-03 11:41:26,788", "timestamp": 1606966886, "millisecond": 1606966886788, "product": "pykafka.handlers", "module": "handlers", "caller_ip": "", "host_ip": "", "proc_id": 29361, "service_id": "test_service", "instance_id": "", "x_hop": "", "msg": "RequestHandler worker: exiting cleanly", "src": "", "send": "", "return": "", "cost": "", "uri_path": "", "weights": ""}

问题描述:

链接上kafka之后,hang住不动了

尝试过的解决方案:

1.考虑电脑问题,因为在别的开发环境可以运行,就是在Mac上不行,最后发现在docker容器也不行;

2.考虑过是python版本问题,也不行;

3.百度谷歌各种办法,重装各个模块,都不行;

终极解决方案:不要多余安装snappy模块

docker容器中解决方案:

pip uninstall snappy python-snappy

pip install python-snappy

mac电脑解决方案

brew install snappy

pip Install python-snappy

总结:

一定不要多余安装snappy模块,这是重点

 

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值