我有两个nameko服务,它们通过RabbitMQ使用RPC进行通信。与docker本地组合一切顺利。然后我把所有的东西都部署到DigitalOcean上的Kubernetes/Istio集群,并开始得到以下错误。在10/20/60分钟内连续重复1次。服务之间的通信工作正常(我想是在重新连接之前和之后),但是日志由于那些不应该发生的意外重新连接而变得混乱。在
我试图增加RAM和CPU配置(到上面配置文件中的值:512Mb和400m),但仍然有相同的行为。在
NB:部署后,我不会接触服务,也不会发送任何消息或发出任何请求,我在大约60分钟内第一次遇到此错误。当我提出请求时,他们成功了,但最终我们在日志中仍然会出现此错误。在
Nameko服务日志:"Connection to broker lost, trying to re-establish connection...",
"exc_info": "Traceback (most recent call last):
File \"/usr/local/lib/python3.6/site-packages/kombu/mixins.py\", line 175, in run for _ in self.consume(limit=None, **kwargs):
File \"/usr/local/lib/python3.6/site-packages/kombu/mixins.py\", line 197, in consume conn.drain_events(timeout=safety_interval)
File \"/usr/local/lib/python3.6/site-packages/kombu/connection.py\", line 323, in drain_events
return self.transport.drain_events(self.connection, **kwargs)
File \"/usr/local/lib/python3.6/site-packages/kombu/transport/pyamqp.py\", line 103, in drain_events
return connection.drain_events(**kwargs)
File \"/usr/local/lib/python3.6/site-packages/amqp/connection.py\", line 505, in drain_events
while not self.blocking_read(timeout):
File \"/usr/local/lib/python3.6/site-packages/amqp/connection.py\", line 510, in blocking_read\n frame = self.transport.read_frame()
File \"/usr/local/lib/python3.6/site-packages/amqp/transport.py\", line 252, in read_frame
frame_header = read(7, True)
File \"/usr/local/lib/python3.6/site-packages/amqp/transport.py\", line 446, in _read
raise IOError('Server unexpectedly closed connection')
OSError: Server unexpectedly closed connection"}
{"name": "kombu.mixins", "asctime": "29/12/2019 20:22:54", "levelname": "INFO", "message": "Connected to amqp://user:**@rabbit-rabbitmq:5672//"}
RabbitMQ日志
^{pr2}$
升级版: