ElasticSearch CircuitBreakingException相关问题排查

现象

logstash向ES写入数据,出现错误

[2018-10-22T14:23:07,406][INFO ][logstash.outputs.elasticsearch] retrying failed action with response code: 503 ({"type"=>"circuit_breaking_exception", "reason"=>"[parent] Data too large, data for [<transport_request>] would be [24153861037/22.4gb], which is larger than the limit of [22408154316/20.8gb]", "bytes_wanted"=>24153861037, "bytes_limit"=>22408154316})

ES刚开始的事后并没有什么事,一段事件后无法正常工作。
后台日志显示

[2018-10-22T10:00:43,603][DEBUG][o.e.a.a.c.n.i.TransportNodesInfoAction] [node-101] failed to execute on node [FnXP-863QFC0FnrHOBVycQ]
org.elasticsearch.transport.RemoteTransportException: [node-102][10.5.145.102:9300][cluster:monitor/nodes/info[n]]
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [<transport_request>] would be [22842300539/21.2gb], which is larger than the limit of [22408154316/20.8gb]
	at org.elasticsearch.indices.breaker.HierarchyCircuitBreakerService.checkParentLimit(HierarchyCircuitBreakerService.java:230) ~[elasticsearch-6.3.2.jar:6.3.2]
	at org.elasticsearch.common.breaker.ChildMemoryCircuitBreaker.addEstimateBytesAndMaybeBreak(ChildMemoryCircuitBreaker.java:128) ~[elasticsearch-6.3.2.jar:6.3.2]
	at org.elasticsearch.transport.TcpTransport.handleRequest(TcpTransport.java:1540) [elasticsearch-6.3.2.jar:6.3.2]
	at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1414) [elasticsearch-6.3.2.jar:6.3.2]

排查

首先注意到了这个bug-fix,不过很可惜,这个bug-fix是2017年时针对5.3.x以下版本的。摔锅失败。
https://github.com/elastic/elasticsearch/pull/23310

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值