impala执行任务,出现错误情况分析过程

[2019-06-14 06:41:37,995] {bash_operator.py:110} INFO - ERROR: ExecQueryFInstances rpc query_id=ad436a66e8edf461:1f40b0a200000000 failed:
 Failed to get minimum memory reservation of 108.00 MB on daemon hadoop10:22000
 for query ad436a66e8edf461:1f40b0a200000000 due to following error: Failed to increase reservation by 108.00 MB because it would exceed the applicable reservation limit for the "Process" ReservationTracker: reservation_limit=68.00 GB reservation=67.98 GB used_reservation=0 child_reservations=67.98 GB

[2019-06-14 06:41:37,995] {bash_operator.py:110} INFO - The top 5 queries that allocated memory under this tracker are:
[2019-06-14 06:41:37,995] {bash_operator.py:110} INFO - Query(21487f1dbe01a9e1:8ef2a48a00000000): Reservation=64.00 GB ReservationLimit=64.00 GB OtherMemory=5.38 MB Total=64.01 GB Peak=64.09 GB
[2019-06-14 06:41:37,995] {bash_operator.py:110} INFO - Query(744b0de54b078b9:18b639f00000000): Reservation=3.97 GB ReservationLimit=64.00 GB OtherMemory=58.88 MB Total=4.03 GB Peak=4.33 GB
[2019-06-14 06:41:37,995] {bash_operator.py:110} INFO - Query(ad436a66e8edf461:1f40b0a200000000): Reservation=0 ReservationLimit=64.00 GB OtherMemory=0 Total=0 Peak=0

通过日志发现造成该impala sql执行错误的原因是有几个(query_id红色部分)sql执行占用该节点太多的内存,导致任务失败;于是在impala查询该query_id是哪个任务,造成的

 

 

同时查的该任务的sql语句和发现占用内存都很大,直接kill掉,后面任务可以执行了

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值