Impala队列内存参数分析

同步发布在博客园上

问题

对Impala队列内存的几个参数分析了下，欢迎指正

队列资源池的几个内存配置

1. Maximum Query Memory Limit

   某个队列资源池，一个查询在一个Impala节点上下执行需要的最小内存

2. Minimum Query Memory Limit

   某个队列资源池，一个查询在一个Impala节点上下执行需要的最大内存

3. 最大内存

   可用于此池中执行的所有查询的最大内存

给一个Impala队列提交查询时，Impala如何判断是否接受查询请求

实验sql

 set request_pool = hqueue;
 select tally_id, acctset_code  from testtable where acctset_code='00001'order by acctset_code limit 5 offset 5;

查询sql分析

[ip:21000] testdb> explain select tally_id, acctset_code  from testtable where acctset_code='00001'order by acctset_code limit 5 offset 5;
Query: explain select tally_id, acctset_code  from testtable where acctset_code='00001'order by acctset_code limit 5 offset 5
+------------------------------------------------------------------------------------+
| Explain String                                                                     |
+------------------------------------------------------------------------------------+
| Max Per-Host Resource Reservation: Memory=8.00MB Threads=3                         |
| Per-Host Resource Estimates: Memory=256MB                                          |
| WARNING: The following tables are missing relevant table and/or column statistics. |
| testdb.testtable                                              |
|                                                                                    |
| PLAN-ROOT SINK                                                                     |
| |                                                                                  |
| 02:MERGING-EXCHANGE [UNPARTITIONED]                                                |
| |  offset: 5                                                                       |
| |  order by: acctset_code ASC                                                      |
| |  limit: 5                                                                        |
| |