impala的优化策略：广播，hash与straight_join

五块兰州拉面

已于 2022-02-28 16:45:24 修改

阅读量757

点赞数

分类专栏：工作文章标签： impala

于 2022-02-28 16:33:07 首次发布

本文链接：https://blog.csdn.net/qq_39331255/article/details/123183672

版权

本文介绍了Impala查询优化中的广播连接和分区连接策略，以及在统计信息不足或自动优化不理想时，如何使用STRAIGHT_JOIN关键字固定连接顺序。STRAIGHT_JOIN不仅适用于INNER JOIN，也适用于LEFT JOIN。

摘要由CSDN通过智能技术生成

查看执行计划，避免大表被广播，表关联顺序如果被impala优化器修改导致hint失效，使用straight_join固定顺序。
阅读impala官方文档

关于hint

The Impala query planner chooses between different techniques for performing join queries, depending on the absolute and relative sizes of the tables. Broadcast joins are the default, where the right-hand table is considered to be smaller than the left-hand table, and its contents are sent to all the other nodes involved in the query. The alternative technique is known as a partitioned join (not related to a partitioned table), which is more suitable for large tables of roughly equal size. With this technique, portions of each table are sent to appropriate other nodes where those subsets of rows can be processed in parallel. The choice of broadcast or partitioned join also depends on statistics being available for all tables in the join, gathered by the COMPUTE STATS statement.
Impala查询规划器根据表的绝对大小和相对大小来选择执行连接查询的不同技术。广播连接是默认的