Hive执行计划

1、hive显示执行计划语法

EXPLAIN [EXTENDED|CBO|AST|DEPENDENCY|AUTHORIZATION|LOCKS|VECTORIZATION|ANALYZE] hql

末尾hql是你要执行的hive语句 中间[]中为可选参数

2、执行计划示例
贴一个很简单的hql语句执行计划示例,用了extended子句,感觉是比较详细的一个输出了,如果不加extended,输出会显示mr过程以及stage的依赖关系,对于排查基本的语法错误来说其实已经足够了(首先申明我很菜,其实没太看明白,先把过程记下来 0_0)

    > explain extended select ugc_id, count(distinct if(topic_id is null,null,topic_id)) as topic_num from data_warehouse.dwd_publish_ugc where ugc_id is not null and stat_date = '2021-07-01' and stat_hour = '12' group by ugc_id;
OK
STAGE DEPENDENCIES:
  Stage-1 is a root stage
  Stage-0 depends on stages: Stage-1

STAGE PLANS:
  Stage: Stage-1
    Spark
      Edges:
        Reducer 2 <- Map 1 (GROUP PARTITION-LEVEL SORT, 1)
      DagName: bigdata_20210805151741_94407807-3b69-4851-b303-b1eb07ec537e:7
      Vertices:
        Map 1 
            Map Operator Tree:
                TableScan
                  alias: dwd_publish_ugc
                  Statistics: Num rows: 3 Data size: 753 Basic stats: COMPLETE Column stats: NONE
                  GatherStats: false
                  Filter Operator
                    isSamplingPred: false
                    predicate: ugc_id is not null (type: boolean)
                    Statistics: Num rows: 3 Data size: 753 Basic stats: COMPLETE Column stats: NONE
                    Group By Operator
                      aggregations: count(DISTINCT if(topic_id is null, null, topic_id))
                      keys: ugc_id (type: string), if(topic_id is null, null, topic_id) (type: string)
                      mode: hash
                      outputColumnNames: _col0, _col1, _col2
                      Statistics: Num rows: 3 Data size: 753 Basic stats: COMPLETE Column stats: NONE
                      Reduce Output Operator
                        key expressions: _col0 (type
  • 0
    点赞
  • 3
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值