gbase 8a trace日志结构

在这里插入图片描述
摘要区:
并非每次查询都会产生摘要trace,每个trc生成1次,当某个session首次写trace文件时会产生摘要区trace
/opt/10.10.11.146/gnode/log/gbase/gbase_root_159_20230727194515.trc --trace文件路径
Server Version: 9.5.3.29.23fba856 --gbased服务版本号
Version Comment: 23fba856
Instance Name: gbase --实例名称
Session ID: 159 --连接session id
User: root --连接用户名
Time: 20230727194515 --时间戳
GBASE_HOME=/opt/10.10.11.146/gnode/server/ --GBASE_HOME环境变量
CPUS: 4 --CPU核数
MEM: 7821 MB --系统物理内存大小
Sql语句区:
在gnode都是分片的,一般带_n1等分片号
2023-07-27 19:45:15.178 [M: 9M, 0B,D: 0B] [DC: 0, 0] SQL Statement:
CREATE TABLE gctmpdb._tmp_2450197002_203_t15_1_1690421666_s AS SELECT /10.10.11.146_203_3_2023-07-27_19:45:15/ /*+ TID(‘196674’) */ SUM((vcname000001.test.lineitem.l_extendedprice * vcname000001.test.lineitem.l_discount)) AS c1 FROM test.lineitem_n1 vcname000001.test.lineitem WHERE (vcname000001.test.lineitem.l_shipdate >= cast(‘1994-01-01’ as date)) AND (vcname000001.test.lineitem.l_shipdate < date_add(cast(‘1994-01-01’ as date), INTERVAL ‘1’ YEAR)) AND (vcname000001.test.lineitem.l_discount BETWEEN (0.06 - 0.01) AND (0.06 + 0.01)) AND (vcname000001.test.lineitem.l_quantity < 24) LIMIT 0

资源监控区:
数据结构如下:
[内存:数据堆,large堆,磁盘:临时表空间] [访问DC数:内存命中,磁盘访问]
[M: 9M, 0B,D: 0B] [DC: 0, 0]
[M: 9M, 0B,D: 0B] [DC: 0, 0]
[M: 9M, 0B,D: 0B] [DC: 0, 0]
数据堆:data heap的使用情况,全局状态
Large堆:算子buffer的使用情况,全局状态
临时表空间:语句执行过程占用的临时磁盘空间,session级
内存中访问DC总数:从内存缓冲中访问的DC总数,session级
磁盘中访问DC总数:从磁盘中访问的DC总数,session级
执行计划汇总:
2023-07-27 19:45:15.185 [M: 9M, 0B,D: 0B] [DC: 0, 0] SUMMARY
2023-07-27 19:45:15.185 [M: 9M, 0B,D: 0B] [DC: 0, 0] elapsed time: 00:00:00.007 --sql执行时间
2023-07-27 19:45:15.185 [M: 9M, 0B,D: 0B] [DC: 0, 0] data loaded from storage: 0B, 0s, 0 DC. --总共从磁盘读了0B(共0DC)的 数据,用时0s
2023-07-27 19:45:15.185 [M: 9M, 0B,D: 0B] [DC: 0, 0] data decompressed: 0B, 0s. --总共解压了0B的数据,用时0s
2023-07-27 19:45:15.185 [M: 9M, 0B,D: 0B] [DC: 0, 0] temp space IO stats: --查询过程中临时表空间使用情况
2023-07-27 19:45:15.186 [M: 9M, 0B,D: 0B] [DC: 0, 0] CB write( 0B, 0time, 0sec), read( 0B, 0time, 0sec) --物化中间结果(读/写大小、请求次数、花费时间)
2023-07-27 19:45:15.186 [M: 9M, 0B,D: 0B] [DC: 0, 0] SRT write( 0B, 0time, 0sec), read( 0B, 0time, 0sec) --排序中间结果
2023-07-27 19:45:15.186 [M: 9M, 0B,D: 0B] [DC: 0, 0] GDC write( 0B, 0time, 0sec), read( 0B, 0time, 0sec) --group by distinct中间结果
2023-07-27 19:45:15.186 [M: 9M, 0B,D: 0B] [DC: 0, 0] MAT write( 0B, 0time, 0sec), read( 0B, 0time, 0sec) --join中间结果
2023-07-27 19:45:15.186 [M: 9M, 0B,D: 0B] [DC: 0, 0] HSJ write( 0B, 0time, 0sec), read( 0B, 0time, 0sec) --One-pass Hash Join中间结果
2023-07-27 19:45:15.186 [M: 9M, 0B,D: 0B] [DC: 0, 0] ======================================================

执行详细部分:
查询主要算子:扫描(scan),连接(join),分组聚集(group),排序(order),物化(materialize)

#开始执行
2023-07-28 02:24:17.406 [M: 116M, 0B,D: 0B] [DC: 0, 0] Start Query Execution
2023-07-28 02:24:17.406 [M: 116M, 0B,D: 0B] [DC: 0, 0] Tables: --显示涉及到的表并为表起别名T0、T1、T2…
2023-07-28 02:24:17.406 [M: 116M, 0B,D: 0B] [DC: 0, 0] T0: vcname000001.test.supplier(test.supplier_n1), 10000 rows, 1 DC
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] T1: vcname000001.test.partsupp(test.partsupp), 800000 rows, 13 DC
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] T2: vcname000001.test.part(test.part), 200000 rows, 4 DC

#智能扫描
涉及多个表、多个字段时会分别扫描。只用到智能索引部分,所以一般耗时很少
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] Condition Weight (non-join):
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] cnd(0): FALSE (0)
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] BEGIN Smart Scan
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] T0: total 1 DC, found 1 DC to scan(with 0 FULL DC).
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] T1: total 13 DC, found 13 DC to scan(with 0 FULL DC).
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] T2: total 4 DC, found 4 DC to scan(with 0 FULL DC).
2023-07-28 02:24:17.407 [M: 116M, 0B,D: 0B] [DC: 0, 0] END Smart Scan. (time used: 0.000s)

#逐行过滤
需要读取DC数据,解压后按照列条件进行逐行扫描,耗时较长
2023-07-28 02:24:17.423 [M: 116M, 0B,D: 0B] [DC: 0, 0] BEGIN Scan
2023-07-28 02:24:17.423 [M: 116M, 0B,D: 0B] [DC: 0, 0] cnd(2) vcname000001.test.part.p_size BET. NONE AND 25
2023-07-28 02:24:17.424 [M: 116M, 0B,D: 0B] [DC: 0, 0] ( 0)ApplyQueryDesc cur(dc*65536):0 end: 65536
2023-07-28 02:24:17.425 [M: 116M, 0B,D: 0B] [DC: 1, 0] ( 0)cnd(2) scanned 65536 rows, found 32812 rows (time used: 0.001s)
2023-07-28 02:24:17.426 [M: 116M, 0B,D: 0B] [DC: 4, 0] ( 1)cnd(2) scanned 65536 rows, found 32872 rows (time used: 0.001s)
2023-07-28 02:24:17.428 [M: 116M, 0B,D: 0B] [DC: 4, 0] ( 2)cnd(2) scanned 65536 rows, found 32907 rows (time used: 0.002s)
2023-07-28 02:24:17.428 [M: 116M, 0B,D: 0B] [DC: 4, 0] ( 3)cnd(2) scanned 3392 rows, found 1717 rows (time used: 0.003s)
2023-07-28 02:24:17.435 [M: 116M, 0B,D: 0B] [DC: 4, 0] cnd(2) Done. scanned 200000 rows, found 100308 rows (time used: 0.012s)
2023-07-28 02:24:17.435 [M: 116M, 0B,D: 0B] [DC: 4, 0] cnd(1) vcname000001.test.part.p_mfgr BET. ‘Manufacturer#4’ AND ‘Manufacturer#4’
2023-07-28 02:24:17.440 [M: 116M, 0B,D: 0B] [DC: 8, 0] ( 0)cnd(1) scanned 32812 rows, found 6463 rows (time used: 0.003s)
2023-07-28 02:24:17.440 [M: 116M, 0B,D: 0B] [DC: 8, 0] ( 3)cnd(1) scanned 1717 rows, found 350 rows (time used: 0.002s)
2023-07-28 02:24:17.440 [M: 116M, 0B,D: 0B] [DC: 8, 0] ( 2)cnd(1) scanned 32907 rows, found 6444 rows (time used: 0.003s)
2023-07-28 02:24:17.440 [M: 116M, 0B,D: 0B] [DC: 8, 0] ( 1)cnd(1) scanned 32872 rows, found 6550 rows (time used: 0.003s)
2023-07-28 02:24:17.448 [M: 116M, 0B,D: 0B] [DC: 8, 0] cnd(1) Done. scanned 100308 rows, found 19807 rows (time used: 0.013s)
2023-07-28 02:24:17.465 [M: 116M, 0B,D: 0B] [DC: 16, 0] cnd(0) vcname000001.test.partsupp.ps_supplycost BET. 500.01 AND NONE
2023-07-28 02:24:17.471 [M: 116M, 0B,D: 0B] [DC: 26, 0] ( 0)cnd(0) scanned 262144 rows, found 130905 rows (time used: 0.005s)
2023-07-28 02:24:17.471 [M: 116M, 0B,D: 0B] [DC: 27, 0] ( 2)cnd(0) scanned 196608 rows, found 98683 rows (time used: 0.004s)
2023-07-28 02:24:17.473 [M: 116M, 0B,D: 0B] [DC: 29, 0] ( 3)cnd(0) scanned 144640 rows, found 72499 rows (time used: 0.006s)
2023-07-28 02:24:17.473 [M: 116M, 0B,D: 0B] [DC: 29, 0] ( 1)cnd(0) scanned 196608 rows, found 98223 rows (time used: 0.003s)
2023-07-28 02:24:17.476 [M: 116M, 0B,D: 0B] [DC: 29, 0] cnd(0) Done. scanned 800000 rows, found 400310 rows (time used: 0.011s)
2023-07-28 02:24:17.491 [M: 116M, 0B,D: 0B] [DC: 37, 0] T0: total 1 DC, found 1 DC after scan(with 1 FULL DC).
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] T1: total 13 DC, found 13 DC after scan(with 0 FULL DC).
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] T2: total 4 DC, found 4 DC after scan(with 0 FULL DC).
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] END Scan. (time used: 0.069s)

#连接(join)
Join算法有三种:hash join,sort-merge join,nested-loop join,其中hash join是实际应用最多的join方法(有等值条件就会用),sort-merge join适用于>,>=,<,<=等非等值连接,以上join算法都不适用才会使用nested-loop join算法,如!=
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] Condition Weight (join):
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] cnd(3): vcname000001.test.part.p_partkey = vcname000001.test.partsupp.ps_partkey (23.01)
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] cnd(4): vcname000001.test.supplier.s_suppkey = vcname000001.test.partsupp.ps_suppkey (29.03)
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] BEGIN Join
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] cnd(3):
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] cnd(3): vcname000001.test.part.p_partkey = vcname000001.test.partsupp.ps_partkey
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] prepare to use hash join
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] prepare to use hash join
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] traverse dim: 19807 tuples, match dim: 400310 tuples --traverse(小表)条数,match(大表)条数
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] traverse tuple: total_size = 7, key_size = 3, tuple_size = 4, other_size = 0, pseudo_size = 0
–total_size:总和,key_size:计算哈希值的大小,tuple_size:存储行号的大小,other_size:不等值条件的大小
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] match tuple: total_size = 7, key_size = 3, tuple_size = 4, other_size = 0, pseudo_size = 0
2023-07-28 02:24:17.492 [M: 116M, 0B,D: 0B] [DC: 37, 0] divide to 4 blocks(using round-robin): 130905, 98223, 98683, 72499.
2023-07-28 02:24:17.493 [M: 116M, 288K,D: 0B] [DC: 37, 0] Hybrid hash join: data will be split into 1(分片数) partitions
2023-07-28 02:24:17.493 [M: 116M, 288K,D: 0B] [DC: 37, 0] bloom filter (0 close 1 open): 0
2023-07-28 02:24:17.493 [M: 116M, 288K,D: 0B] [DC: 37, 0] traverse dim: 19807 tuples, match dim: 130905 tuples
2023-07-28 02:24:17.493 [M: 116M, 2M,D: 0B] [DC: 37, 0] traverse dim: 19807 tuples, match dim: 98223 tuples
2023-07-28 02:24:17.493 [M: 116M, 5M,D: 0B] [DC: 37, 0] traverse dim: 19807 tuples, match dim: 98683 tuples
2023-07-28 02:24:17.493 [M: 116M, 8M,D: 0B] [DC: 37, 0] traverse dim: 19807 tuples, match dim: 72499 tuples
2023-07-28 02:24:17.493 [M: 116M, 10M,D: 0B] [DC: 37, 0] BEGIN hybrid hash join: partition(-1/1): traverse dim: 19807 tuples, match dim: 400310 tuples
2023-07-28 02:24:17.493 [M: 116M, 10M,D: 0B] [DC: 37, 0] Begin join: partition(-1/1), pass(0)
2023-07-28 02:24:17.494 [M: 116M, 10M,D: 0B] [DC: 37, 0] ( 0)Traverse: begin scanning from 0 to 4951
2023-07-28 02:24:17.495 [M: 116M, 11M,D: 0B] [DC: 38, 0] ( 3)Traverse: begin scanning from 14853 to 19807
2023-07-28 02:24:17.496 [M: 116M, 11M,D: 0B] [DC: 39, 0] ( 1)Traverse: begin scanning from 4951 to 9902
2023-07-28 02:24:17.496 [M: 116M, 11M,D: 0B] [DC: 40, 0] ( 0)Traverse: scanned to rowid 4951.
2023-07-28 02:24:17.496 [M: 116M, 11M,D: 0B] [DC: 40, 0] ( 0)Joiner(0) finish traverse task
2023-07-28 02:24:17.497 [M: 116M, 11M,D: 0B] [DC: 41, 0] ( 1)Traverse: scanned to rowid 9902.
2023-07-28 02:24:17.497 [M: 116M, 11M,D: 0B] [DC: 41, 0] ( 1)Joiner(1) finish traverse task
2023-07-28 02:24:17.497 [M: 116M, 11M,D: 0B] [DC: 41, 0] ( 2)Traverse: begin scanning from 9902 to 14853
2023-07-28 02:24:17.498 [M: 116M, 11M,D: 0B] [DC: 43, 0] ( 2)Traverse: scanned to rowid 14853.
2023-07-28 02:24:17.499 [M: 116M, 11M,D: 0B] [DC: 43, 0] ( 2)Joiner(2) finish traverse task
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)Traverse: scanned to rowid 19807.
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)Joiner(3) finish traverse task
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)HashTable: mem: total 16544782, desired 89131, block_size 98304
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)Sub 0: use 32768+58836; buckets: total 8192, use 3466, avg 1.41, longest 6; rows: add 4903
–sub0:total哈希桶数,use用了多少桶,avg桶内数据的平均比,1是最优的数据分布证明一个桶里1条数据
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)Sub 1: use 32768+60348; buckets: total 8192, use 3550, avg 1.42, longest 5; rows: add 5029
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)Sub 2: use 32768+59748; buckets: total 8192, use 3525, avg 1.41, longest 6; rows: add 4979
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)Sub 3: use 32768+58752; buckets: total 8192, use 3466, avg 1.41, longest 5; rows: add 4896
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)JoinTables: mem: exp. 67108864; rows: exp. 19807, cap. 22020096, add 19807
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)Traverse finished. (time used: 0.008s)
2023-07-28 02:24:17.501 [M: 116M, 11M,D: 0B] [DC: 44, 0] ( 3)Match: begin scanning…
2023-07-28 02:24:17.517 [M: 116M, 14M,D: 0B] [DC: 54, 0] ( 3)Match: scanned 72499 rows, and produced 7206 rows already.
2023-07-28 02:24:17.517 [M: 116M, 14M,D: 0B] [DC: 54, 0] ( 3)bloomfilter skipped 0 rows
2023-07-28 02:24:17.517 [M: 116M, 14M,D: 0B] [DC: 54, 0] ( 3)Joiner(3) finish match task
2023-07-28 02:24:17.522 [M: 116M, 14M,D: 0B] [DC: 55, 0] ( 2)Match: scanned 98683 rows, and produced 9595 rows already.
2023-07-28 02:24:17.522 [M: 116M, 14M,D: 0B] [DC: 55, 0] ( 2)bloomfilter skipped 0 rows
2023-07-28 02:24:17.522 [M: 116M, 14M,D: 0B] [DC: 55, 0] ( 2)Joiner(2) finish match task
2023-07-28 02:24:17.525 [M: 116M, 14M,D: 0B] [DC: 55, 0] ( 1)Match: scanned 98223 rows, and produced 9604 rows already.
2023-07-28 02:24:17.525 [M: 116M, 14M,D: 0B] [DC: 55, 0] ( 1)bloomfilter skipped 0 rows
2023-07-28 02:24:17.525 [M: 116M, 14M,D: 0B] [DC: 55, 0] ( 1)Joiner(1) finish match task
2023-07-28 02:24:17.547 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)Match: scanned 130905 rows, and produced 13086 rows already.
2023-07-28 02:24:17.547 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)bloomfilter skipped 0 rows
2023-07-28 02:24:17.547 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)Joiner(0) finish match task
2023-07-28 02:24:17.547 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)Match finished. (time used: 0.046s)
2023-07-28 02:24:17.547 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)Commit: begin …
2023-07-28 02:24:17.547 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)join: found 13086 rows. (inner: 13086, traverse outer: 0, match outer: 0)
2023-07-28 02:24:17.548 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 2)join: found 9595 rows. (inner: 9595, traverse outer: 0, match outer: 0)
2023-07-28 02:24:17.548 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 1)join: found 9604 rows. (inner: 9604, traverse outer: 0, match outer: 0)
2023-07-28 02:24:17.549 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 2)begin scanning dc segment info. 9595 tuples, begin = 0, end = 9594, max_tuple_dim = 1, max_tuple_no = 800000, dc_segment_size = 1
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 2)
7 dc_segment: begin 0, end 3243, tuple_no 3244
8 dc_segment: begin 3244, end 6445, tuple_no 3202
9 dc_segment: begin 6446, end 9594, tuple_no 3149
finish scanning dc segment info.
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 2)pass info: 9595
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 2)Joiner(2) finish commit task
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 2)TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 3)join: found 7206 rows. (inner: 7206, traverse outer: 0, match outer: 0)
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 2)TqJob finish <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 1)begin scanning dc segment info. 9604 tuples, begin = 0, end = 9603, max_tuple_dim = 1, max_tuple_no = 800000, dc_segment_size = 1
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 1)
4 dc_segment: begin 0, end 3214, tuple_no 3215
5 dc_segment: begin 3215, end 6417, tuple_no 3203
6 dc_segment: begin 6418, end 9603, tuple_no 3186
finish scanning dc segment info.
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 1)pass info: 9604
2023-07-28 02:24:17.550 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 1)Joiner(1) finish commit task
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 1)TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 1)TqJob finish <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 3)begin scanning dc segment info. 7206 tuples, begin = 0, end = 7205, max_tuple_dim = 1, max_tuple_no = 800000, dc_segment_size = 1
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 3)
10 dc_segment: begin 0, end 3333, tuple_no 3334
11 dc_segment: begin 3334, end 6526, tuple_no 3193
12 dc_segment: begin 6527, end 7205, tuple_no 679
finish scanning dc segment info.
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 3)pass info: 7206
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 3)Joiner(3) finish commit task
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 3)TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 3)TqJob finish <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:17.551 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)begin scanning dc segment info. 13086 tuples, begin = 0, end = 13085, max_tuple_dim = 1, max_tuple_no = 800000, dc_segment_size = 1
2023-07-28 02:24:17.552 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)
0 dc_segment: begin 0, end 3289, tuple_no 3290
1 dc_segment: begin 3290, end 6627, tuple_no 3338
2 dc_segment: begin 6628, end 9890, tuple_no 3263
3 dc_segment: begin 9891, end 13085, tuple_no 3195
finish scanning dc segment info.
2023-07-28 02:24:17.552 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)pass info: 13086
2023-07-28 02:24:17.552 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)Joiner(0) finish commit task
2023-07-28 02:24:17.552 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:17.552 [M: 116M, 14M,D: 0B] [DC: 57, 0] ( 0)TqJob finish <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:17.552 [M: 116M, 14M,D: 0B] [DC: 57, 0] End join: partition(-1/1), pass(0)
2023-07-28 02:24:17.552 [M: 116M, 14M,D: 0B] [DC: 57, 0] END hybrid hash join: partition(-1/1): (time used: 0.059s)
2023-07-28 02:24:17.552 [M: 116M, 14M,D: 0B] [DC: 57, 0] join: found 39491 rows. (inner: 39491, traverse outer: 0, match outer: 0)
2023-07-28 02:24:17.556 [M: 116M, 11M,D: 717K] [DC: 57, 0] Begin rowid merge-sorting: 4 inputs, 39491 rows
2023-07-28 02:24:17.556 [M: 116M, 11M,D: 717K] [DC: 57, 0] sort rowid: max_dc_segment_no = 1025, total_tuple_no = 39491, dop = 4, average_thread_tuple_no = 9873
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[0]: 3290 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[1]: 3338 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[2]: 3263 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[3]: 3195 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[4]: 3215 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[5]: 3203 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[6]: 3186 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[7]: 3244 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[8]: 3202 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[9]: 3149 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[10]: 3334 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[11]: 3193 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[12]: 679 tuples
2023-07-28 02:24:17.557 [M: 116M, 11M,D: 717K] [DC: 57, 0] dc_segment[13]: 0 tuples

2023-07-28 02:24:17.600 [M: 116M, 11M,D: 717K] [DC: 57, 0] sort rowid: thread[0] processes 3 dc_segment(9891 tuples) from dc_segment[0]
2023-07-28 02:24:17.601 [M: 116M, 11M,D: 717K] [DC: 57, 0] sort rowid: thread[1] processes 3 dc_segment(9613 tuples) from dc_segment[3]
2023-07-28 02:24:17.601 [M: 116M, 11M,D: 717K] [DC: 57, 0] sort rowid: thread[2] processes 3 dc_segment(9632 tuples) from dc_segment[6]
2023-07-28 02:24:17.601 [M: 116M, 11M,D: 717K] [DC: 57, 0] sort rowid: thread[3] processes 1016 dc_segment(10355 tuples) from dc_segment[9]
2023-07-28 02:24:17.601 [M: 116M, 11M,D: 717K] [DC: 57, 0] ( 0)begin sorting 9891 tuples
2023-07-28 02:24:17.602 [M: 116M, 11M,D: 615K] [DC: 57, 0] ( 0)finish sorting 9891 tuples
2023-07-28 02:24:17.602 [M: 116M, 11M,D: 615K] [DC: 57, 0] ( 1)begin sorting 9613 tuples
2023-07-28 02:24:17.603 [M: 116M, 11M,D: 512K] [DC: 57, 0] ( 1)finish sorting 9613 tuples
2023-07-28 02:24:17.603 [M: 116M, 11M,D: 512K] [DC: 57, 0] ( 2)begin sorting 9632 tuples
2023-07-28 02:24:17.605 [M: 116M, 11M,D: 410K] [DC: 57, 0] ( 2)finish sorting 9632 tuples
2023-07-28 02:24:17.605 [M: 116M, 11M,D: 410K] [DC: 57, 0] ( 3)begin sorting 10355 tuples
2023-07-28 02:24:17.606 [M: 116M, 11M,D: 308K] [DC: 57, 0] ( 3)finish sorting 10355 tuples
2023-07-28 02:24:17.611 [M: 116M, 11M,D: 308K] [DC: 57, 0] Finish rowid merge-sorting: 4 inputs, 39491 rows(time used: 0.055s)
2023-07-28 02:24:17.613 [M: 116M, 11M,D: 617K] [DC: 57, 0] Parallel join done. Merged tuple: 39491 rows
2023-07-28 02:24:17.614 [M: 116M, 224K,D: 308K] [DC: 57, 0] inner join(T1 - T2), using hash join, produced 39491 rows.
2023-07-28 02:24:17.615 [M: 116M, 224K,D: 308K] [DC: 57, 0] cnd(3) Done(time used: 0.122s)

#分组聚集(group)
聚集算法分两种:hash划分,round-robin划分;hash划分有两种one-path hash/multi-pass hash,数据不重复率小于10%时选择RR划分
2023-07-28 02:24:17.643 [M: 116M, 236K,D: 0B] [DC: 71, 0] BEGIN Parallel Aggregation(39491 rows)
2023-07-28 02:24:17.643 [M: 116M, 236K,D: 0B] [DC: 71, 0] GTBuff: total_size:67108864 has_dist:0 rows_limit:1 width:108
2023-07-28 02:24:17.643 [M: 116M, 236K,D: 0B] [DC: 71, 0] op buffer size: 67108864, tuple width: 48. op buffer can hold 1398101 rows
2023-07-28 02:24:17.643 [M: 116M, 236K,D: 0B] [DC: 71, 0] total tuples(per thread): 9872, tuples in op buffer(per thread): 349525
2023-07-28 02:24:17.644 [M: 116M, 236K,D: 0B] [DC: 71, 0] OP buffer big enough, do not use one-pass algorithm
2023-07-28 02:24:17.644 [M: 116M, 236K,D: 0B] [DC: 71, 0] begin distinct ratio sampling…
–自动评估数据不重复率日志
2023-07-28 02:24:17.769 [M: 116M, 236K,D: 0B] [DC: 80, 0] finish distinct ratio sampling: total 39491 rows; sampled 38987 rows, 4 DCs. NDV: 37789, 96%. (time used: 0.125s)
2023-07-28 02:24:17.776 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.776 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.776 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.776 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.777 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.777 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.777 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.777 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.777 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.777 [M: 116M, 236K,D: 0B] [DC: 80, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.777 [M: 116M, 236K,D: 0B] [DC: 80, 0] Begin parallel splitting for aggregation (split_type = 1)
–split_type=1:Multi-Pass hash; split_type=2:round-robin; split_type=3:One-Pass Hash
2023-07-28 02:24:17.778 [M: 116M, 236K,D: 231K] [DC: 80, 0] ( 0)GTBuff: total_size:16777216 has_dist:0 rows_limit:1 width:108
2023-07-28 02:24:17.779 [M: 116M, 373K,D: 231K] [DC: 82, 0] ( 3)GTBuff: total_size:16777216 has_dist:0 rows_limit:1 width:108
2023-07-28 02:24:17.780 [M: 116M, 510K,D: 231K] [DC: 82, 0] ( 2)GTBuff: total_size:16777216 has_dist:0 rows_limit:1 width:108
2023-07-28 02:24:17.781 [M: 116M, 645K,D: 231K] [DC: 83, 0] ( 1)GTBuff: total_size:16777216 has_dist:0 rows_limit:1 width:108
2023-07-28 02:24:17.802 [M: 116M, 780K,D: 231K] [DC: 89, 0] ( 0)split by hash already(39491 rows).
2023-07-28 02:24:17.804 [M: 116M, 780K,D: 231K] [DC: 89, 0] divide to 4 blocks(using hash[parallel]): 9974, 9789, 9921, 9807.
2023-07-28 02:24:17.804 [M: 116M, 780K,D: 231K] [DC: 89, 0] End parallel splitting for aggregation (split_type = 1)(time used: 0.027s)
2023-07-28 02:24:17.804 [M: 116M, 780K,D: 231K] [DC: 89, 0] ( 0)BEGIN Aggregation(9974 rows)
2023-07-28 02:24:17.805 [M: 116M, 1M,D: 231K] [DC: 89, 0] ( 0)GTBuff: total_size:16777216 has_dist:0 rows_limit:46205 width:108
2023-07-28 02:24:17.805 [M: 116M, 1M,D: 231K] [DC: 91, 0] ( 2)BEGIN Aggregation(9921 rows)
2023-07-28 02:24:17.805 [M: 116M, 1M,D: 231K] [DC: 91, 0] ( 3)BEGIN Aggregation(9807 rows)
2023-07-28 02:24:17.806 [M: 116M, 1M,D: 231K] [DC: 91, 0] ( 2)GTBuff: total_size:16777216 has_dist:0 rows_limit:46205 width:108
2023-07-28 02:24:17.806 [M: 116M, 2M,D: 231K] [DC: 91, 0] ( 3)GTBuff: total_size:16777216 has_dist:0 rows_limit:46205 width:108
2023-07-28 02:24:17.806 [M: 116M, 2M,D: 231K] [DC: 94, 0] ( 1)BEGIN Aggregation(9789 rows)
2023-07-28 02:24:17.807 [M: 116M, 2M,D: 231K] [DC: 96, 0] ( 1)GTBuff: total_size:16777216 has_dist:0 rows_limit:46205 width:108
2023-07-28 02:24:17.829 [M: 116M, 9M,D: 231K] [DC: 121, 0] ( 2)CalculatePageSize: TmpCacheSize = 33554432, no obj = 9619, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.833 [M: 119M, 9M,D: 231K] [DC: 125, 0] ( 0)CalculatePageSize: TmpCacheSize = 33554432, no obj = 9653, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.836 [M: 122M, 9M,D: 231K] [DC: 126, 0] ( 2)Commit 9618 result rows.
2023-07-28 02:24:17.836 [M: 122M, 9M,D: 231K] [DC: 127, 0] ( 2)CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.837 [M: 123M, 9M,D: 231K] [DC: 127, 0] ( 1)CalculatePageSize: TmpCacheSize = 33554432, no obj = 9491, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.840 [M: 124M, 9M,D: 231K] [DC: 128, 0] ( 0)Commit 9652 result rows.
2023-07-28 02:24:17.841 [M: 125M, 9M,D: 231K] [DC: 129, 0] ( 2)produced total 9618 groups.
2023-07-28 02:24:17.841 [M: 125M, 9M,D: 231K] [DC: 129, 0] ( 3)CalculatePageSize: TmpCacheSize = 33554432, no obj = 9520, attr count = 5, record size = 126, page size = 65536
2023-07-28 02:24:17.846 [M: 128M, 7M,D: 231K] [DC: 129, 0] ( 0)produced total 9652 groups.
2023-07-28 02:24:17.849 [M: 131M, 5M,D: 231K] [DC: 129, 0] ( 1)Commit 9490 result rows.
2023-07-28 02:24:17.854 [M: 132M, 5M,D: 231K] [DC: 129, 0] ( 3)Commit 9519 result rows.
2023-07-28 02:24:17.854 [M: 132M, 5M,D: 231K] [DC: 129, 0] ( 1)produced total 9490 groups.
2023-07-28 02:24:17.860 [M: 132M, 3M,D: 231K] [DC: 129, 0] ( 3)produced total 9519 groups.

2023-07-28 02:24:17.943 [M: 117M, 236K,D: 231K] [DC: 154, 0] produced total 38279 groups.
2023-07-28 02:24:17.943 [M: 117M, 236K,D: 231K] [DC: 154, 0] END Parallel Aggregation. (time used: 0.300s)

#排序(order)
排序共4种算法:OnePassSorter(quick sort)、MultiPassSorter(多趟算法)、CountingSorter(计数排序)、LimitSorter(堆排序)
2023-07-28 02:24:18.157 [M: 122M, 0B,D: 0B] [DC: 18, 5] BEGIN Sort(38279 rows)
2023-07-28 02:24:18.157 [M: 122M, 1K,D: 0B] [DC: 18, 5] limit sorter initialized, total_bytes: 94, key_bytes: 28.
2023-07-28 02:24:18.207 [M: 122M, 1K,D: 0B] [DC: 31, 5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 10, attr count = 6, record size = 168, page size = 65536
2023-07-28 02:24:18.219 [M: 125M, 1K,D: 0B] [DC: 31, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 0(LINK_INIT) DataSize: 205
2023-07-28 02:24:18.219 [M: 125M, 1K,D: 0B] [DC: 31, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : <<<< 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 1(LINK_INIT_ACK) DataSize: 19
2023-07-28 02:24:18.220 [M: 125M, 1K,D: 0B] [DC: 31, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 2(OPEN_TABLE) DataSize: 13
2023-07-28 02:24:18.221 [M: 125M, 1K,D: 0B] [DC: 31, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : <<<< 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 3(OPEN_TABLE_ACK) DataSize: 20
2023-07-28 02:24:18.221 [M: 125M, 1K,D: 0B] [DC: 31, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 4(GET_TABLE_INFO) DataSize: 8
2023-07-28 02:24:18.222 [M: 125M, 1K,D: 0B] [DC: 31, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : <<<< 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 5(BACK_TABLE_INFO) DataSize: 1213
2023-07-28 02:24:18.222 [M: 125M, 1K,D: 0B] [DC: 31, 5] Start send data to remote server.
2023-07-28 02:24:18.222 [M: 125M, 1K,D: 0B] [DC: 31, 5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 6, record size = 168, page size = 65536
2023-07-28 02:24:18.222 [M: 125M, 1K,D: 0B] [DC: 31, 5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 6, record size = 168, page size = 65536
2023-07-28 02:24:18.223 [M: 125M, 1K,D: 0B] [DC: 31, 5] gbase_hybrid_store: 1. NoTuplesEachDc: 10
2023-07-28 02:24:18.223 [M: 125M, 1K,D: 0B] [DC: 31, 5] Added new task: cur_pos:0 loat_pos:0 size:10 run_no_obj:10 dc:0
2023-07-28 02:24:18.223 [M: 125M, 1K,D: 0B] [DC: 31, 5] sis_task: HASH (0 - 10)
2023-07-28 02:24:18.223 [M: 125M, 1K,D: 0B] [DC: 35, 5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 0, attr count = 4, record size = 110, page size = 65536
2023-07-28 02:24:18.225 [M: 132M, 1K,D: 0B] [DC: 35, 5] [Memory Statistics (LOCAL)] PeakSize: 0, allocated: 0, used: 0, free: 0, peak_per_table: 0.
Query: SELECT /10.10.11.146_260_2_2023-07-28_02:24:17/ /*+ TID(‘196702’) */ _tmp_rht_2450197002_260_t17_1_1690421666_s_n1.c1 AS c6, _tmp_rht_2450197002_260_t17_1_1690421666_s_n1.c2 AS c7, _tmp_rht_2450197002_260_t17_1_1690421666_s_n1.c3 AS c8, cast((SUM_2ND(_tmp_rht_2450197002_260_t17_1_1690421666_s_n1.c4) / SUM_2ND(_tmp_rht_2450197002_260_t17_1_1690421666_s_n1.c5)) as decimal(19,6)) AS c9 FROM gctmpdb._tmp_rht_2450197002_260_t17_1_1690421666_s_n1 GROUP BY _tmp_rht_2450197002_260_t17_1_1690421666_s_n1.c1, _tmp_rht_2450197002_260_t17_1_1690421666_s_n1.c2, _tmp_rht_2450197002_260_t17_1_1690421666_s_n1.c3 ORDER BY c9 DESC, c6 ASC LIMIT 10 target INTO SERVER (content skipped)…
2023-07-28 02:24:18.225 [M: 132M, 1K,D: 0B] [DC: 35, 5] [DTS Statistics] Avg Batch Rows: 0
2023-07-28 02:24:18.225 [M: 132M, 1K,D: 0B] [DC: 35, 5] TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:18.225 [M: 132M, 1K,D: 0B] [DC: 35, 5] TqJob finish <<<<<<<<<<<<<<<<<<<
2023-07-28 02:24:18.226 [M: 127M, 1K,D: 0B] [DC: 36, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 6(TABLE_DATA) DataSize: 161 AppendId: -1 InfoLength: 0 DataLength: 145
2023-07-28 02:24:18.226 [M: 127M, 1K,D: 0B] [DC: 37, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 6(TABLE_DATA) DataSize: 383 AppendId: -1 InfoLength: 0 DataLength: 367
2023-07-28 02:24:18.227 [M: 127M, 1K,D: 0B] [DC: 38, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 6(TABLE_DATA) DataSize: 131 AppendId: -1 InfoLength: 0 DataLength: 115
2023-07-28 02:24:18.227 [M: 127M, 1K,D: 0B] [DC: 39, 5] src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 – SisHeader: SCN: 0 GroupID: 0 Cmd: 6(TABLE_DATA) DataSize: 295 AppendId: -1 InfoLength: 68 DataLength: 211
2023-07-28 02:24:18.227 [M: 127M, 1K,D: 0B] [DC: 39, 5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 4, record size = 110,

2023-07-28 02:24:18.227 [M: 122M, 1K,D: 0B] [DC: 39, 5] Complete send data to remote server.
2023-07-28 02:24:18.227 [M: 122M, 1K,D: 0B] [DC: 39, 5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 6, record size = 168, page size = 65536
2023-07-28 02:24:18.227 [M: 122M, 1K,D: 0B] [DC: 39, 5] END Sort. (time used: 0.070s)

#物化(materialize)
如果含group或order,在执行完输出的时候已经将结果物化,如果不含group或order,则单独执行物化的逻辑,即通过行号到对应的列中获得数据最后将查询命中的数据物化成一张表输出
2023-07-27 19:09:34.874 [M: 8K, 0B,D: 0B] [DC: 0, 0] BEGIN Materialization(6001215 rows, page size: 65536)
2023-07-27 19:09:34.874 [M: 8K, 0B,D: 0B] [DC: 0, 0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 10, attr count = 16, record size = 348, page size = 65536
2023-07-27 19:09:34.874 [M: 8K, 0B,D: 0B] [DC: 0, 0] need not materialize here, materialize later
2023-07-27 19:09:35.832 [M: 9M, 0B,D: 0B] [DC: 0, 16] Send 10 rows already
2023-07-27 19:09:35.832 [M: 9M, 0B,D: 0B] [DC: 0, 16] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 16, record size = 348, page size = 65536

#发送:将结果发送到目标接受端
2023-07-27 19:09:35.833 [M: 9M, 0B,D: 0B] [DC: 0, 16] ResultSender: send 0 rows.
2023-07-27 19:09:35.833 [M: 9M, 0B,D: 0B] [DC: 0, 16] output result done.

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值