fullscan mysql_通过案例学调优之--IndexFULLSCAN和IndexFASTFULLSCAN

最新推荐文章于 2023-04-12 14:34:06 发布

伶邪

最新推荐文章于 2023-04-12 14:34:06 发布

阅读量586

点赞数

文章标签： fullscan mysql

本文链接：https://blog.csdn.net/weixin_36018748/article/details/113433741

版权

通过案例学调优之--Index FULL SCAN和Index FAST FULL SCAN Index FULL SCAN 和 ndex FAST FULL SCAN工作原理： Index FULL SCAN 和I ndex FAST FULL SCAN 的适用情况：适用于我们想选择的列都包含在索引里边时，这时候就可以使用IFS或者FFS来代替全表扫描来

通过案例学调优之--Index FULL SCAN和Index FAST FULL SCAN

Index FULL SCAN 和ndex FAST FULL SCAN工作原理：

Index FULL SCAN 和Index FAST FULL SCAN的适用情况：适用于我们想选择的列都包含在索引里边时，这时候就可以使用IFS或者FFS来代替全表扫描来得到想要的结果。

INDEX FULL SCAN：HINT写法：INDEX(表名索引名)原理：ORACLE定位到索引的ROOT BLOCK，然后到BRANCH BLOCK(如果有的话)，再定位到第一个LEAF BLOCK, 然后根据LEAF BLOCK的双向链表顺序读取。它所读取的块都是有顺序的，也是经过排序的。INDEX FAST FULL SCAN：HINT写法：INDEX_FFS(表名索引名)原理：从段头开始，读取包含位图块，ROOT BLOCK，所有的BRANCH BLOCK，LEAF BLOCK，读取的顺序完全有物理存储位置决定，并采取多块读，每次读取DB_FILE_MULTIBLOCK_READ_COUNT个块。查询某个表记录总数的时候，往往基于PRIMARY KEY的INDEX FAST FULL SCAN是最有效的。

Fast Full Index Scans :Fast full index scans are an alternative to a full table scan when the index contains all the columns that are needed for the query, and at least one column in the index key has the NOT NULL constraint. A fast full scan accesses the data in the index itself, without accessing the table. It cannot be used to eliminate a sort operation, because the data is not ordered by the index key. It reads the entire index using multiblock reads, unlike a full index scan, and can be parallelized.

Fast full scan is available only with the CBO. You can specify it with the initialization parameter OPTIMIZER_FEATURES_ENABLE or the INDEX_FFS hint. Fast full index scans cannot be performed against bitmap indexes.

A fast full scan is faster than a normal full index scan in that it can use multiblock I/O and can be parallelized just like a table scan.

http://download-west.oracle.com/doc…imops.htm#51111

Full Table Scans :

This type of scan reads all rows from a table and filters out those that do not meet the selection criteria. During a full table scan, all blocks in the table that are under the high water mark are scanned. Each row is examined to determine whether it satisfies the statement’s WHERE clause.

When Oracle performs a full table scan, the blocks are read sequentially. Because the blocks are adjacent, I/O calls larger than a single block can be used to speed up the process. The size of the read calls range from one block to the number of blocks indicated by the initialization parameter DB_FILE_MULTIBLOCK_READ_COUNT. Using multiblock reads means a full table scan can be performed very efficiently. Each block is read only once.

http://download-west.oracle.com/doc…imops.htm#44852

案例分析：

1、创建表和索引

16:02:10 SYS@ prod >create table t as select * from dba_objects where 1=2;

Table created.

16:05:43 SYS@ prod >insert into t select * from dba_objects where object_id is not null;

73025 rows created.

16:06:46 SYS@ prod >select count(*) from t;

COUNT(*)

----------

73025

16:06:56 SYS@ prod >commit;

Commit complete.

16:13:48 SYS@ prod >exec dbms_stats.gather_table_stats('SYS','T',cascade=>true);

PL/SQL procedure successfully completed.

16:14:33 SYS@ prod >set autotrace trace

16:15:32 SYS@ prod >select object_id from t;

73025 rows selected.

Execution Plan

----------------------------------------------------------

Plan hash value: 1601196873

--------------------------------------------------------------------------

--------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 73025 | 356K| 284 (1)| 00:00:04 |

| 1 | TABLE ACCESS FULL| T | 73025 | 356K| 284 (1)| 00:00:04 |

--------------------------------------------------------------------------

Statistics

----------------------------------------------------------

141 recursive calls

0 db block gets

5857 consistent gets

1038 physical reads

0 redo size

1060958 bytes sent via SQL*Net to client

53963 bytes received via SQL*Net from client

4870 SQL*Net roundtrips to/from client

4 sorts (memory)

0 sorts (disk)

73025 rows processed

从上面的执行计划中可知，此时走了全表扫描。

--由于我们需要查询的列为object_id，因此理论上只需要读取索引就应该可以返回所有数据，而此时为什么是全表扫描呢？

--这是因为NULL值与索引的特性所决定的。即null值不会被存储到B树索引。因此应该为表 t 的列 object_id 添加 not null 约束。

16:16:14 SYS@ prod >desc t;

Name Null? Type

----------------------------------------------------------------- -------- --------------------------------------------

OWNER VARCHAR2(30)

OBJECT_NAME VARCHAR2(128)

SUBOBJECT_NAME VARCHAR2(30)

OBJECT_ID NUMBER

DATA_OBJECT_ID NUMBER

OBJECT_TYPE VARCHAR2(19)

CREATED DATE

LAST_DDL_TIME DATE

TIMESTAMP VARCHAR2(19)

STATUS VARCHAR2(7)

TEMPORARY VARCHAR2(1)

GENERATED VARCHAR2(1)

SECONDARY VARCHAR2(1)

NAMESPACE NUMBER

EDITION_NAME VARCHAR2(30)

在object_id上添加not null约束

16:16:42 SYS@ prod >alter table t modify(object_id not null);

Table altered.

Elapsed: 00:00:00.34

16:16:46 SYS@ prod >desc t

Name Null? Type

----------------------------------------------------------------- -------- --------------------------------------------

OWNER VARCHAR2(30)

OBJECT_NAME VARCHAR2(128)

SUBOBJECT_NAME VARCHAR2(30)

OBJECT_ID NOT NULL NUMBER

DATA_OBJECT_ID NUMBER

OBJECT_TYPE VARCHAR2(19)

CREATED DATE

LAST_DDL_TIME DATE

TIMESTAMP VARCHAR2(19)

STATUS VARCHAR2(7)

TEMPORARY VARCHAR2(1)

GENERATED VARCHAR2(1)

SECONDARY VARCHAR2(1)

NAMESPACE NUMBER

EDITION_NAME VARCHAR2(30)

2、对Index_FS和Index_FFS对比

16:16:49 SYS@ prod >select object_id from t;

73025 rows selected.

Execution Plan

----------------------------------------------------------

Plan hash value: 1220328745

-----------------------------------------------------------------------------

-----------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 73025 | 356K| 46 (0)| 00:00:01 |

| 1 | INDEX FAST FULL SCAN| T_ID | 73025 | 356K| 46 (0)| 00:00:01 |

-----------------------------------------------------------------------------

Statistics

----------------------------------------------------------

1 recursive calls

0 db block gets

5028 consistent gets

0 physical reads

0 redo size

1060958 bytes sent via SQL*Net to client

53963 bytes received via SQL*Net from client

4870 SQL*Net roundtrips to/from client

0 sorts (memory)

0 sorts (disk)

73025 rows processed

16:17:20 SYS@ prod >select * from t;

73025 rows selected.

Elapsed: 00:00:01.99

Execution Plan

----------------------------------------------------------

Plan hash value: 1601196873

--------------------------------------------------------------------------

--------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 73025 | 6917K| 284 (1)| 00:00:04 |

| 1 | TABLE ACCESS FULL| T | 73025 | 6917K| 284 (1)| 00:00:04 |

--------------------------------------------------------------------------

Statistics

----------------------------------------------------------

284 recursive calls

0 db block gets

5885 consistent gets

27 physical reads

0 redo size

8096826 bytes sent via SQL*Net to client

53963 bytes received via SQL*Net from client

4870 SQL*Net roundtrips to/from client

0 sorts (memory)

0 sorts (disk)

73025 rows processed

16:20:19 SYS@ prod >select /*+ index(t t_id) */ object_id from t;

73025 rows selected.

Elapsed: 00:00:00.56

Execution Plan

----------------------------------------------------------

Plan hash value: 2842924753

-------------------------------------------------------------------------

-------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 73025 | 356K| 163 (0)| 00:00:02 |

| 1 | INDEX FULL SCAN | T_ID | 73025 | 356K| 163 (0)| 00:00:02 |

-------------------------------------------------------------------------

Statistics

----------------------------------------------------------

1 recursive calls

0 db block gets

5021 consistent gets

0 physical reads

0 redo size

1060958 bytes sent via SQL*Net to client

53963 bytes received via SQL*Net from client

4870 SQL*Net roundtrips to/from client

0 sorts (memory)

0 sorts (disk)

73025 rows processed

从以上(full table，index full scan，index fast full scan)付出的cost进行比较，index_ffs的cost最小(46)

3、在对查询做排序时对比16:20:48 SYS@ prod >select object_id from t order by object_id ;

73025 rows selected.

Execution Plan

----------------------------------------------------------

Plan hash value: 2842924753

-------------------------------------------------------------------------

-------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 73025 | 356K| 163 (0)| 00:00:02 |

| 1 | INDEX FULL SCAN | T_ID | 73025 | 356K| 163 (0)| 00:00:02 |

-------------------------------------------------------------------------

Statistics

----------------------------------------------------------

1 recursive calls

0 db block gets

5021 consistent gets

0 physical reads

0 redo size

1060958 bytes sent via SQL*Net to client

53963 bytes received via SQL*Net from client

4870 SQL*Net roundtrips to/from client

0 sorts (memory)

0 sorts (disk)

73025 rows processed

16:21:28 SYS@ prod >select /*+ index_ffs(t t_id) */ object_id from t order by object_id;

73025 rows selected.

Execution Plan

----------------------------------------------------------

Plan hash value: 2317820129

--------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 73025 | 356K| | 271 (2)| 00:00:04 |

| 1 | SORT ORDER BY | | 73025 | 356K| 872K| 271 (2)| 00:00:04 |

| 2 | INDEX FAST FULL SCAN| T_ID | 73025 | 356K| | 46 (0)| 00:00:01 |

--------------------------------------------------------------------------------------

Statistics

----------------------------------------------------------

1 recursive calls

0 db block gets

170 consistent gets

0 physical reads

0 redo size

1060958 bytes sent via SQL*Net to client

53963 bytes received via SQL*Net from client

4870 SQL*Net roundtrips to/from client

1 sorts (memory)

0 sorts (disk)

73025 rows processed

16:23:02 SYS@ prod >select /*+ full(t) */ object_id from t order by object_id;

73025 rows selected.

Execution Plan

----------------------------------------------------------

Plan hash value: 961378228

-----------------------------------------------------------------------------------

-----------------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 73025 | 356K| | 508 (1)| 00:00:07 |

| 1 | SORT ORDER BY | | 73025 | 356K| 872K| 508 (1)| 00:00:07 |

| 2 | TABLE ACCESS FULL| T | 73025 | 356K| | 284 (1)| 00:00:04 |

-----------------------------------------------------------------------------------

Statistics

----------------------------------------------------------

1 recursive calls

0 db block gets

1043 consistent gets

32 physical reads

0 redo size

1060958 bytes sent via SQL*Net to client

53963 bytes received via SQL*Net from client

4870 SQL*Net roundtrips to/from client

1 sorts (memory)

0 sorts (disk)

73025 rows processed

从上面的执行计划中可以看出，只要是涉及到排序操作，Oracle会毫不犹豫地选择INDEX FULL SCAN，因为INDEX FULL SCAN方式扫描一定是按创建索引是的方式来排序的。

4、对index_fs 和 index_ffs查看traceINDEX_FS:

16:45:24 sys@ prod >alter session set events '10046 trace name context forever,level 12';

16:32:34 sys@ prod >set autotrace trace

16:31:42 sys@ prod >select /*+ index (t t_id) */ object_id from t;

Execution Plan

----------------------------------------------------------

Plan hash value: 2842924753

-------------------------------------------------------------------------

-------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 19 | 247 | 1 (0)| 00:00:01 |

| 1 | INDEX FULL SCAN | T_ID | 19 | 247 | 1 (0)| 00:00:01 |

-------------------------------------------------------------------------

Note

-----

- dynamic sampling used for this statement (level=2)

Statistics

----------------------------------------------------------

0 recursive calls

0 db block gets

3 consistent gets

0 physical reads

0 redo size

753 bytes sent via SQL*Net to client

426 bytes received via SQL*Net from client

3 SQL*Net roundtrips to/from client

0 sorts (memory)

0 sorts (disk)

19 rows processed

16:33:00 sys@ prod >alter session set events '10046 trace name context off';

Session altered.

查看trace文件内容(节选)

select /* index(t t_id) */ object_id from t

END OF STMT

PARSE #4:c=5000,e=5235,p=7,cr=9,cu=0,mis=1,r=0,dep=0,og=1,plh=2842924753,tim=1416818316519023

EXEC #4:c=0,e=25,p=0,cr=0,cu=0,mis=0,r=0,dep=0,og=1,plh=2842924753,tim=1416818316519139

WAIT #4: nam='SQL*Net message to client' ela= 3 driver id=1650815232 #bytes=1 p3=0 obj#=76546 tim=1416818316519211

WAIT #4: nam='db file sequential read' ela= 0 file#=4 block#=139 blocks=1 obj#=76547 tim=1416818316519280

FETCH #4:c=999,e=58,p=1,cr=1,cu=0,mis=0,r=1,dep=0,og=1,plh=2842924753,tim=1416818316519303

16:44:09 SYS@ prod >select object_name,object_id,object_type from dba_objects

16:44:30 2 where object_id='76547';

OBJECT_NAME OBJECT_ID OBJECT_TYPE

-------------------- ---------- -------------------

T_ID 76547 INDEX

WAIT #4: nam='db file sequential read'，在T_ID的index上，产生了单块读得wait。

INDEX_FFS:

16:45:24 sys@ prod >alter session set events '10046 trace name context forever,level 12';

Session altered.

16:46:10 SCOTT@ prod >set autotrace trace

16:46:16 SCOTT@ prod >select /*+ index_ffs(t t_id) */ object_id from t

19 rows selected.

Execution Plan

----------------------------------------------------------

Plan hash value: 1220328745

-----------------------------------------------------------------------------

-----------------------------------------------------------------------------

| 0 | SELECT STATEMENT | | 19 | 247 | 2 (0)| 00:00:01 |

| 1 | INDEX FAST FULL SCAN| T_ID | 19 | 247 | 2 (0)| 00:00:01 |

-----------------------------------------------------------------------------

Note

-----

- dynamic sampling used for this statement (level=2)

Statistics

----------------------------------------------------------

0 recursive calls

0 db block gets

6 consistent gets

0 physical reads

0 redo size

753 bytes sent via SQL*Net to client

426 bytes received via SQL*Net from client

3 SQL*Net roundtrips to/from client

0 sorts (memory)

0 sorts (disk)

19 rows processed

16:46:17 SCOTT@ prod >alter session set events '10046 trace name context off';

Session altered.

查看trace文件内容(节选)

select /*+ index_ffs(t t_id) */ object_id from t

END OF STMT

PARSE #19:c=1000,e=1050,p=0,cr=0,cu=0,mis=1,r=0,dep=0,og=1,plh=1220328745,tim=1416818962627696

EXEC #19:c=0,e=28,p=0,cr=0,cu=0,mis=0,r=0,dep=0,og=1,plh=1220328745,tim=1416818962627788

WAIT #19: nam='SQL*Net message to client' ela= 3 driver id=1650815232 #bytes=1 p3=0 obj#=19 tim=1416818962627824

WAIT #19: nam='db file sequential read' ela= 10 file#=1 block#=91000 blocks=1 obj#=76545 tim=1416818962627888

WAIT #19: nam='db file scattered read' ela= 20 file#=1 block#=91001 blocks=7 obj#=76545 tim=1416818962627977

FETCH #19:c=0,e=181,p=8,cr=8,cu=0,mis=0,r=1,dep=0,og=1,plh=1220328745,tim=1416818962628030

WAIT #19: nam='SQL*Net message from client' ela= 235 driver id=1650815232 #bytes=1 p3=0 obj#=76545 tim=1416818962630284

16:53:45 SYS@ prod >select object_name,object_type,object_id from dba_objects

16:54:02 2 where object_id=76545;

OBJECT_NAME OBJECT_TYPE OBJECT_ID

-------------------- ------------------- ----------

T_ID INDEX 76545

WAIT #19: nam='db file sequential read' block#=91000 blocks=1 ,对索引段的头部块，做了单块读

WAIT #19: nam='db file scattered read' block#=91001 blocks=7，对index的其余的块，做了多块的读取

进一步验证：

1)查看T_ID索引段分配的block，其中block#91000为段头块

16:55:12 SYS@ prod >col segment_name for a20

16:55:18 SYS@ prod >select segment_name,segment_type,file_id,block_id,blocks from dba_extents

16:55:50 2 where segment_name='T_ID' and owner='SYS';

SEGMENT_NAME SEGMENT_TYPE FILE_ID BLOCK_ID BLOCKS

-------------------- ------------------ ---------- ---------- ----------

T_ID INDEX 1 91000 8

T_ID INDEX 1 92032 8

T_ID INDEX 1 92040 8

T_ID INDEX 1 92048 8

T_ID INDEX 1 92056 8

T_ID INDEX 1 92064 8

T_ID INDEX 1 92072 8

T_ID INDEX 1 92080 8

T_ID INDEX 1 92088 8

T_ID INDEX 1 92096 8

T_ID INDEX 1 92104 8

T_ID INDEX 1 92112 8

T_ID INDEX 1 92120 8

T_ID INDEX 1 92128 8

T_ID INDEX 1 92136 8

T_ID INDEX 1 92144 8

T_ID INDEX 1 92160 128

17 rows selected.

2)对block#91000做dump

16:56:19 SYS@ prod >alter system dump datafile 1 block 91000;

System altered.

[oracle@RH6 ~]$ more /u01/app/oracle/diag/rdbms/prod/prod/trace/prod_ora_3415.trc

Trace file /u01/app/oracle/diag/rdbms/prod/prod/trace/prod_ora_3415.trc

Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production

With the Partitioning, OLAP, Data Mining and Real Application Testing options

ORACLE_HOME = /u01/app/oracle/product/11.2.0/db_1

System name: Linux

Node name: RH6

Release: 2.6.32-71.el6.i686

Version: #1 SMP Wed Sep 1 01:26:34 EDT 2010

Machine: i686

Instance name: prod

Redo thread mounted by this instance: 1

Oracle process number: 17

Unix process pid: 3415, image: oracle@RH6 (TNS V1-V3)

*** 2014-11-24 16:57:55.182

*** SESSION ID:(45.143) 2014-11-24 16:57:55.182

*** CLIENT ID:() 2014-11-24 16:57:55.182

*** SERVICE NAME:(SYS$USERS) 2014-11-24 16:57:55.182

*** MODULE NAME:(sqlplus@RH6 (TNS V1-V3)) 2014-11-24 16:57:55.182

*** ACTION NAME:() 2014-11-24 16:57:55.182

Start dump data blocks tsn: 0 file#:1 minblk 91000 maxblk 91000

Block dump from cache:

Dump of buffer cache at level 4 for tsn=0, rdba=4285304

BH (0x28beb940) file#: 1 rdba: 0x00416378 (1/91000) class: 4 ba: 0x28974000

set: 3 pool 3 bsz: 8192 bsi: 0 sflg: 1 pwc: 0,19

dbwrid: 0 obj: 76545 objn: 76545 tsn: 0 afn: 1 hint: f

hash: [0x32a97bd0,0x32a97bd0] lru: [0x27fe9a74,0x287ef23c]

ckptq: [NULL] fileq: [NULL] objq: [0x30baa69c,0x287ef254]

st: XCURRENT md: NULL tch: 3

flags:

LRBA: [0x0.0.0] LSCN: [0x0.0] HSCN: [0xffff.ffffffff] HSUB: [65535]

cr pin refcnt: 0 sh pin refcnt: 0

Block dump from disk:

buffer tsn: 0 rdba: 0x00416378 (1/91000)

scn: 0x0000.00811496 seq: 0x02 flg: 0x04 tail: 0x14961002

frmt: 0x02 chkval: 0xaa58 type: 0x10=DATA SEGMENT HEADER - UNLIMITED

Hex dump of block: st=0, typ_found=1

Dump of memory from 0x00E49600 to 0x00E4B600

E49600 0000A210 00416378 00811496 04020000 [....xcA.........]

E49610 0000AA58 00000000 00000000 00000000 [X...............]

E49620 00000000 00000011 000000FF 00001020 [............ ...]

E49630 00000010 00000024 00000080 00416824 [....$.......$hA.]

E49640 00000000 00000010 00000000 000000A3 [................]

E49650 00000000 00000000 00000000 00000011 [................]

E49660 00000000 00012B01 40000000 00416379 [.....+.....@ycA.]

E49670 00000007 00416780 00000008 00416788 [.....gA......gA.]

E49680 00000008 00416790 00000008 00416798 [.....gA......gA.]

E49690 00000008 004167A0 00000008 004167A8 [.....gA......gA.]

E496A0 00000008 004167B0 00000008 004167B8 [.....gA......gA.]

E496B0 00000008 004167C0 00000008 004167C8 [.....gA......gA.]

E496C0 00000008 004167D0 00000008 004167D8 [.....gA......gA.]

E496D0 00000008 004167E0 00000008 004167E8 [.....gA......gA.]

E496E0 00000008 004167F0 00000008 00416800 [.....gA......hA.]

E496F0 00000080 00000000 00000000 00000000 [................]

E49700 00000000 00000000 00000000 00000000 [................]

Repeat 242 times

E4A630 00000000 00010000 00020001 00000000 [................]

E4A640 00000000 00000000 00000000 00000000 [................]

Repeat 250 times

E4B5F0 00000000 00000000 00000000 14961002 [................]

Extent Control Header

-----------------------------------------------------------------

Extent Header:: spare1: 0 spare2: 0 #extents: 17 #blocks: 255

last map 0x00000000 #maps: 0 offset: 4128

Highwater:: 0x00416824 ext#: 16 blk#: 36 ext size: 128

#blocks in seg. hdr's freelists: 0

#blocks below: 163

mapblk 0x00000000 offset: 16

Unlocked

Map Header:: next 0x00000000 #extents: 17 obj#: 76545 flag: 0x40000000

Extent Map

-----------------------------------------------------------------

0x00416379 length: 7

0x00416780 length: 8

0x00416788 length: 8

0x00416790 length: 8

0x00

本文原创发布php中文网，转载请注明出处，感谢您的尊重！

伶邪

关注

0
点赞
踩
1

收藏

觉得还不错? 一键收藏
0
评论
fullscan mysql_通过案例学调优之--IndexFULLSCAN和IndexFASTFULLSCAN

通过案例学调优之--Index FULL SCAN和Index FAST FULL SCAN Index FULL SCAN 和 ndex FAST FULL SCAN工作原理： Index FULL SCAN 和I ndex FAST FULL SCAN 的适用情况：适用于我们想选择的列都包含在索引里边时，这时候就可以使用IFS或者FFS来代替全表扫描来通过案例学调优之--Index FULL ...
复制链接

扫一扫