COUNT(*) vs COUNT(col) 覆盖索引

COUNT(*) vs COUNT(col)

April 10, 2007 By  Peter Zaitsev  39 Comments

http://www.mysqlperformanceblog.com/2007/04/10/count-vs-countcol/

Looking at how people are using COUNT(*) and COUNT(col) it looks like most of them think they are synonyms and just using what they happen to like, while there is substantial difference in performance and even query result.

Lets look at the following series of examples:

CREATE TABLE `fact` (
  `i` int(10) unsigned NOT NULL,
  `val` int(11) default NULL,
  `val2` int(10) unsigned NOT NULL,
  KEY `i` (`i`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1

mysql> select count(*) from fact;
+----------+
| count(*) |
+----------+
|  7340032 |
+----------+
1 row in set (0.00 sec)

mysql> select count(val) from fact;
+------------+
| count(val) |
+------------+
|    7216582 |
+------------+
1 row in set (1.17 sec)

mysql> select count(val2) from fact;
+-------------+
| count(val2) |
+-------------+
|     7340032 |
+-------------+
1 row in set (0.00 sec)

As this is MYISAM table MySQL has cached number of rows in this table. This is why it is able to instantly answer COUNT(*) and

COUNT(val2) queries, but not COUNT(val). Why ? Because val column is not defined as NOT NULL there can be some NULL values in it and so MySQL have to perform table scan to find out. This is also why result is different for the second query.

So COUNT(*) and COUNT(col) queries not only could have substantial performance performance differences but also ask different question.

MySQL Optimizer does good job in this case doing full table scan only if it is needed because column can be NULL.

Now lets try few more queries:

mysql> select count(*) from fact where i<10000;
+----------+
| count(*) |
+----------+
|   733444 |
+----------+
1 row in set (0.40 sec)

mysql> explain select count(*) from fact where i<10000 \G
*************************** 1. row ***************************
           id: 1
  select_type: SIMPLE
        table: fact
         type: range
possible_keys: i
          key: i
      key_len: 4
          ref: NULL
         rows: 691619
        Extra: Using where; Using index
1 row in set (0.00 sec)

mysql> select count(val) from fact where i<10000;
+------------+
| count(val) |
+------------+
|     720934 |
+------------+
1 row in set (1.29 sec)

mysql> explain select count(val) from fact where i<10000 \G
*************************** 1. row ***************************
           id: 1
  select_type: SIMPLE
        table: fact
         type: range
possible_keys: i
          key: i
      key_len: 4
          ref: NULL
         rows: 691619
        Extra: Using where
1 row in set (0.00 sec)

mysql> select count(val2) from fact where i<10000;
+-------------+
| count(val2) |
+-------------+
|      733444 |
+-------------+
1 row in set (1.30 sec)

mysql> explain select count(val2) from fact where i<10000 \G
*************************** 1. row ***************************
           id: 1
  select_type: SIMPLE
        table: fact
         type: range
possible_keys: i
          key: i
      key_len: 4
          ref: NULL
         rows: 691619
        Extra: Using where
1 row in set (0.00 sec)

As you can see even if you have where clause performance for count(*) and count(col) can be significantly different. In fact this example shows just 3 times performance difference because all data fits in memory, for IO bound workloads you frequently can see 10 and even 100 times performance difference in this case.

The thing is count(*) query can use covering index even while count(col) can't. Of course you can extend index to be (i,val) and get query to be index covered again but I would use this workaround only if you can't change the query (ie it is third party application) or in case column name is in the query for reason, and you really need count of non-NULL values.

It is worth to note in this case MySQL Optimizer does not do too good job optimizing the query. One could notice (val2) column is not null so count(val2) is same as count(*) and so the query could be run as index covered query. It does not and both queries have to perform row reads in this case.

mysql> alter table fact drop key i, add key(i,val);
Query OK, 7340032 rows affected (37.15 sec)
Records: 7340032  Duplicates: 0  Warnings: 0

mysql> select count(val) from fact where i<10000;
+------------+
| count(val) |
+------------+
|     720934 |
+------------+
1 row in set (0.78 sec)

As you can see extending index helps in this case but it makes query about 2 times slower compared to count(*) one. This is probably because index becomes about two times longer in this case.