查询统计信息占用了99%的查询时间

时间:2013-10-30 18:58:07

标签: mysql sql phpmyadmin entity-attribute-value

我有一个SQL查询,执行大约需要1.81秒。我在phpMyAdmin中对它进行了分析,并且我看到99%的时间用于“统计”。

有趣的是,如果我再添加一个连接,时间会增加到大约23秒,如果我删除1个连接,则时间会减少到大约0.26秒。

我试图将product_id = 放在联接中attribute_id = 的位置。它没有改善性能,“统计”仍然占用了99%的时间。

我尝试group by p.id确实提高了性能,但“统计数据”仍然使用了98%的时间。

有没有办法改善“统计”效果或只是禁用它?

注意:我的所有PK / FK都有索引。

有用的信息

sqlfiddle here

查询返回约150行。

ss_product table has 1k rows
ss_product_attributes has 30 rows
ss_product_attribute_varchars has 5000 rows
ss_product_attribute_decimals has 10000 rows

架构

ss_products has many ss_product_attribute_varchars
ss_products has many ss_product_attribute_decimals
ss_product_attribute_varchars belongs to ss_product_attributes
ss_product_attribute_decimals belongs to ss_product_attributes

-------------
-ss_products-
-------------
- PK - id   -
-------------

--------------------------------
-ss_product_attribute_varchars-
--------------------------------
- PK - id                      -
- FK - product_id              -
- FK - attribute_id            -
--------------------------------

--------------------------------
-ss_products_attribute_decimals-
--------------------------------
- PK - id                      -
- FK - product_id              -
- FK - attribute_id            -
--------------------------------

------------------------
-ss_products_attributes-
------------------------
- PK - id              -
------------------------

分析

Starting                 101 µs
Checking Permissions     6 µs
Checking Permissions     2 µs
Checking Permissions     2 µs
Checking Permissions     2 µs
Checking Permissions     1 µs
Checking Permissions     2 µs
Checking Permissions     2 µs
Checking Permissions     2 µs
Checking Permissions     2 µs
Checking Permissions     3 µs
Opening Tables           47 µs
System Lock              10 µs
Init                     35 µs
Optimizing               21 µs
Statistics               1.8 s      //1.8seconds!!!!
Preparing                46 µs
Executing                3 µs
Sending Data             41 ms
End                      7 µs
Query End                4 µs
Closing Tables           12 µs
Freeing Items            463 µs
Logging Slow Query       3 µs
Cleaning Up              9 µs

查询

select
    aa.value as attribute_a,
    bb.value as attribute_b,
    cc.value as attribute_c,
    dd.value as attribute_d,
    ee.value as attribute_e,
    ff.value as attribute_f,
    gg.value as attribute_g,
    hh.value as attribute_h,
    ii.value as attribute_i
from ss_products as p
    inner join ss_product_attribute_varchars as aa
    on p.id = aa.product_id
    inner join ss_product_attribute_varchars as bb
    on p.id = bb.product_id
    inner join ss_product_attribute_varchars as cc
    on p.id = cc.product_id
    inner join ss_product_attribute_decimals as dd
    on p.id = dd.product_id
    inner join ss_product_attribute_decimals as ee
    on p.id = ee.product_id
    inner join ss_product_attribute_decimals as ff
    on p.id = ff.product_id
    inner join ss_product_attribute_varchars as gg
    on p.id = gg.product_id
    INNER JOIN ss_product_attribute_varchars AS hh 
    ON p.id = hh.product_id 
    INNER JOIN ss_product_attribute_varchars AS ii 
    ON p.id = ii.product_id 
where 
    aa.attribute_id = 8 AND 
    bb.attribute_id = 6 AND 
    cc.attribute_id = 7 AND 
    dd.attribute_id = 9 and
    ee.attribute_id = 10 and
    ff.attribute_id = 11 AND
    gg.attribute_id = 20 AND 
    hh.attribute_id = 2 AND
    ii.attribute_id = 3

解释

id| select_type| table  | type   | possible_keys                                         |key                                          |key_len| ref                 | rows| Extra
1 | SIMPLE     | gg     | ref    | fk_product_attribute_varchars_products1_idx,fk_pro... | attribute_id                                | 4     | const               | 143 |
1 | SIMPLE     | aa     | ref    | fk_product_attribute_varchars_products1_idx,fk_pro... | fk_product_attribute_varchars_products1_idx | 4     | my_id.gg.product_id | 2   | Using where
1 | SIMPLE     | cc     | ref    | fk_product_attribute_varchars_products1_idx,fk_pro... | fk_product_attribute_varchars_products1_idx | 4     | my_id.gg.product_id | 2   | Using where
1 | SIMPLE     | bb     | ref    | fk_product_attribute_varchars_products1_idx,fk_pro... | fk_product_attribute_varchars_products1_idx | 4     | my_id.gg.product_id | 2   | Using where
1 | SIMPLE     | ii     | ref    | fk_product_attribute_varchars_products1_idx,fk_pro... | fk_product_attribute_varchars_products1_idx | 4     | my_id.aa.product_id | 2   | Using where
1 | SIMPLE     | p      | eq_ref | PRIMARY                                               | PRIMARY                                     | 4     | my_id.aa.product_id | 1   | Using where; Using index
1 | SIMPLE     | dd     | ref    | fk_product_attribute_decimals_products1_idx,fk_pro... | fk_product_attribute_decimals_products1_idx | 4     | my_id.cc.product_id | 2   | Using where
1 | SIMPLE     | ee     | ref    | fk_product_attribute_decimals_products1_idx,fk_pro... | fk_product_attribute_decimals_products1_idx | 4     | my_id.ii.product_id | 2   | Using where
1 | SIMPLE     | ff     | ref    | fk_product_attribute_decimals_products1_idx,fk_pro... | fk_product_attribute_decimals_products1_idx | 4     | my_id.p.id          | 2   | Using where
1 | SIMPLE     | hh     | ref    | fk_product_attribute_varchars_products1_idx,fk_pro... | fk_product_attribute_varchars_products1_idx | 4     | my_id.cc.product_id | 2   | Using where

完整档案(由Raymond Nijland提出)

+----------------------+----------+----------+------------+-------------------+---------------------+--------------+---------------+---------------+-------------------+-------------------+-------------------+-------+-----------------+---------------+-------------+
| Status               | Duration | CPU_user | CPU_system | Context_voluntary | Context_involuntary | Block_ops_in | Block_ops_out | Messages_sent | Messages_received | Page_faults_major | Page_faults_minor | Swaps | Source_function | Source_file   | Source_line |
+----------------------+----------+----------+------------+-------------------+---------------------+--------------+---------------+---------------+-------------------+-------------------+-------------------+-------+-----------------+---------------+-------------+
| starting             | 0.000151 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | NULL            | NULL          |        NULL |
| checking permissions | 0.000005 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000002 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000003 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000002 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000003 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000002 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000005 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000002 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000002 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| checking permissions | 0.000005 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4751 |
| Opening tables       | 0.000051 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_base.cc   |        4838 |
| System lock          | 0.000016 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | lock.cc       |         299 |
| init                 | 0.000046 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_select.cc |        2560 |
| optimizing           | 0.000031 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_select.cc |         869 |
| statistics           | 1.419911 | 1.404009 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_select.cc |        1060 |
| preparing            | 0.000050 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_select.cc |        1082 |
| executing            | 0.000003 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_select.cc |        1829 |
| Sending data         | 0.018508 | 0.015600 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_select.cc |        2371 |
| end                  | 0.000007 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_select.cc |        2596 |
| query end            | 0.000004 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4440 |
| closing tables       | 0.000018 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        4492 |
| freeing items        | 0.000110 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        5640 |
| logging slow query   | 0.000004 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        1461 |
| cleaning up          | 0.000008 | 0.000000 |   0.000000 |              NULL |                NULL |         NULL |          NULL |          NULL |            NULL |              NULL |              NULL |  NULL | <unknown>       | sql_parse.cc  |        1417 |
+----------------------+----------+----------+------------+-------------------+---------------------+--------------+---------------+---------------+------------------+-------------------+-------------------+-------+-----------------+---------------+-------------+

1 个答案:

答案 0 :(得分:2)

作出答案,因为评论会支持代码格式化。

配置文件输出中的统计信息在此部分中在MySQL的C ++源代码中定义

 /* Calculate how to do the join */
thd_proc_info(thd, "statistics");
if (make_join_statistics(this, select_lex->leaf_tables, conds, &keyuse) ||
thd->is_fatal_error)
{
DBUG_PRINT("error",("Error: make_join_statistics() failed"));
DBUG_RETURN(1);
}

但你仍然需要运行

SHOW PROFILE ALL FOR QUERY n

因此,我们可以看到查询是CPU还是磁盘I / O限制。

我建议使用UNION ALL或使用分而治之的策略来分隔查询