由于JOIN / WHERE过滤器较小,PostgreSQL Select语句非常慢

时间:2013-04-10 14:46:38

标签: php postgresql doctrine-orm

2013-05-29:更新了最新配置和额外信息的问题。之前我在虚拟机映像中进行测试。现在我在高效的服务器上进行测试,它更好地反映了现实世界。问题现在应该完全清楚。如果您以前曾帮助我,请仔细阅读

目前我发现PostgreSQL中的查询速度非常慢,但我不明白它的速度有多慢。我把它缩小了一点,所以它在这里发布要小得多(而且速度要快得多,但仍然很慢!)。

背景知识:在这个项目中,我有属于用户的广告。用户是该国家/地区的一部分。一个区域可以有多个子区域,因此区域表是一棵树。将网络分配给区域。在网络上过滤时,它应该过滤该区域及其树中的所有区域子项。因为我无法查询无休止的树,所以我有一张桌子可以展平这棵完整的树。

因此,使用1个查询(SELECT area_id FROM network_area_flatdeep WHERE network_id = 1),我获得了属于网络1的所有区域: 63, 64, 65, 66, 67, 68, 69, 70

这使得查询变得非常容易。

慢查询(在测试所有内容之前已进行真空分析):

EXPLAIN ANALYZE SELECT a0_.id  AS id0
FROM   advert a0_
       INNER JOIN member m6_
               ON a0_.user_id = m6_.id
       INNER JOIN area a7_
               ON m6_.area_id = a7_.id
WHERE  a0_.status IN ( 1 )
       AND m6_.status IN ( 1 )
       AND a7_.id IN (SELECT area_id FROM network_area_flatdeep WHERE network_id IN (1))
ORDER  BY a0_.created_date DESC
LIMIT  60;
                                                                                 QUERY PLAN                                                                                  
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=41.10..34695.53 rows=60 width=12) (actual time=9.327..134.581 rows=60 loops=1)
   ->  Nested Loop  (cost=41.10..2291276.69 rows=3967 width=12) (actual time=9.326..134.534 rows=60 loops=1)
         Join Filter: (a7_.id = m6_.area_id)
         Rows Removed by Join Filter: 22566
         ->  Nested Loop  (cost=41.10..821630.16 rows=317633 width=24) (actual time=0.049..39.638 rows=22666 loops=1)
               ->  Index Scan Backward using advert_created_date_idx on advert a0_  (cost=0.00..762000.64 rows=317633 width=16) (actual time=0.013..4.357 rows=2834 loops=1)
                     Filter: (status = 1)
                     Rows Removed by Filter: 21
               ->  Materialize  (cost=41.10..73.38 rows=15 width=8) (actual time=0.000..0.004 rows=8 loops=2834)
                     ->  Nested Loop  (cost=41.10..73.30 rows=15 width=8) (actual time=0.031..0.073 rows=8 loops=1)
                           ->  HashAggregate  (cost=41.10..41.18 rows=8 width=4) (actual time=0.023..0.026 rows=8 loops=1)
                                 ->  Bitmap Heap Scan on network_area_flatdeep  (cost=4.37..41.06 rows=15 width=4) (actual time=0.011..0.015 rows=8 loops=1)
                                       Recheck Cond: (network_id = 1)
                                       ->  Bitmap Index Scan on idx_c29e880034128b91  (cost=0.00..4.36 rows=15 width=0) (actual time=0.007..0.007 rows=8 loops=1)
                                             Index Cond: (network_id = 1)
                           ->  Index Only Scan using area_pkey on area a7_  (cost=0.00..4.01 rows=1 width=4) (actual time=0.002..0.003 rows=1 loops=8)
                                 Index Cond: (id = network_area_flatdeep.area_id)
                                 Heap Fetches: 8
         ->  Index Scan using member_pkey on member m6_  (cost=0.00..4.61 rows=1 width=8) (actual time=0.002..0.003 rows=1 loops=22666)
               Index Cond: (id = a0_.user_id)
               Filter: (status = 1)
               Rows Removed by Filter: 0
 Total runtime: 134.698 ms
(23 rows)

子查询本身是:

EXPLAIN ANALYZE SELECT area_id FROM network_area_flatdeep WHERE network_id IN (1);
                                                        QUERY PLAN                                                          
------------------------------------------------------------------------------------------------------------------------------
 Bitmap Heap Scan on network_area_flatdeep  (cost=4.37..41.06 rows=15 width=4) (actual time=0.020..0.024 rows=8 loops=1)
   Recheck Cond: (network_id = 1)
   ->  Bitmap Index Scan on idx_c29e880034128b91  (cost=0.00..4.36 rows=15 width=0) (actual time=0.012..0.012 rows=8 loops=1)
         Index Cond: (network_id = 1)
 Total runtime: 0.051 ms
(5 rows)

导致:63, 64, 65, 66, 67, 68, 69, 70

所以我试图在ID中进行硬编码。并期望它更快(但不是):

EXPLAIN ANALYZE SELECT a0_.id  AS id0
FROM   advert a0_
       INNER JOIN member m6_
               ON a0_.user_id = m6_.id
       INNER JOIN area a7_
                   ON m6_.area_id = a7_.id
WHERE  a0_.status IN ( 1 )
       AND m6_.status IN ( 1 )
       AND a7_.id IN (63, 64, 65, 66, 67, 68, 69, 70)
ORDER  BY a0_.created_date DESC
LIMIT  60;
                                                                           QUERY PLAN                                                                           
----------------------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=17558.82..17558.97 rows=60 width=12) (actual time=56.594..56.670 rows=60 loops=1)
   ->  Sort  (cost=17558.82..17560.07 rows=498 width=12) (actual time=56.593..56.621 rows=60 loops=1)
         Sort Key: a0_.created_date
         Sort Method: top-N heapsort  Memory: 27kB
         ->  Nested Loop  (cost=0.00..17541.62 rows=498 width=12) (actual time=0.047..53.808 rows=4478 loops=1)
               ->  Nested Loop  (cost=0.00..3903.99 rows=286 width=4) (actual time=0.027..17.492 rows=8004 loops=1)
                     ->  Seq Scan on area a7_  (cost=0.00..144.78 rows=8 width=4) (actual time=0.007..0.823 rows=8 loops=1)
                           Filter: (id = ANY ('{63,64,65,66,67,68,69,70}'::integer[]))
                           Rows Removed by Filter: 5081
                     ->  Index Scan using idx_70e4fa78bd0f409c on member m6_  (cost=0.00..468.38 rows=152 width=8) (actual time=0.011..1.208 rows=1000 loops=8)
                           Index Cond: (area_id = a7_.id)
                           Filter: (status = 1)
                           Rows Removed by Filter: 2
               ->  Index Scan using idx_54f1f40ba76ed395 on advert a0_  (cost=0.00..47.49 rows=19 width=16) (actual time=0.002..0.003 rows=1 loops=8004)
                     Index Cond: (user_id = m6_.id)
                     Filter: (status = 1)
                     Rows Removed by Filter: 1
 Total runtime: 56.744 ms
(18 rows)

Time: 57.995 ms

我试图将子查询放在INNER JOIN中:

EXPLAIN ANALYZE SELECT a0_.id  AS id0
FROM   advert a0_
       INNER JOIN member m6_
               ON a0_.user_id = m6_.id
       INNER JOIN area a7_
               ON m6_.area_id = a7_.id 
               AND m6_.area_id IN (SELECT area_id FROM network_area_flatdeep WHERE network_id IN     (1))
WHERE  a0_.status IN ( 1 )
       AND m6_.status IN ( 1 )
ORDER  BY a0_.created_date DESC
LIMIT  60;
                                                                                QUERY PLAN                                                                                     
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=4.37..34966.73 rows=60 width=12) (actual time=2.957..42.443 rows=60 loops=1)
   ->  Nested Loop  (cost=4.37..2311599.10 rows=3967 width=12) (actual time=2.956..42.394 rows=60 loops=1)
         ->  Nested Loop Semi Join  (cost=4.37..2302173.51 rows=3967 width=20) (actual time=2.949..42.099 rows=60 loops=1)
               Join Filter: (m6_.area_id = network_area_flatdeep.area_id)
               Rows Removed by Join Filter: 22333
               ->  Nested Loop  (cost=0.00..2230853.09 rows=316797 width=16) (actual time=0.028..18.612 rows=2829 loops=1)
                     ->  Index Scan Backward using advert_created_date_idx on advert a0_  (cost=0.00..762000.64 rows=317633 width=16) (actual time=0.012..3.802 rows=2834 loops=1)
                           Filter: (status = 1)
                           Rows Removed by Filter: 21
                     ->  Index Scan using member_pkey on member m6_  (cost=0.00..4.61 rows=1 width=8) (actual time=0.003..0.003 rows=1 loops=2834)
                           Index Cond: (id = a0_.user_id)
                           Filter: (status = 1)
                           Rows Removed by Filter: 0
               ->  Materialize  (cost=4.37..41.14 rows=15 width=4) (actual time=0.000..0.004 rows=8 loops=2829)
                     ->  Bitmap Heap Scan on network_area_flatdeep  (cost=4.37..41.06 rows=15 width=4) (actual time=0.009..0.015 rows=8 loops=1)
                           Recheck Cond: (network_id = 1)
                           ->  Bitmap Index Scan on idx_c29e880034128b91  (cost=0.00..4.36 rows=15 width=0) (actual time=0.006..0.006 rows=8 loops=1)
                                 Index Cond: (network_id = 1)
         ->  Index Only Scan using area_pkey on area a7_  (cost=0.00..2.37 rows=1 width=4) (actual time=0.002..0.003 rows=1 loops=60)
               Index Cond: (id = m6_.area_id)
               Heap Fetches: 60
 Total runtime: 42.538 ms
(22 rows)

我试图摆脱子查询并对network_area_flatdeep做一个正确的JOIN语句(我强烈赞同这个版本):

EXPLAIN ANALYZE SELECT a0_.id  AS id0
FROM   advert a0_
       INNER JOIN member m6_
               ON a0_.user_id = m6_.id
       INNER JOIN area a7_
               ON m6_.area_id = a7_.id 
       INNER JOIN network_area_flatdeep n14_
               ON a7_.id = n14_.area_id
                  AND ( n14_.network_id IN ( 1 ) )
WHERE  a0_.status IN ( 1 )
       AND m6_.status IN ( 1 )
ORDER  BY a0_.created_date DESC
LIMIT  60;
                                                                                   QUERY PLAN                                                                                    
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=30031.18..30031.33 rows=60 width=12) (actual time=62.968..63.045 rows=60 loops=1)
   ->  Sort  (cost=30031.18..30033.51 rows=934 width=12) (actual time=62.967..62.991 rows=60 loops=1)
         Sort Key: a0_.created_date
         Sort Method: top-N heapsort  Memory: 27kB
         ->  Nested Loop  (cost=0.00..29998.92 rows=934 width=12) (actual time=0.157..60.280 rows=4478 loops=1)
               ->  Nested Loop  (cost=0.00..4401.66 rows=536 width=4) (actual time=0.029..20.488 rows=8004 loops=1)
                     ->  Nested Loop  (cost=0.00..120.69 rows=15 width=8) (actual time=0.015..0.084 rows=8 loops=1)
                           ->  Index Scan using idx_c29e880034128b91 on network_area_flatdeep n14_  (cost=0.00..60.47 rows=15 width=4) (actual time=0.009..0.019 rows=8 loops=1)
                                 Index Cond: (network_id = 1)
                           ->  Index Only Scan using area_pkey on area a7_  (cost=0.00..4.01 rows=1 width=4) (actual time=0.004..0.005 rows=1 loops=8)
                                 Index Cond: (id = n14_.area_id)
                                 Heap Fetches: 8
                     ->  Index Scan using idx_70e4fa78bd0f409c on member m6_  (cost=0.00..283.88 rows=152 width=8) (actual time=0.011..1.278 rows=1000 loops=8)
                           Index Cond: (area_id = a7_.id)
                           Filter: (status = 1)
                           Rows Removed by Filter: 2
               ->  Index Scan using idx_54f1f40ba76ed395 on advert a0_  (cost=0.00..47.57 rows=19 width=16) (actual time=0.003..0.003 rows=1 loops=8004)
                     Index Cond: (user_id = m6_.id)
                     Filter: (status = 1)
                     Rows Removed by Filter: 1
 Total runtime: 63.125 ms
(21 rows)

IN更改为=也无法帮助。

我按照wilderplasser的建议尝试使用EXISTS,答案如下。

当我删除ORDER BY或网络条件时,查询速度很快(2ms)。但为什么他们不能在一起玩得很好呢?

现在......当我将network_id从'1'更改为'10'时。查询速度非常快,就像我想要的那样。 10是包含所有区域的根网络。因此,JOIN需要过滤掉LESS结果,查询速度越快。

结构如下:

area (mapped to network 10 which contains 5089 areas in flat table and is FAST)
|    |---- area 1 (network 1 which contains 8 areas in flat table and is SLOW)
|        |--- more areas
|-- ALOT MORE areas
|-- etc

将网络1更改为10可提供:3.265 ms

总结差异:

网络1在network_area_flatdeep中有8个区域 网络10在network_area_flatdeep

中有5089个区域

因此使用网络1的INNER JOIN非常慢,使用网络10的INNER JOIN非常快。子查询的行为相同。

广告表

353804 rows
                                                                   Table "public.advert"
           Column            |              Type              |                      Modifiers                      | Storage  | Stats target | Description 
-----------------------------+--------------------------------+-----------------------------------------------------+----------+--------------+-------------
 id                          | integer                        | not null default nextval('advert_id_seq'::regclass) | plain    |              | 
 user_id                     | integer                        | not null                                            | plain    |              | 
 advert_category_id          | integer                        | not null                                            | plain    |              | 
 currency_id                 | integer                        | not null                                            | plain    |              | 
 advert_kind_id              | integer                        | not null                                            | plain    |              | 
 advert_price_id             | integer                        |                                                     | plain    |              | 
 external_source_id          | integer                        |                                                     | plain    |              | 
 status                      | integer                        | not null                                            | plain    |              | 
 type                        | integer                        | not null                                            | plain    |              | 
 title                       | character varying(60)          | not null                                            | extended |              | 
 description                 | text                           | not null                                            | extended |              | 
 price                       | numeric(19,2)                  | default NULL::numeric                               | main     |              | 
 accepting_bids              | boolean                        | not null                                            | plain    |              | 
 promoted                    | boolean                        | not null                                            | plain    |              | 
 edited_date                 | timestamp(0) without time zone | default NULL::timestamp without time zone           | plain    |              | 
 created_date                | timestamp(0) without time zone | not null                                            | plain    |              | 
 archived_date               | timestamp(0) without time zone | default NULL::timestamp without time zone           | plain    |              | 
 views                       | integer                        | not null                                            | plain    |              | 
 checked_date                | timestamp(0) without time zone | default NULL::timestamp without time zone           | plain    |              | 
 archived_by_cron            | boolean                        | not null                                            | plain    |              | 
 unarchived_by_cron          | boolean                        | not null                                            | plain    |              | 
 containting_forbidden_words | boolean                        | not null                                            | plain    |              | 
 external_id                 | character varying(255)         | default NULL::character varying                     | extended |              | 
 new_product                 | boolean                        | not null                                            | plain    |              | 
Indexes:
    "advert_pkey" PRIMARY KEY, btree (id)
    "advert_external_idx_uq" UNIQUE, btree (external_id, external_source_id)
    "advert_archived_date_idx" btree (archived_date)
    "advert_checked_date_idx" btree (checked_date)
    "advert_created_date_idx" btree (created_date)
    "advert_edited_date_idx" btree (edited_date)
    "advert_external_id_idx" btree (external_id)
    "advert_price_idx" btree (price)
    "advert_status_idx" btree (status)
    "advert_type_idx" btree (type)
    "advert_views_idx" btree (views)
    "idx_54f1f40b38248176" btree (currency_id)
    "idx_54f1f40b54b67d66" btree (advert_price_id)
    "idx_54f1f40b9a2e6cff" btree (advert_kind_id)
    "idx_54f1f40ba76ed395" btree (user_id)
    "idx_54f1f40bb167b375" btree (external_source_id)
    "idx_54f1f40bd4436821" btree (advert_category_id)
Foreign-key constraints:
    "fk_54f1f40b38248176" FOREIGN KEY (currency_id) REFERENCES currency(id) ON DELETE RESTRICT
    "fk_54f1f40b54b67d66" FOREIGN KEY (advert_price_id) REFERENCES advertprice(id) ON DELETE RESTRICT
    "fk_54f1f40b9a2e6cff" FOREIGN KEY (advert_kind_id) REFERENCES advertkind(id) ON DELETE RESTRICT
    "fk_54f1f40ba76ed395" FOREIGN KEY (user_id) REFERENCES member(id) ON DELETE CASCADE
    "fk_54f1f40bb167b375" FOREIGN KEY (external_source_id) REFERENCES externalsource(id) ON DELETE RESTRICT
    "fk_54f1f40bd4436821" FOREIGN KEY (advert_category_id) REFERENCES advertcategory(id) ON DELETE RESTRICT
Referenced by:
    TABLE "advert_photo" CONSTRAINT "fk_1c939974d07eccb6" FOREIGN KEY (advert_id) REFERENCES advert(id) ON DELETE CASCADE
    TABLE "banner" CONSTRAINT "fk_6f9db8e7d07eccb6" FOREIGN KEY (advert_id) REFERENCES advert(id) ON DELETE SET NULL
    TABLE "advertbid" CONSTRAINT "fk_fccdba75d07eccb6" FOREIGN KEY (advert_id) REFERENCES advert(id) ON DELETE CASCADE
Has OIDs: no

区域表:

5089 rows
                                               Table "public.area"
   Column   |  Type   |                     Modifiers                     | Storage | Stats target | Description 
------------+---------+---------------------------------------------------+---------+--------------+-------------
 id         | integer | not null default nextval('area_id_seq'::regclass) | plain   |              | 
 network_id | integer |                                                   | plain   |              | 
 parent_id  | integer |                                                   | plain   |              | 
 selectable | boolean | not null                                          | plain   |              | 
Indexes:
    "area_pkey" PRIMARY KEY, btree (id)
    "idx_d7943d6834128b91" btree (network_id)
    "idx_d7943d68727aca70" btree (parent_id)
Foreign-key constraints:
    "fk_d7943d6834128b91" FOREIGN KEY (network_id) REFERENCES network(id) ON DELETE RESTRICT
    "fk_d7943d68727aca70" FOREIGN KEY (parent_id) REFERENCES area(id) ON DELETE CASCADE
Referenced by:
    TABLE "network_area_flat" CONSTRAINT "fk_10aae5b2bd0f409c" FOREIGN KEY (area_id) REFERENCES area(id) ON DELETE CASCADE
    TABLE "area_language" CONSTRAINT "fk_17d42f7dbd0f409c" FOREIGN KEY (area_id) REFERENCES area(id) ON DELETE CASCADE
    TABLE "area_zip_code" CONSTRAINT "fk_62a3bf90bd0f409c" FOREIGN KEY (area_id) REFERENCES area(id) ON DELETE CASCADE
    TABLE "member" CONSTRAINT "fk_70e4fa78bd0f409c" FOREIGN KEY (area_id) REFERENCES area(id) ON DELETE RESTRICT
    TABLE "network_area_flatdeep" CONSTRAINT "fk_c29e8800bd0f409c" FOREIGN KEY (area_id) REFERENCES area(id) ON DELETE CASCADE
    TABLE "area" CONSTRAINT "fk_d7943d68727aca70" FOREIGN KEY (parent_id) REFERENCES area(id) ON DELETE CASCADE
Has OIDs: no

会员表:

182450 rows
                                                               Table "public.member"
        Column         |              Type              |                      Modifiers                      | Storage  | Stats target | Description 
-----------------------+--------------------------------+-----------------------------------------------------+----------+--------------+-------------
 id                    | integer                        | not null default nextval('member_id_seq'::regclass) | plain    |              | 
 language_id           | integer                        | not null                                            | plain    |              | 
 area_id               | integer                        | not null                                            | plain    |              | 
 company_id            | integer                        |                                                     | plain    |              | 
 external_source_id    | integer                        |                                                     | plain    |              | 
 email                 | character varying(255)         | not null                                            | extended |              | 
 password              | character varying(40)          | not null                                            | extended |              | 
 status                | integer                        | not null                                            | plain    |              | 
 name                  | character varying(150)         | not null                                            | extended |              | 
 zip_code              | character varying(20)          |                                                     | extended |              | 
 phone_number          | character varying(120)         | default NULL::character varying                     | extended |              | 
 using_email_service   | boolean                        | not null                                            | plain    |              | 
 edited_date           | timestamp(0) without time zone | default NULL::timestamp without time zone           | plain    |              | 
 created_date          | timestamp(0) without time zone | not null                                            | plain    |              | 
 hiding_on_own_network | boolean                        | not null                                            | plain    |              | 
 staff                 | boolean                        | not null                                            | plain    |              | 
 superuser             | boolean                        | not null                                            | plain    |              | 
 external_id           | character varying(255)         | default NULL::character varying                     | extended |              | 
 last_login_date       | timestamp(0) without time zone | default NULL::timestamp without time zone           | plain    |              | 
 deleted_adverts       | integer                        | not null                                            | plain    |              | 
Indexes:
    "member_pkey" PRIMARY KEY, btree (id)
    "user_email_idx_uq" UNIQUE, btree (email)
    "user_external_idx_uq" UNIQUE, btree (external_id, external_source_id)
    "idx_70e4fa7882f1baf4" btree (language_id)
    "idx_70e4fa78979b1ad6" btree (company_id)
    "idx_70e4fa78b167b375" btree (external_source_id)
    "idx_70e4fa78bd0f409c" btree (area_id)
    "user_external_id_idx" btree (external_id)
    "user_name_idx" btree (name)
    "user_status_idx" btree (status)
Foreign-key constraints:
    "fk_70e4fa7882f1baf4" FOREIGN KEY (language_id) REFERENCES language(id) ON DELETE RESTRICT
    "fk_70e4fa78979b1ad6" FOREIGN KEY (company_id) REFERENCES company(id) ON DELETE SET NULL
    "fk_70e4fa78b167b375" FOREIGN KEY (external_source_id) REFERENCES externalsource(id) ON DELETE RESTRICT
    "fk_70e4fa78bd0f409c" FOREIGN KEY (area_id) REFERENCES area(id) ON DELETE RESTRICT
Referenced by:
    TABLE "user_link" CONSTRAINT "fk_4c2dd538a76ed395" FOREIGN KEY (user_id) REFERENCES member(id) ON DELETE CASCADE
    TABLE "advert" CONSTRAINT "fk_54f1f40ba76ed395" FOREIGN KEY (user_id) REFERENCES member(id) ON DELETE CASCADE
    TABLE "banner" CONSTRAINT "fk_6f9db8e7a76ed395" FOREIGN KEY (user_id) REFERENCES member(id) ON DELETE SET NULL
    TABLE "user_admin_module_permission" CONSTRAINT "fk_74fee7cea76ed395" FOREIGN KEY (user_id) REFERENCES member(id) ON DELETE CASCADE
    TABLE "user_admin_resource_permission" CONSTRAINT "fk_c9fcf279a76ed395" FOREIGN KEY (user_id) REFERENCES member(id) ON DELETE CASCADE
Has OIDs: no

Network_area_flatdeep表:

10177 rows
                                                           Table "public.network_area_flatdeep"
    Column    |              Type              |                             Modifiers                              | Storage | Stats target | Description 
--------------+--------------------------------+--------------------------------------------------------------------+---------+--------------+-------------
 id           | integer                        | not null default nextval('network_area_flatdeep_id_seq'::regclass) | plain   |              | 
 network_id   | integer                        | not null                                                           | plain   |              | 
 area_id      | integer                        | not null                                                           | plain   |              | 
 created_date | timestamp(0) without time zone | not null                                                           | plain   |              | 
Indexes:
    "network_area_flatdeep_pkey" PRIMARY KEY, btree (id)
    "area_flatdeep_idx_uq" UNIQUE, btree (area_id, network_id, created_date)
    "idx_c29e880034128b91" btree (network_id)
    "idx_c29e8800bd0f409c" btree (area_id)
Foreign-key constraints:
    "fk_c29e880034128b91" FOREIGN KEY (network_id) REFERENCES network(id) ON DELETE CASCADE
    "fk_c29e8800bd0f409c" FOREIGN KEY (area_id) REFERENCES area(id) ON DELETE CASCADE
Has OIDs: no

短服务器配置:

                                                   version                                                    
--------------------------------------------------------------------------------------------------------------
 PostgreSQL 9.2.4 on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-3), 64-bit

            name            |  current_setting   |        source        
----------------------------+--------------------+----------------------
 shared_buffers             | 1800MB             | configuration file
 work_mem                   | 4MB                | configuration file

结论:

数据越多(过滤掉越少),查询越快。我现在有点无能为力了。 PostgreSQL怎么会这么慢?再说一次:40ms看起来并不是很慢,但是对于带有大型SELECT语句的真实查询,查询大多数情况下都是1.5秒,最多可能需要3秒。

所有过滤都在索引上完成。订购也在索引上完成。

有没有人知道如何改进这个简单的过滤器我显然需要分开数据?

4 个答案:

答案 0 :(得分:2)

尝试将IN(subquery)替换为相应的EXISTS(correlated subquery)

SELECT a0_.id  AS id0
FROM   advert a0_
INNER JOIN member m6_
               ON a0_.user_id = m6_.id
INNER JOIN area a7_
               ON m6_.area_id = a7_.id 
WHERE a0_.status IN ( 1 )
AND m6_.status IN ( 1 )
AND EXISTS (
     SELECT*
     FROM network_area_flatdeep xx
     WHERE xx.area_id = m6_.area_id
     AND xx.network_id IN  (2)
     )
ORDER  BY a0_.created_date DESC
LIMIT  60
   ;

您确实需要主键和相关外键。我不知道network_area_flatdeep.area_id,如果它不是PK或FK,你可能需要一个索引(或使它成为复合PK的一部分)

更新:带有合成数据的测试平台:

DROP SCHEMA tmp CASCADE;
CREATE SCHEMA tmp ;
SET search_path=tmp;

CREATE Table area
 ( id   SERIAL  not null PRIMARY KEY
 , zzzz varchar
        );

CREATE Table member
 ( id   SERIAL  not null PRIMARY KEY
 , language_id  integer not null DEFAULT 0
 , area_id      integer not null REFERENCES area(id)
 , company_id   integer
 , external_source_id   integer
 , status       integer not null  DEFAULT 0
 , name varchar not null
 , zip_code     varchar not null
 , phone_number varchar default NULL
 , using_email_service  boolean not null DEFAULT False
 , edited_date  timestamp(0) without time zone  default NULL
 , created_date timestamp(0) without time zone  not null
 , hiding_on_own_network        boolean not null DEFAULT False
 , staff        boolean not null DEFAULT False
 , superuser    boolean not null DEFAULT False
 , external_id  varchar default NULL
        );

CREATE TABLE advert
 ( id   SERIAL NOT NULL PRIMARY KEY
 , user_id      integer NOT NULL  REFERENCES member(id)
 , advert_category_id   integer NOT NULL DEFAULT 0
 , currency_id  integer NOT NULL DEFAULT 0
 , advert_kind_id       integer NOT NULL DEFAULT 0
 , advert_price_id      integer
 , external_source_id   integer
 , status       integer NOT NULL DEFAULT 0
 , type integer NOT NULL DEFAULT 0
 , title        varchar NOT NULL
 , description  text NOT NULL
 , price        numeric(10,2) default NULL
 , accepting_bids       boolean NOT NULL DEFAULT False
 , promoted     boolean NOT NULL  DEFAULT False
 , edited_date  timestamp(0) without time zone default NULL
 , created_date timestamp(0) without time zone NOT NULL
 , archived_date        timestamp(0) without time zone  default NULL
 , views        integer NOT NULL  DEFAULT 0
 , checked_date timestamp(0) without time zone default NULL
 , archived_by_cron     boolean NOT NULL  DEFAULT False
 , unarchived_by_cron   boolean NOT NULL  DEFAULT False
 , containting_forbidden_words  boolean NOT NULL  DEFAULT False
 , external_id  varchar default NULL
        );

CREATE INDEX advert_created_date_idx ON advert (created_date);

CREATE Table network_area_flatdeep
        -- the surrogate key in a junction table is questionable
 ( id   SERIAL not null PRIMARY KEY
 , network_id   integer not null -- REFERENCES network(id) ON DELETE CASCADE
 , area_id      integer not null REFERENCES area(id) ON DELETE CASCADE
 , created_date timestamp(0) without time zone not null
        -- the date in the below constraint is questionable
 , CONSTRAINT area_flatdeep_idx_uq UNIQUE (area_id, network_id, created_date)
        );
CREATE INDEX idx_c29e880034128b91 ON network_area_flatdeep(network_id);
CREATE INDEX idx_c29e8800bd0f409c ON network_area_flatdeep(area_id);
INSERT INTO area ( zzzz)
SELECT 'Zzzz_' || gs::text
FROM generate_series(1,39) gs
        ;

INSERT INTO network_area_flatdeep
        -- the surrogate key in a junction table is questionable
 ( network_id , area_id , created_date)
SELECT gs % 7 , aa.id, now()
FROM generate_series(1,76) gs
JOIN area aa ON aa.id = 1+gs % 39
        ;


INSERT INTO member
 ( area_id , name , zip_code, created_date)
SELECT aa.id
        , 'Member_'|| gs::text
        , 'Code_'|| gs::text
        , now()
FROM generate_series(1, 10086) gs
JOIN area aa ON aa.id = 1 + gs % 39
        ;
INSERT INTO advert( user_id , title, description, edited_date , created_date)
SELECT 1+ (gs* 321) % 10086
        , 'Tit_'|| gs::text
        , 'Desc_'|| gs::text
        , now()
        , now() - (random() * 10000 * '1 sec'::interval)
 from generate_series(1,47569 ) gs
        ;

UPDATE member SET status = 1 WHERE random() < .3;
UPDATE advert SET status = 1 WHERE random() < .3;

VACUUM ANALYZE member;
VACUUM ANALYZE advert;
VACUUM ANALYZE area;
VACUUM ANALYZE network_area_flatdeep;

我的查询在12ms(PG-9.1)中执行,具有与OP相同的计划。 (所以这必须是配置问题)

答案 1 :(得分:1)

当您移除区域中显然不必要(并因此分散注意力)的连接时,您会得到什么样的计划?

SELECT a0_.id  AS id0
FROM   advert a0_
       INNER JOIN member m6_
               ON a0_.user_id = m6_.id
WHERE  a0_.status IN ( 1 )
       AND m6_.status IN ( 1 )
       AND m6_.area_id IN (SELECT area_id FROM network_area_flatdeep WHERE network_id IN (1))
ORDER  BY a0_.created_date DESC
LIMIT  60;

答案 2 :(得分:0)

您的某个查询的一个小变体

SELECT a0_.id  AS id0
FROM   advert a0_
       INNER JOIN member m6_
               ON a0_.user_id = m6_.id
       INNER JOIN area a7_
               ON m6_.area_id = a7_.id 
       INNER JOIN (
                SELECT area_id
                FROM network_area_flatdeep
                WHERE network_id IN (2)
                ) network_area_flatdeep n14_
               ON a7_.id = n14_.area_id
WHERE  a0_.status IN ( 1 )
       AND m6_.status IN ( 1 )
ORDER  BY a0_.created_date DESC
LIMIT  60;

答案 3 :(得分:0)

如果你打开查询会怎么样?首先,您选择区域,然后加入成员和广告。您还可以通过直接在JOIN上添加WHERE部分来限制连接。

SELECT a0_.id  AS id0

FROM    area a7_
        LEFT JOIN member m6_
            ON a7_.id = m6_.area_id AND m6_.status IN ( 1 )
        LEFT JOIN advert a0_
            ON m6_.id = a0_.user_id

WHERE   a7_.id IN (SELECT area_id FROM network_area_flatdeep WHERE network_id IN (1))
        AND a0_.status IN ( 1 )

ORDER  BY a0_.created_date DESC
LIMIT  60;