是否有UNION的替代方案,扫描次数更少?

时间:2020-05-10 17:11:55

标签: c++ sql sqlite

请参见db-fiddle

在下表中

CREATE TABLE foo (x INTEGER PRIMARY KEY, y INTEGER);

INSERT INTO foo VALUES (0,41), (1, 23), (2,45), (3,32), ...

我需要xy,它们在10个min(y)的组中具有x,并且对于max(y)也是相同的:

SELECT x, min(y) FROM foo GROUP BY (x/10)
UNION
SELECT x, max(y) FROM foo GROUP BY (x/10);

EXPLAIN QUERY PLAN输出显示对表进行了两次扫描

`--COMPOUND QUERY
   |--LEFT-MOST SUBQUERY
   |  |--SCAN TABLE foo
   |  `--USE TEMP B-TREE FOR GROUP BY
   `--UNION ALL
      |--SCAN TABLE foo
      `--USE TEMP B-TREE FOR GROUP BY

是否可以通过任何方式重新编写查询语句,以便仅执行一次扫描?

同时,我要做的是选择所有行(SELECT x, y FROM foo;),并在行返回到宿主语言时手动汇总最小/最大:

int lastGroup = 0;
while (sqlite3_step(query) == SQLITE_ROW) {
  int x = sqlite3_column_int(query, 0);
  int y = sqlite3_column_int(query, 1);
  int group = x / 10;
  if (group != lastGroup) {
    // save minX, minY, maxX, maxY in a list somewhere
    // reset minX, minY, maxX, maxY
    // ...
    lastGroup = group;
  }  
  else {
    if (y < minY) {
      minX = x;
      minY = y;
    }
    else if (y > maxY) {
      maxX = x;
      maxY = y;
    }
  }
}

这实现了一次扫描,整个过程的速度是原来的两倍以上。但是,我宁愿在SQL中以明确的方式表达这种逻辑。

1 个答案:

答案 0 :(得分:1)

为什么不只一个group by包含更多列?

在下表中

SELECT (x/10) * 10, min(y), max(y)
FROM foo
GROUP BY (x/10)

如果您想要多行,则可以随后取消透视:

SELECT x, (CASE WHEN x.which = 1 THEN min_y ELSE max_y END) as min_max_y
FROM (SELECT (x/10) * 10 as x, min(y) as min_y, max(y) as max_y
      FROM foo
      GROUP BY (x/10)
     ) f CROSS JOIN
     (SELECT 1 as which UNION ALL SELECT 2) x;

编辑:

您正在使用SQLite扩展名-与标准或任何其他SQL语言不一致。更好的方法是使用窗口函数:

select x, y
from (select f.*,
             row_number() over (partition by (x/10) order by y asc) as seqnum_asc,
             row_number() over (partition by (x/10) order by y desc) as seqnum_desc
      from foo f
     ) f
where 1 in (seqnum_asc, seqnum_desc);

或者,如果您不喜欢子查询,请使用first_value()

select distinct (x/10)*10,  -- this is not necessary but helps to make the purpose clear
       first_value(x) over (partition by (x/10) order by y asc) as x_at_min_y,
       min(y) over (partition by x/10) as min_y,
       first_value(x) over (partition by (x/10) order by y desc) as x_at_max_y,
       max(y) over (partition by x/10) as max_y
from foo;

Here是数据库提琴。

如果愿意,您可以随后取消枢轴设置,如上所示。