Question

如何优化此查询？如果我在没有ORDER BY子句的情况下运行它，它将在＆lt; 100ms内执行。使用ORDER BY子句需要很多秒，并在多个系统尝试同时进行此查询时压缩服务器。

UPDATE companies
SET
    crawling = 1
WHERE
    crawling = 0
    AND url_host IS NOT NULL
ORDER BY
    last_crawled ASC
LIMIT 1;

如果我将此查询作为SELECT运行，它也会很快（<100ms）。

SELECT id
FROM companies
WHERE
    crawling = 0
    AND url_host IS NOT NULL
ORDER BY
    last_crawled ASC
LIMIT 1;

这是我的表架构：

CREATE TABLE `companies` (
  `id` int(11) unsigned NOT NULL AUTO_INCREMENT,
  `url` varchar(255) DEFAULT NULL,
  `url_scheme` varchar(10) DEFAULT NULL,
  `url_host` varchar(255) DEFAULT NULL,
  `name` varchar(255) DEFAULT NULL,
  `crawl` tinyint(1) unsigned NOT NULL DEFAULT '1',
  `crawling` tinyint(1) unsigned NOT NULL DEFAULT '0',
  `last_crawled` datetime NOT NULL,
  PRIMARY KEY (`id`),
  KEY `name` (`name`),
  KEY `url_host` (`url_host`),
  KEY `crawl` (`crawl`),
  KEY `crawling` (`crawling`),
  KEY `last_crawled` (`last_crawled`),
  KEY `url_scheme` (`url_scheme`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;

更新一次

此查询给出了以下错误：You can't specify target table 'companies' for update in FROM clause

UPDATE companies
SET crawling = 1
WHERE id = (
    SELECT id
    FROM companies
    WHERE
        crawling = 0
        AND url_host IS NOT NULL
    ORDER BY
        last_crawled ASC
    LIMIT 1
);

此查询给出了以下错误：This version of MySQL doesn't yet support 'LIMIT & IN/ALL/ANY/SOME subquery'

UPDATE companies
SET crawling = 1
WHERE id in (
    SELECT id
    FROM companies
    WHERE
        crawling = 0
        AND url_host IS NOT NULL
    ORDER BY
        last_crawled ASC
    LIMIT 1
);

Answer 1

尽量不要使用ORDER-BY和LIMIT进行如此少量的更新。

    UPDATE companies t1
    join
    (
        SELECT c.id,@RowNum:=@RowNum+1 AS RowID
        FROM companies c, (SELECT @RowNum := 0)r
        WHERE c.crawling = 0 AND c.url_host IS NOT NULL
        ORDER BY c.last_crawled ASC
    )t2
    ON t2.RowID=1 AND t1.id=t2.id
    SET t1.crawling = 1

编辑：1

确保你有索引（last_crawled ASC，id ASC）

    UPDATE companies t1
    join
    (
        Select ID,RowID
        From
        (
            SELECT c.id,@RowNum:=@RowNum+1 AS RowID
            FROM companies c, (SELECT @RowNum := 0)r
            WHERE c.crawling = 0 AND c.url_host IS NOT NULL
            ORDER BY c.last_crawled ASC
        )t2
        WHERE ROWID=1
    )t3
    ON t1.id=t3.id
    SET t1.crawling = 1

优化包含WHERE和ORDER BY的MySQL UPDATE查询？

1 个答案: