Postgres：SELECT阻止INSERT用于不相关的表

时间：2017-12-13 16:36:29

标签： postgresql locks

我们目前正面临一些数据库（postgres）问题，并且我们所掌握的信息并未导致新的见解。希望有人可以帮助我们。

某些背景

我们正在开发的工具基本上是一个通用的数据库系统。因此用户可以动态添加表和列。 在其中一个表中插入一个条目后，我们返回一个＆＃34; full＆＃34;条目的版本。例如，如果条目包含用户列（表示为用户ID数组），我们将查询有关这些用户的一些信息，并在将其发送到客户端之前将其添加到条目中。添加信息是使用JavaScript而不是通过JOIN完成的。

问题

users 表上的SELECT查询似乎阻止了某些生成的表上的INSERT。两个表之间没有外键关系（条目中的用户ID存储为整数数组）。 此外，INSERT似乎互相阻塞。但也许这是由第一个问题造成的？

为了查看哪些查询阻止了哪些其他查询，我们运行了以下语句：

SELECT 
    blockeda.pid AS blocked_pid,
    blockeda.query as blocked_query,
    blockinga.pid AS blocking_pid,
    blockinga.query as blocking_query,
    blockedl.mode as blocked_mode,
    blockeda.query_start as blocked_query_start,
    blockinga.query_start as blocking_query_start
FROM 
    pg_catalog.pg_locks blockedl
JOIN 
    pg_stat_activity blockeda 
ON 
    blockedl.pid = blockeda.pid
JOIN 
    pg_catalog.pg_locks blockingl
ON
    (blockingl.transactionid=blockedl.transactionid AND blockedl.pid != blockingl.pid)
JOIN 
    pg_stat_activity blockinga 
ON 
    blockingl.pid = blockinga.pid
WHERE NOT 
    blockedl.granted
LIMIT
    10;

结果看起来像这样（除了我稍微更改了表名和列名）：

 blocked_pid |                                                                                                                                                                                             blocked_query                                                                                                                 | blocking_pid |                                                                                                                                                                                            blocking_query                                                                                                                 | blocked_mode |      blocked_query_start      |     blocking_query_start      
-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
       96170 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99736 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:41:07.707156+00 | 2017-12-13 15:40:27.217027+00
       96341 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99033 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:39:04.585587+00 | 2017-12-13 15:13:19.079758+00
       96341 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99427 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:39:04.585587+00 | 2017-12-13 15:13:27.534743+00
       96341 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99439 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:39:04.585587+00 | 2017-12-13 15:13:22.371772+00
       96667 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99127 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:39:00.840949+00 | 2017-12-13 15:36:17.303978+00
       96667 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        97108 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:39:00.840949+00 | 2017-12-13 15:36:35.485022+00
       96667 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        96822 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:39:00.840949+00 | 2017-12-13 15:38:57.932188+00
       96677 | insert into "generated_table_2" ("generated_column_2_searchText", "generated_column_2_text", "generated_column_5_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        96338 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:12:22.040108+00 | 2017-12-13 15:11:36.813946+00
       96822 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99127 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:38:57.932188+00 | 2017-12-13 15:36:17.303978+00
       96822 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        96667 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:38:57.932188+00 | 2017-12-13 15:39:00.840949+00
       96822 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        97108 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:38:57.932188+00 | 2017-12-13 15:36:35.485022+00
       97110 | insert into "generated_table_3" ("generated_column_3_searchText", "generated_column_3_text", "generated_column_3_textType", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning *   |        96422 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:47:12.530821+00 | 2017-12-13 15:42:08.271596+00
       97108 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99127 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:36:35.485022+00 | 2017-12-13 15:36:17.303978+00
       97108 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        96667 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:36:35.485022+00 | 2017-12-13 15:39:00.840949+00
       97108 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        96822 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:36:35.485022+00 | 2017-12-13 15:38:57.932188+00
       99427 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99033 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:13:27.534743+00 | 2017-12-13 15:13:19.079758+00
       99427 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99439 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:13:27.534743+00 | 2017-12-13 15:13:22.371772+00
       99427 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        96341 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:13:27.534743+00 | 2017-12-13 15:39:04.585587+00
       99439 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99033 | select "id", "display_name", "user_name", "initials", "image_link", "is_image_preferred" from "users" where "id" in ($1) and "deprecated_at" is null                                                                                                                                                                      | ShareLock    | 2017-12-13 15:13:22.371772+00 | 2017-12-13 15:13:19.079758+00
       99439 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        99427 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:13:22.371772+00 | 2017-12-13 15:13:27.534743+00
       99439 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * |        96341 | insert into "generated_table_1" ("generated_column_1_searchText", "generated_column_1_text", "generated_column_4_categories", "created_at", "created_by", "display_string", "listId", "shortId", "sort_order", "updated_at", "updated_by", "uuid") values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12) returning * | ShareLock    | 2017-12-13 15:13:22.371772+00 | 2017-12-13 15:39:04.585587+00

有谁知道为什么这些查询应该互相阻塞？ 如果您需要更多信息来回答这个问题，请告诉我。

任何帮助都将受到高度赞赏！

提前多多感谢，

杰西

修改

表格定义生成的表格（静态部分）：

id: integer
shortId: character varying(255)
uuid: uuid
display_string: text
sort_order: numeric
parent_id: integer
created_by: integer
updated_by: integer
deprecated_by: integer 
created_at: timestamp with time zone
updated_at: timestamp with time zone
deprecated_at: timestamp with time zone

解决方法

通过手动查杀任何运行时间超过30秒的事务，我们现在设法解决了这个问题。似乎只有少数交易从未解决，因此越来越多的新交易被阻止和堆积。

之后，我们更改了启动这些事务的相关代码以使用promises而不是回调，从那时起错误就不再发生了。所以也许我们忘了在其中一个错误案例中调用回调。 我们会进一步调查，看看这是否确实解决了这个问题。感谢您一直以来的帮助！

1 个答案:

答案 0 :(得分：1)

您正在运行的查询返回阻塞事务运行的最新语句，但这不一定是导致锁定的语句（在var parentViewController: UIViewController! // you can also use the viewController subclass name that you created 的情况下，它最有可能的不是。

您应该弄清楚的第一件事是实际运行哪些SQL语句。

您可以设置SELECT并重现问题 确保log_statements='all'包含log_line_prefix，以便您可以识别会话 然后找出每个涉及的事务运行的语句。

请记住，如果涉及外键或触发器，那么表达式无关的表会被语句锁定。

相关问题
最新问题