BigQuery在短查询

时间:2016-02-12 16:12:43

标签: google-bigquery

我一直在尝试运行此查询:

SELECT
  created
FROM
  TABLE_DATE_RANGE(
      program1_insights.insights_,
      TIMESTAMP('2016-01-01'),
      TIMESTAMP('2016-02-09')
  )
LIMIT
  10

BigQuery抱怨查询太大了。 我已尝试手动编写表名:

SELECT
  created
FROM program1_insights.insights_20160101,
program1_insights.insights_20160102,
program1_insights.insights_20160103,
program1_insights.insights_20160104,
program1_insights.insights_20160105,
program1_insights.insights_20160106,
program1_insights.insights_20160107,
program1_insights.insights_20160108,
program1_insights.insights_20160109,
program1_insights.insights_20160110,
program1_insights.insights_20160111,
program1_insights.insights_20160112,
program1_insights.insights_20160113,
program1_insights.insights_20160114,
program1_insights.insights_20160115,
program1_insights.insights_20160116,
program1_insights.insights_20160117,
program1_insights.insights_20160118,
program1_insights.insights_20160119,
program1_insights.insights_20160120,
program1_insights.insights_20160121,
program1_insights.insights_20160122,
program1_insights.insights_20160123,
program1_insights.insights_20160124,
program1_insights.insights_20160125,
program1_insights.insights_20160126,
program1_insights.insights_20160127,
program1_insights.insights_20160128,
program1_insights.insights_20160129,
program1_insights.insights_20160130,
program1_insights.insights_20160131,
program1_insights.insights_20160201,
program1_insights.insights_20160202,
program1_insights.insights_20160203,
program1_insights.insights_20160204,
program1_insights.insights_20160205,
program1_insights.insights_20160206,
program1_insights.insights_20160207,
program1_insights.insights_20160208,
program1_insights.insights_20160209
LIMIT
  10

毫不奇怪,BigQuery返回相同的错误。 This Q&A表示“查询太大”意味着BigQuery正在生成一个太大而无法处理的内部查询。但在过去,我已经超过40个表运行查询没有问题。

我的问题是:当其他更大看似的查询运行正常时,这个查询特别是导致此错误的是什么?是不是支持在这个数量的表上进行单个联合?

1 个答案:

答案 0 :(得分:1)

回答问题:特别是导致此错误的查询是什么

问题不在于查询本身 查询看起来不错。
我只是对约400个日常表进行类似的查询,总共5.8B(十亿)行,总大小为5.7TB,其中:
 Query complete (150.0s elapsed, 21.7 GB processed)

SELECT
  Timestamp
FROM
  TABLE_DATE_RANGE(
      MyEvents.Events_,
      TIMESTAMP('2015-01-01'),
      TIMESTAMP('2016-02-12')
  )
LIMIT
  10

你应该环顾四周 - 顺便问一下,你确定你的问题并没有过度简化查询吗?