BigQuery流媒体插入60%失败

时间:2017-12-07 20:33:33

标签: google-bigquery

我需要每秒流8k行。因此,通过谷歌的推荐,我以500行的方式做到这一点。每条记录长92个字节,最后我们得到0.9MB / s的输出流量。我的互联网是80Mb / s,两个方向都是10MB / s。那应该够了。

但由于某种原因,60%的请求都失败了(没有响应,表中没有新数据)。这就是它的外观:

Done. 173/627 which is 27.59%
{ Error: ESOCKETTIMEDOUT
    at ClientRequest.<anonymous> (D:\ProgrammingNew\Actual\Idris Dos\CoinigyParser\node_modules\request\request.js:813:19)
    at Object.onceWrapper (events.js:313:30)
    at emitNone (events.js:106:13)
    at ClientRequest.emit (events.js:208:7)
    at TLSSocket.emitTimeout (_http_client.js:708:34)
    at Object.onceWrapper (events.js:313:30)
    at emitNone (events.js:106:13)
    at TLSSocket.emit (events.js:208:7)
    at TLSSocket.Socket._onTimeout (net.js:407:8)
    at ontimeout (timers.js:475:11) code: 'ESOCKETTIMEDOUT', connect: false }
Done. 174/629 which is 27.66%
Done. 175/631 which is 27.73%
Done. 176/632 which is 27.85%
{ Error: ESOCKETTIMEDOUT
    at ClientRequest.<anonymous> (D:\ProgrammingNew\Actual\Idris Dos\CoinigyParser\node_modules\request\request.js:813:19)
    at Object.onceWrapper (events.js:313:30)
    at emitNone (events.js:106:13)
    at ClientRequest.emit (events.js:208:7)
    at TLSSocket.emitTimeout (_http_client.js:708:34)
    at Object.onceWrapper (events.js:313:30)
    at emitNone (events.js:106:13)
    at TLSSocket.emit (events.js:208:7)
    at TLSSocket.Socket._onTimeout (net.js:407:8)
    at ontimeout (timers.js:475:11) code: 'ESOCKETTIMEDOUT', connect: false }

每个&#34;完成&#34;收到插入响应时会记录行,第一个数字是成功请求,第二个是请求总数。

那么多请求失败的原因是什么?

0 个答案:

没有答案