Question

我有时会收到此错误

2017-10-05 02:40:43 [scrapy.core.scraper] ERROR: Error downloading <POST https://example.com/index.html>
Traceback (most recent call last):
  File "/home/ubuntu/env/lib/python3.4/site-packages/twisted/internet/defer.py", line 1299, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/home/ubuntu/env/lib/python3.4/site-packages/twisted/python/failure.py", line 393, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/home/ubuntu/env/lib/python3.4/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request
    defer.returnValue((yield download_func(request=request,spider=spider)))
twisted.web._newclient.RequestGenerationFailed: [<twisted.python.failure.Failure builtins.AttributeError: 'NoneType' object has no attribute '_producer'>]

有时候它似乎也会被纠正：

2017-10-05 02:45:23 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://example.com/index.html> (failed 1 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>]

所以看起来重试正在运行，但是它适用于twisted.python.failure.Failure builtins.AttributeError吗？

Scrapy是否重试twisted.python.failure.Failure builtins.AttributeError？

0 个答案: