登录scrapy时出现奇怪的错误

时间:2014-01-21 16:59:50

标签: python logging scrapy

我今天早些时候有一个工作的Spider,我似乎通过尝试更改蜘蛛模块名称然后恢复该更改而搞砸了。

现在我的日志中出现了如下错误,如下所示:

2014-01-21 17:28:59+0100 [scrapy] INFO: Scrapy 0.20.2 started (bot: WebScraper)
2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [scrapy] INFO: Scrapy 0.20.2 started (bot: WebScraper)
2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [scrapy] INFO: Scrapy 0.20.2 started (bot: WebScraper)
2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [scrapy] INFO: Scrapy 0.20.2 started (bot: WebScraper)
2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [scrapy] INFO: Scrapy 0.20.2 started (bot: WebScraper)
2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [scrapy] INFO: Scrapy 0.20.2 started (bot: WebScraper)
2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [-] ERROR: 2014-01-21 17:28:59+0100 [scrapy] INFO: Scrapy 0.20.2 started (bot: WebScraper)

这种情况发生在大约98次重复并附加这些错误消息,然后移到下一部分。

2014-01-21 17:29:01+0100 [scrapy] DEBUG: Optional features available: ssl, http11
2014-01-21 17:29:01+0100 [scrapy] DEBUG: Overridden settings: {'NEWSPIDER_MODULE': 'WebScraper.spiders', 'SPIDER_MODULES': ['WebScraper.spiders'], 'LOG_FILE': 'log.txt', 'BOT_NAME': 'WebScraper'}
2014-01-21 17:29:01+0100 [scrapy] DEBUG: Enabled extensions: LogStats, TelnetConsole, CloseSpider, WebService, CoreStats, SpiderState
2014-01-21 17:29:02+0100 [scrapy] DEBUG: Enabled downloader middlewares: HttpAuthMiddleware, DownloadTimeoutMiddleware, UserAgentMiddleware, RetryMiddleware, DefaultHeadersMiddleware, MetaRefreshMiddleware, HttpCompressionMiddleware, RedirectMiddleware, CookiesMiddleware, ChunkedTransferMiddleware, DownloaderStats
2014-01-21 17:29:02+0100 [scrapy] DEBUG: Enabled spider middlewares: HttpErrorMiddleware, OffsiteMiddleware, RefererMiddleware, UrlLengthMiddleware, DepthMiddleware
2014-01-21 17:29:02+0100 [scrapy] DEBUG: Enabled item pipelines: 
2014-01-21 17:29:02+0100 [OfferingService] INFO: Spider opened

知道为什么会这样,或者我要废弃这个项目并重新开始?

0 个答案:

没有答案