对于3.2MB数据,yql获得max-response-exceeded 1536000

时间:2015-05-20 04:30:02

标签: http xpath yql

我从网站获取一组数据。该网站制作很差,它拥有大约3.5 MB的所有数据,在一个大表中,大约8000行数据

我正在使用以下YQL语句

select * from html where url="example.com" and xpath="//div[@id='page-1']"

现在我在YQL控制台中得到的是这个

  {
 "query": {
  "count": 0,
  "created": "2015-05-20T04:13:50Z",
  "lang": "en-US",
  "diagnostics": {
   "publiclyCallable": "true",
   "url": [
    {
     "execution-start-time": "1",
     "execution-stop-time": "2076",
     "execution-time": "2075",
     "max-response-exceeded": "1536000",
     "content": "example.com"
    },
    {
     "execution-start-time": "1",
     "execution-stop-time": "2076",
     "execution-time": "2075",
     "max-response-exceeded": "1536000",
     "content": "example.com"
    }
   ],
   "user-time": "2076",
   "service-time": "4150",
   "build-version": "0.2.134"
  },
  "results": null
 }
}

我如何获取数据? 有没有办法可以拨打多个电话并拼接数据?

0 个答案:

没有答案