webscraper chrome扩展程序以获取分页数据

时间:2019-03-16 11:43:37

标签: web-scraping google-chrome-extension

https://www.adtoi.in/member-list.php

这是我们的站点地图:

{"_id":"adtoi","startUrl":["https://www.adtoi.in/member-list.php"],"selectors":[{"id":"agency","type":"SelectorLink","parentSelectors":["pagination"],"selector":"td.sorting_1 a","multiple":true,"delay":0},{"id":"pop-up-details","type":"SelectorPopupLink","parentSelectors":["agency"],"selector":"div.card li:nth-of-type(3) a","multiple":true,"delay":0},{"id":"details","type":"SelectorText","parentSelectors":["agency"],"selector":"div.tab-pane.active","multiple":true,"regex":"","delay":0},{"id":"pagination","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"td.sorting_1 a","multiple":true,"delay":0,"clickElementSelector":"a.paginate_button","clickType":"clickOnce","discardInitialElements":true,"clickElementUniquenessType":"uniqueText"}]}

议程:

  1. 转到表格的每一页
  2. 转到表格各页上的每个链接
  3. 转到“简短详细信息”选项卡 和
  4. 提取数据

问题:分页正在运行,但是当我们尝试使用分页提取时没有数据被提取。无需分页,就可以很好地提取首页数据。

0 个答案:

没有答案