基于一类的scrapy数据提取

时间:2017-09-30 23:48:04

标签: python scrapy

我目前正在使用scrapy来提取数据,如果给定值是变化我需要输出深层思考如果给定值是change_1然后我需要得到输出deep-thoughts_1如果给定值是change_2然后我需要得到输出deep-thoughts_2

 <div class="tags">
    <div class="giv">
    <h3 class="r">
    <a href="/tag/change/page/1/">change</a> </h3>
    <div class="s">deep-thoughts</div> </div>
   <div class="giv">
    <h3 class="r">
    <a href="/tag/change/page/2/">change_1</a> </h3>
    <div class="s">deep-thoughts_1</div> </div> 
   <div class="giv">
    <h3 class="r">
    <a href="/tag/change/page/2/">change_2</a> </h3>
    <div class="s">deep-thoughts_2</div> </div> 
</div>

1 个答案:

答案 0 :(得分:0)

您可以使用以下代码

data = "change"
value = response.xpath("//div[preceding-sibling::h3/a='{}']/text()".format(data)).extract_first()