从这里开始：

Question

嗨：我是Scraperwiki和Python的新手，并试图找出如何在符合我的cssselect规范的抓取网页上没有项目的情况下返回“NA”或类似内容。

在我的下面的代码中，我正在抓取一组双嵌套的网页。当我刮掉一个没有cssselect属性值的子页面时，它只复制最后一个有值的页面的值。

任何提示？谢谢！托德

导入scraperwiki import urlparse import lxml.html import urllib

def scrape_table（root）： rows = root.cssselect（“h2”）

record = {}

for row in rows:
    table_cells = row.cssselect("h2 a")
    for cell in table_cells:
        record['Title'] = table_cells[0].text_content()
        table_cellsurls = table_cells[0].cssselect("a")

        record['CaseURL'] = table_cellsurls[0].attrib.get('href')

        caselinkurl = urllib.urlopen('http://www.italaw.com/'+table_cellsurls[0].attrib.get('href')).read()
        print caselinkurl

        caseroots = lxml.html.fromstring(caselinkurl)

        ids=caseroots.cssselect("div div div div a")
        #turns out that the data i want is third and second instance. BUT THE PROBLEM I HAVE IS THAT IT COPIES THE PREVIOUS ROW IF NULL.
        for i in ids:
            if len(ids)>=2:
                record['Rules']=ids[2].text_content()
                record['Treaty']=ids[3].text_content()
            else:
                return None
                #record['Rules']="NA"
                #record['Treaty']="NA"
                #pass
                #print "None"
# As you can see, i have experimented with different ways of returning nothing.
        pars = caseroots.cssselect("span.'case-doc-details'")


        for par in pars:

            for i in pars:                
                pars1=pars[0].cssselect("a")
                if len(pars1)>=0:
                    record['DetailsURL']=pars1[0].attrib.get('href')
                else: 
                    return None

             #Create a third level of scrape.
                caselinkurl2=urllib.urlopen('http://www.italaw.com/'+pars1[0].attrib.get('href')).read()
                print caselinkurl2
                caseroots2=lxml.html.fromstring(caselinkurl2)
                pars2=caseroots2.cssselect("div.'field-item even' span.'date-display-single'")
                for i in pars2:
                    if len(pars2)>=0:
                        record['Doc Date']=pars2[0].text_content()

                    else:

                        return None

                pars3=caseroots2.cssselect("div.'field-item even' span.'file' a")
                for i in pars3:        
                    if len(pars3)>=0:    
                        record['Doc Type Link']=pars3[0].attrib.get('href') 
                        record['Doc Type']=pars3[0].text_content()    
                    else:
                        return None

                pars4=caseroots2.cssselect("div.'field-name-field-arbitrator-claimant'")
                for i in pars4:
                    if len(pars4)>=0:

                        record['Claimant Nominee']=pars4[0].text_content()
                    else:
                        return None

                pars5=caseroots2.cssselect("div.'field-name-field-arbitrator-respondent'")
                for i in pars5:
                    if len(pars5)>=0:

                        record['Respondent Nominee']=pars5[0].text_content()
                    else:

                        return None

                pars6=caseroots2.cssselect("div.'field-name-field-arbitrator-chair'")
                for i in pars6:
                    if len(pars6)>=0:

                        record['President']=pars6[0].text_content()
                    else:

                        return None

        print record, '------------'

        scraperwiki.sqlite.save(["Title"],record)

def scrape_and_look_for_next_link（url）： html = scraperwiki.scrape（url）打印HTML root = lxml.html.fromstring（html） scrape_table（根）

从这里开始：

url ='http://www.italaw.com/cases-by-respondent?field_case_respondent_tid=All' scrape_and_look_for_next_link（URL）

Answer 1

在这里回答了我自己的问题。

对于可能出现空值的每个查询，请使用以下内容：

        for par in pars:
            pars1=pars[0].cssselect("a")
            for i in pars1:                
                if len(pars)==0:
                    record['DetailsURL']="None"
                else:
                    record['DetailsURL']=pars1[0].attrib.get('href')

如何在Python和ScraperWiki中给出空白值返回“N / A”

从这里开始：

1 个答案: