转动蟒蛇字典。到excel表

时间:2013-06-05 02:32:50

标签: python beautifulsoup

我遇到以下代码的问题。

import urllib2
import csv
from bs4 import BeautifulSoup
soup = BeautifulSoup(urllib2.urlopen('http://www.ny.com/clubs/nightclubs/index.html').read())
clubs = []
trains = ["A","C","E","1","2","3","4","5","6","7","N","Q","R","L","B","D","F"]
for club in soup.find_all("dt"):
    clubD = {}
    clubD["name"] = club.b.get_text()
    clubD["address"] = club.i.get_text()
    text = club.dd.get_text()
    nIndex = text.find("(")
    if(text[nIndex+1]=="2"):
        clubD["number"] = text[nIndex:nIndex+15]
    sIndex = text.find("Subway")
    sIndexEnd = text.find(".",sIndex)
    if(text[sIndexEnd-1] == "W" or text[sIndexEnd -1] == "E"):
        sIndexEnd2 = text.find(".",sIndexEnd+1)
        clubD["Subway"] = text[sIndex:sIndexEnd2]
    else:
        clubD["Subway"] = text[sIndex:sIndexEnd]
    try:
        cool = clubD["number"]
    except (ValueError,KeyError):
        clubD["number"] = "N/A"
    clubs.append(clubD)
keys = [u"name", u"address",u"number",u"Subway"]
f = open('club.csv', 'wb')
dict_writer = csv.DictWriter(f, keys)
dict_writer.writerow([unicode(s).encode("utf-8") for s in clubs])

我收到错误ValueError:dict包含不在fieldnames中的字段。我不明白这是怎么回事。任何援助都会很棒。我正在尝试将字典转换为excel文件。

1 个答案:

答案 0 :(得分:2)

clubs是一个字典列表,而每个字典有四个字段:名称,地址,数字和地铁。您需要对每个字段进行编码:

# Instead of:
#dict_writer.writerow([unicode(s).encode("utf-8") for s in clubs])

# Do this:
for c in clubs:
    # Encode each field: name, address, ...
    for k in c.keys():
        c[k] = c[k].encode('utf-8').strip()

    # Write to file
    dict_writer.writerow(c)

更新

我查看了您的数据,并且某些字段已结束新行\n,因此我更新了代码以同时编码和删除空格。