Question

以下代码在我的机器上运行正常，但它在行

处抛出错误

soup = BeautifulSoup(html)

当它在另一台机器上运行时。它正在解析雅虎体育活动中的活跃NBA球员名单，并将他们的名字和位置存储到文本文件中。

from bs4 import BeautifulSoup
import urllib2

'''
scraping the labeled data from yahoo sports
'''
def scrape(filename):
    base_url = "http://sports.yahoo.com/nba/players?type=position&c=NBA&pos="
    positions = ['G', 'F', 'C']
    players = 0

    with open(filename, 'w') as names:
        for p in positions:
            html = urllib2.urlopen(base_url + p).read()
            soup = BeautifulSoup(html) #throws the error!
            table = soup.find_all('table')[9]
            cells = table.find_all('td')

            for i in xrange(4, len(cells) - 1, 3):
                names.write(cells[i].find('a').string + '\t' + p + '\n')
                players += 1

    print "...success! %r players downloaded." % players

它抛出的错误是：

Traceback (most recent call last):
  File "run_me.py", line 9, in <module>
    scrapenames.scrape('namelist.txt')
  File "/Users/brapse/Downloads/bball/scrapenames.py", line 15, in scrape
    soup = BeautifulSoup(html)
  File "/usr/local/Cellar/python/2.6.5/lib/python2.6/site-packages/bs4/__init__.py", line 100, in __init__
    self._feed()
  File "/usr/local/Cellar/python/2.6.5/lib/python2.6/site-packages/bs4/__init__.py", line 113, in _feed
    self.builder.feed(self.markup)
  File "/usr/local/Cellar/python/2.6.5/lib/python2.6/site-packages/bs4/builder/_htmlparser.py", line 46, in feed
    super(HTMLParserTreeBuilder, self).feed(markup)
  File "/usr/local/Cellar/python/2.6.5/lib/python2.6/HTMLParser.py", line 108, in feed
    self.goahead(0)
  File "/usr/local/Cellar/python/2.6.5/lib/python2.6/HTMLParser.py", line 171, in goahead
    self.handle_charref(name)
  File "/usr/local/Cellar/python/2.6.5/lib/python2.6/site-packages/bs4/builder/_htmlparser.py", line 58, in handle_charref
    self.handle_data(unichr(int(name)))
ValueError: invalid literal for int() with base 10: 'xBB'

Answer 1

我相信它是BS4 htmlparser代码中的一个错误，它会在»实体（代表»）上崩溃，认为它应该是十进制的。我建议你在那台机器上更新BeautifulSoup。

在python中使用BeautifulSoup时出错：ValueError：int（）的基数为10的无效文字：'xBB'

1 个答案: