使用python和美丽的汤从HTML获取结构化数据

时间:2014-10-27 17:19:00

标签: python beautifulsoup html-parsing

我是python的新手。我想得到如下代码的结果:

Score      Postive        Negative
  5         good            bad
  7       interesting
  3                       horrible

但我的代码没有输出任何内容。请问问题在哪里?

from bs4 import BeautifulSoup
text = """
... <body>
        <div class="review">
        <p class="pos">good</p>
        <p class="neg">bad</p>
    </div>
    <div class="review">
        <p class="pos">interesting</p>
    </div>
    <div class="review">
        <p class="neg">horrible</p>
    </div>
... </body>"""
soup = BeautifulSoup(text)
for parent in soup.find_all('div', attrs={'class': 'review'}):   
if parent.findNextSiblings('p', attrs={'class': 'pos'}):
    postive.append(parent.get_text())
else:
    postive.append("")
if parent.findNextSiblings('p', attrs={'class': 'neg'}): 
    negtive.append(parent.get_text())
else:
    negtive.append("")

1 个答案:

答案 0 :(得分:1)

p标记不是div标记的同级review的兄弟,它们是子标记:

positive = []
negative = []
for div in soup.find_all('div', attrs={'class': 'review'}):
    pos = div.find('p', {'class': 'pos'})
    positive.append(pos.get_text() if pos else '')

    neg = div.find('p', {'class': 'neg'})
    negative.append(neg.get_text() if neg else '')

print positive
print negative

打印:

[u'good', u'interesting', ''] 
[u'bad', '', u'horrible']