Question

我正在尝试从几个网页中提取数据，这些网页在显示表格方面不一致。我需要编写将搜索文本字符串的代码，然后立即转到该特定文本字符串后面的表。然后我想提取该表的内容。这是我到目前为止所得到的：

from BeautifulSoup import BeautifulSoup, SoupStrainer
import re

html = ['<html><body><p align="center"><b><font size="2">Table 1</font></b><table><tr><td>1. row 1, cell 1</td><td>1. row 1, cell 2</td></tr><tr><td>1. row 2, cell 1</td><td>1. row 2, cell 2</td></tr></table><p align="center"><b><font size="2">Table 2</font></b><table><tr><td>2. row 1, cell 1</td><td>2. row 1, cell 2</td></tr><tr><td>2. row 2, cell 1</td><td>2. row 2, cell 2</td></tr></table></html>']
soup = BeautifulSoup(''.join(html))
searchtext = re.compile('Table 1',re.IGNORECASE) # Also need to figure out how to ignore space
foundtext = soup.findAll('p',text=searchtext)
soupafter = foundtext.findAllNext()
table = soupafter.find('table') # find the next table after the search string is found
rows = table.findAll('tr')
for tr in rows:
    cols = tr.findAll('td')
    for td in cols:
        try:
            text = ''.join(td.find(text=True))
        except Exception:
            text = ""
        print text+"|",
print

但是，我收到以下错误：

    soupafter = foundtext.findAllNext()
AttributeError: 'ResultSet' object has no attribute 'findAllNext'

使用BeautifulSoup有一种简单的方法吗？

Answer 1

错误是由于findAllNext是Tag个对象的方法，但foundtext是ResultSet对象，这是列表< / em>匹配标签或字符串。您可以遍历foundtext中的每个标记，但根据您的需要，使用find可能就足够了，ignore whitespace between the words只返回第一个匹配的标记。

以下是您的代码的修改版本。将foundtext更改为使用soup.find后，我发现并修复了与table相同的问题。我将你的正则表达式修改为{{3}}：

from BeautifulSoup import BeautifulSoup, SoupStrainer import re html = ['<html><body><p align="center"><b><font size="2">Table 1</font></b><table><tr><td>1. row 1, cell 1</td><td>1. row 1, cell 2</td></tr><tr><td>1. row 2, cell 1</td><td>1. row 2, cell 2</td></tr></table><p align="center"><b><font size="2">Table 2</font></b><table><tr><td>2. row 1, cell 1</td><td>2. row 1, cell 2</td></tr><tr><td>2. row 2, cell 1</td><td>2. row 2, cell 2</td></tr></table></html>'] soup = BeautifulSoup(''.join(html)) searchtext = re.compile(r'Table\s+1',re.IGNORECASE) foundtext = soup.find('p',text=searchtext) # Find the first <p> tag with the search text table = foundtext.findNext('table') # Find the first <table> tag that follows it rows = table.findAll('tr') for tr in rows: cols = tr.findAll('td') for td in cols: try: text = ''.join(td.find(text=True)) except Exception: text = "" print text+"|", print

输出：

1. row 1, cell 1| 1. row 1, cell 2| 1. row 2, cell 1| 1. row 2, cell 2|

如何在Python中使用BeautifulSoup在文本字符串后面找到一个表？

1 个答案: