我正在使用beautifulsoup,但我不确定如何正确使用find,findall和其他功能......
如果我有:
<div class="hey"></div>
使用:soup.find_all("div", class_="hey")
将正确找到有问题的div,但我不知道如何做以下事项:
<h3 id="me"></h3> # Find this one via "h3" and "id"
<li id="test1"></li># Find this one via "li" and "id"
<li custom="test2321"></li># Find this one via "li" and "custom"
<li id="test1" class="tester"></li> # Find this one via "li" and "class"
<ul class="here"></ul> # Find this one via "ul" and "class"
任何想法都会非常感激:)
答案 0 :(得分:1)
看看以下代码:
from bs4 import BeautifulSoup
html = """
<h3 id="me"></h3>
<li id="test1"></li>
<li custom="test2321"></li>
<li id="test1" class="tester"></li>
<ul class="here"></ul>
"""
soup = BeautifulSoup(html)
# This tells BS to look at all the h3 tags, and find the ones that have an ID of me
# This however should not be done because IDs are supposed to be unique, so
# soup.find_all(id="me") should be used
one = soup.find_all("h3", {"id": "me"})
print one
# Same as above, if something has an ID, just use the ID
two = soup.find_all("li", {"id": "test1"}) # ids should be unique
print two
# Tells BS to look at all the li tags and find the node with a custom attribute
three = soup.find_all("li", {"custom": "test2321"})
print three
# Again ID, should have been enough
four = soup.find_all("li", {"id": "test1", "class": "tester"})
print four
# Look at ul tags, and find the one with a class attribute of "here"
four = soup.find_all("ul", {"class": "here"})
print four
输出:
[<h3 id="me"></h3>]
[<li id="test1"></li>, <li class="tester" id="test1"></li>]
[<li custom="test2321"></li>]
[<li class="tester" id="test1"></li>]
[<ul class="here"></ul>]
This应该提供所需的文档。
答案 1 :(得分:0)
来自帮助:
In [30]: soup.find_all?
Type: instancemethod
String Form:
<bound method BeautifulSoup.find_all
File: /usr/lib/python2.7/site-packages/bs4/element.py
Definition: soup.find_all(self, name=None, attrs={}, recursive=True, text=None, limit=None, **kwargs)
Docstring:
Extracts a list of Tag objects that match the given
criteria. You can specify the name of the Tag and any
attributes you want the Tag to have.
The value of a key-value pair in the 'attrs' map can be a
string, a list of strings, a regular expression object, or a
callable that takes a string and returns whether or not the
string matches for some custom definition of 'matches'. The
same is true of the tag name.
因此,您可以将属性作为字典传递,或者作为命名参数传递:
In [31]: soup.find_all("li", custom="test2321")
Out[31]: [<li custom="test2321"></li>]
In [32]: soup.find_all("li", {"id": "test1", "class": ""})
Out[32]: [<li id="test1"></li>]