BeautifulSoup .hyperlinks如何运作?

时间:2014-01-23 16:11:39

标签: python beautifulsoup

目前我正在分析来自其他人的代码,现在我正在弄清楚BeautifulSoup.hyperlinks变量必须具备的内容。有谁知道这方面的文件?我在官方网站上找不到任何东西。问题是当我打印soup.hyperlinks时,以下代码给出'None':

from bs4 import BeautifulSoup

html_doc = """
<html><head><title>The Dormouse's story</title></head>
<body>
<p class="title"><b>The Dormouse's story</b></p>

<p class="story">Once upon a time there were three little sisters; and their names were
<a href="http://example.com/elsie" class="sister" id="link1">Elsie</a>,
<a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
<a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
and they lived at the bottom of a well.</p>

<p class="intermezzo">this is a link: http://www.link.nl/
<a href="http://www.link.nl" title="link title" target="link target" class="link class">link label</a>
</p>

<p class="story">...</p>
"""

soup = BeautifulSoup(html_doc)

print soup.hyperlinks

我希望有人可以帮助我吗?

1 个答案:

答案 0 :(得分:5)

BeautifulSoup对象不拥有 .hyperlinks属性;从来没有这样的事情。

相反,BeautifulSoup无法识别的任何属性访问都会转变为对.find()的调用。 soup.hyperlinks被解释为soup.find('hyperlinks'),搜索第一个<hyperlinks> HTML元素。由于没有此类标记,因此会返回None

要查找HTML文档中的所有超链接,只需循环遍历所有a标记,仅限于具有href属性的标记:

print soup.find_all('a', href=True)

演示:

>>> soup.find_all('a', href=True)
[<a class="sister" href="http://example.com/elsie" id="link1">Elsie</a>, <a class="sister" href="http://example.com/lacie" id="link2">Lacie</a>, <a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>, <a class="link class" href="http://www.link.nl" target="link target" title="link title">link label</a>]

您也可以获取所有href属性:

>>> [l['href'] for l in soup.find_all('a', href=True)]
[u'http://example.com/elsie', u'http://example.com/lacie', u'http://example.com/tillie', u'http://www.link.nl']