使用beautifulsoup从HTML获取链接文本

时间:2014-11-06 16:52:26

标签: python html web-scraping beautifulsoup html-parsing

从下面的HTML示例部分,我使用beautifilsoup从一个页面中提取一堆足球分数,简单易懂:

<tr class='report' id='match-row-EFBO695086'> <td class='statistics show' title='Show latest      match stats'> <button>Show</button> </td>  <td class='match-competition'> Premier League  </td>  <td class='match-details
teams'> <p> <span class='team-home teams'> <a href='/sport/football/teams/manchester-city'>Man City</a> </span>   <span class='score'> <abbr title='Score'> 1-0 </abbr> </span>   <span class='team-away teams'> <a
href='/sport/football/teams/crystal-palace'>Crystal Palace</a> </span>   </p> </td> <td class="match-date"> Sat 28 Dec </td>   <td class='time'>  Full time  </td>   <td class='status'>    <a class='report'
href='/sport/football/25474625'>Report</a>

from bs4 import BeautifulSoup
import urllib.request
import csv

url = 'http://www.bbc.co.uk/sport/football/teams/manchester-city/results/'
page = urllib.request.urlopen(url)
soup = BeautifulSoup(page)

for score in soup.findAll('abbr'):
    print(score.string)

*** Remote Interpreter Reinitialized  ***
>>> 
None
1-2 
1-0 
0-2 
2-1 
2-2 
4-1 
0-2 
1-1 

如何从HTML的这一部分中提取团队名称:

<span class='team-away teams'> <a href='/sport/football/teams/crystal-palace'>Crystal Palace</a>    </span> 

1 个答案:

答案 0 :(得分:2)

我们的想法是首先获取包含每个游戏信息的元素 - 这些是带有tr的{​​{1}}标签。对于每一行,按类class="report"team-home获取团队名称,并按标记名称team-away进行评分:

abbr

打印:

from bs4 import BeautifulSoup
import urllib.request

url = 'http://www.bbc.co.uk/sport/football/teams/manchester-city/results/'
page = urllib.request.urlopen(url)
soup = BeautifulSoup(page)

for match in soup.select('table.table-stats tr.report'):
    team1 = match.find('span', class_='team-home')
    team2 = match.find('span', class_='team-away')
    score = match.abbr
    if not all((team1, team2, score)):
        continue

    print(team1.text, score.text, team2.text)

仅供参考,Man City 1-2 CSKA Man City 1-0 Man Utd Man City 0-2 Newcastle West Ham 2-1 Man City ... 是一个CSS Selector,其table.table-stats tr.report内的所有tr代码与class="report" table匹配。