Beautifulsoup文本从标签内的标签

时间:2018-04-14 06:43:27

标签: python regex web-scraping beautifulsoup

我试图获得Artist resultsSong results,但我不确定如何获得我想要的两个值。这就是我所拥有的:

albums = soup.find('div', attrs={'class':'panel-heading'}, text=re.compile('Artist results:'))
        for i in albums.find_all('a'):
            print (i)

我想从artist results:asap rocky,asap mob,asap ferg

同样,我希望我试图从song results获得的是:尽快由T.I提供,由Eric Bellinger提供等等。

<div class="panel">
    <div class="panel-heading"><b>Artist results:</b><br><small>[1-3 of 3 total <span class="text-lowercase">Artists</span> found]</small></div>
    <table class="table table-condensed">
        <tr><td class="text-left visitedlyr">
            1. <a href="https://www.azlyrics.com/a/asaprocky.html" target="_blank"><b>Asap Rocky</b></a></td>
        </tr>
        <tr><td class="text-left visitedlyr">
            2. <a href="https://www.azlyrics.com/a/asapmob.html" target="_blank"><b>Asap Mob</b></a></td>
        </tr>
        <tr><td class="text-left visitedlyr">
            3. <a href="https://www.azlyrics.com/a/asapferg.html" target="_blank"><b>Asap Ferg</b></a></td>
        </tr>
    </table>
</div>
<div class="panel">
    <div class="panel-heading"><b>Song results:</b><br><small>[1-5 of 454 total <span class="text-lowercase">Songs</span> found]</small></div>
    <table class="table table-condensed">
        <tr><td class="text-left visitedlyr">
            1. <a href="https://www.azlyrics.com/lyrics/ti/asap.html" target="_blank"><b>ASAP</b></a>  by <b>T.I.</b><br>
            <small>[Intro] <strong>Asap</strong>, <strong>asap</strong>, <strong>asap</strong> <strong>Asap</strong>, <strong>asap</strong>, <strong>asap</strong> Ay, ay, ay, ay, ay, you niggaz better exit <strong>Asap</strong>, <strong>asap</strong>, <strong>asap</strong>, <strong>asap</strong> Ay-s, ay-p, ay-s, ay-p <strong>Asap</strong>, <strong>asap</strong>, <strong>asap</strong>, <strong>asap</strong> Ay-s, ay-p, ay-s, ay-p <strong>Asap</strong>, <strong>asap</strong>, <strong>asap</strong>, <strong>asap</strong> A-s-a-p, A-S-A-P [Verse 1] I'm on my grind, grand h...</small></td>
        </tr>
        <tr><td class="text-left visitedlyr">
            2. <a href="https://www.azlyrics.com/lyrics/ericbellinger/asap.html" target="_blank"><b>ASAP</b></a>  by <b>Eric Bellinger</b><br>
            <small>ou say? Cause girl I need that <strong>asap</strong> [Hook] Girl I need that <strong>asap</strong>, <strong>asap</strong>, <strong>asap</strong>, I need Girl I need that <strong>asap</strong>, <strong>asap</strong>, <strong>asap</strong>, I need Girl I need that <strong>asap</strong>, <strong>asap</strong>, <strong>asap</strong>, baby I need Girl I'm tryina taste that, taste that, I need Girl I need that <strong>asap</strong>, <strong>asap</strong>, ...</small></td>
        </tr>

2 个答案:

答案 0 :(得分:2)

获得艺术家的结果非常简单。首先,使用<b>Artist results:</b>找到soup.find('b', text='Artist results:')标记。然后使用find_next('table')找到包含结果的表格。

artists_table = soup.find('b', text='Artist results:').find_next('table')
artists = [x.text for x in artists_table.find_all('a')]
print(artists)
# ['Asap Rocky', 'Asap Mob', 'Asap Ferg']

要获得歌曲结果,请使用相同的方法获取表格。但是,要获得您想要的文本,您必须进行一些更改。

songs_table = soup.find('b', text='Song results:').find_next('table')
songs = [' by '.join(b.text for b in td.find_all('b')) for td in songs_table.find_all('td')]
print(songs)
# ['ASAP by T.I.', 'ASAP by Eric Bellinger']

答案 1 :(得分:0)

据我所知,BeautifulSoup仅适用于Tags。

这里你想要的是什么

elements = bs.find_all('div',attrs={"class":"panel"})
for i in elements:
    if i.div.b.text == "Artist results:":
        artist_a_tag = i.find_all("a")
    if i.div.b.text == "Song results:":
        songs_a_tag = i
artist_results = [i.b.text for i in artist_a_tag]
songs_with_artist = re.findall(r"target=\"_blank\"><b>(.*?)<\/b><\/a>\s+by\s+<b>(.*?)<\/b><br", str(songs_a_tag), re.M|re.I|re.S)
songs_results = [" by ".join(i) for i in songs_with_artist]

希望这能解决您的问题,如果没有,请告诉我