使用Beautiful Soup从非类节获取数据

时间:2014-01-18 11:49:27

标签: python parsing python-2.7 html-parsing beautifulsoup

我还是新手,学习蟒蛇和美丽的汤。我已经知道如何从非类的HTML中获取文本。

这是我正在使用的HTML代码片段:

<section class="userbody">
    <script type="text/javascript"></script>
    <figure class="iw">
        <div id="ci">
            <img id="iwi" title="image 2" alt="" src="http://images.craigslist.org/00C0C_daJm4U9yU5B_600x450.jpg" style="min-width: inherit; min-height: 450px;"></img>
        </div>
        <div id="thumbs"></div>
    </figure>
    <div class="mapAndAttrs">
        <div class="mapbox">
            <div id="map" class="leaflet-container leaflet-fade-anim" data-longitude="-84.072447" data-latitude="33.908534" tabindex="0">
                <div class="leaflet-map-pane" style="transform: translate(0px, 0px);"></div>
                <div class="leaflet-control-container">
                    <div class="leaflet-top leaflet-left"></div>
                    <div class="leaflet-top leaflet-right"></div>
                    <div class="leaflet-bottom leaflet-left"></div>
                    <div class="leaflet-bottom leaflet-right">
                        <div class="leaflet-control-attribution leaflet-control"></div>
                    </div>
                </div>
            </div>
            <div class="mapaddress">

                Some Address

            </div>
        </div>
        <div class="attributes"></div>
    </div>
    <section id="postingbody">
            some posting info
            <br></br>
             more posting info
             <br></br>
    </section>
    <section class="cltags"></section>
    <div class="postinginfos"></div>
</section>

我已经能够提取地址信息:

     for address in soup.findAll("div", { "class" : "mapaddress" }):
       addressText = ''.join(address.findAll(text=True))

看来findAll()不能用于没有我正在尝试的类的标签

     for post in soup.findall("section", { "id" : "postingbody" }):
       postText = ''.join(post.findAll(text=True))

如何抓取id =“postbody”部分中的文字?

3 个答案:

答案 0 :(得分:1)

考虑到s是html字符串:

,您可以执行以下操作
from bs4 import BeautifulSoup

soup = BeautifulSoup(s)
print soup.find(attrs={'id' : 'postingbody'})

输出:

<section id="postingbody">
            some posting info
            <br/>
             more posting info
             <br/>
</section>

答案 1 :(得分:1)

除了游戏Brainiac的回答:要把文本放在背后.text。

所以:

print soup.find(attrs={'id' : 'postingbody'}).text

答案 2 :(得分:1)

如果你使用的是BeautifulSoup4,你可以这样做:

element = soup.find(id="postingbody")