Python Beautifulsoup。解析<p> </p>

Question

我正在学习如何用Beautifulsoup解析。有人可以解释我如何解析<p></p>中的div class="article-content"元素。我想在脚本启动后只看到内容信息。让我演示我想要的东西：

我可以解析div class="article-content"，但无法在<p></p>中找到相关信息。我的代码看起来像这样：

import urllib2
from bs4 import BeautifulSoup

html = urllib2.urlopen('http://www.engadget.com/2014/10/17/local-multiplayer-is-coming-to-android-games/')
parsed_html = BeautifulSoup(html)
print parsed_html.body.find('div', attrs={'class':'article-content'}).text

但我也得到了很多垃圾：

$ python engadget_parser.py


Ever wish that you could just whip out your Android device and harass a passer-by to play games with you? It's the sort of thing that Nintendo DS users, for example, have been using thanks to that company's StreetPass feature, but, until now, hasn't been available on Google's smartphones. Now, however, the company has an added an update to its games infrastructure that enables "ambient, real-time" games with more than one user - so long that the game relies upon Google's home-grown multiplayer backend. Still, maybe don't sprint into the street and start challenging people to a dual, because they might get the wrong idea.





        onBreak({
            0: function(){
                (function() {
                        var a = {
                                mobilePlacementID: "348-14-15-135b",
                        width: "320",
                        height: "115"
                        };
                    madserver.requestAd(a);
                })();
            },
            768: function(){}
        });






Source: Android Developers (G+)



Tags: android, AndroidGames, gaming, google, googleplaygames, mobile, mobilepostcross





 Hide Comments
0Comments










            _when_.eng("eng.livefyre.init", {
                articleId: 20979699 ,
                domain: "engadget.fyre.co" ,
                siteId: "296092" ,
                el: "livefyre_20979699",
                initialNumVisible: 2
            })



_when_.eng("eng.perm.init");



lab.scriptBs('gravity.js')




onBreak({
    0: function(){},
    320: function(){},
    768: function(){}
});

谢谢！

Answer 1

在这种情况下，我喜欢beautifulsoup的select方法。替换这个：

print parsed_html.body.find('div', attrs={'class':'article-content'}).text

有了这个：

for p in parsed_html.select('div.article-content p'):
    print p.text

Answer 2

也许这是非常糟糕的代码，但无论如何我会告诉他，不要戳我，我只是Python的初学者：

import urllib2
from bs4 import BeautifulSoup

url  = "http://www.engadget.com/2014/10/17/castar-augmented-reality/"

html = urllib2.urlopen(url)
parsed_html = BeautifulSoup(html)


def news_parser(url):
    list = []
    for p in parsed_html.select('div.article-content p'):
        list.append(p.text)
    return list


def longest_text_position(list):
    # sometimes article is not in list[1] position, so I am searching a longest element in list
    a = 0
    longest_text = ""

    for item in list:
        x = len(item)
        if x > a:
            a = x
            longest_text = item

    position = list.index(longest_text)  
    return position


def print_news(position):
    print "-" * 80
    print parsed_html.title.string
    print "-" * 80
    print list[position]
    print "-" * 80
    print " "

list = news_parser(url)
position = longest_text_position(list)
print_news(position)

结果是：

$ python engadget_parser_new.py 
--------------------------------------------------------------------------------
castAR bets big on its augmented reality hardware with move to Silicon Valley
--------------------------------------------------------------------------------
And they certainly were. From just a brief hands-on with the new hardware, I could tell the  make out ....ating that I could look around objects by just walking around the table. Henkel-Wallace mentioned a potential for a holodeck application by blanketing a room with that retroreflective material, and I could certainly see a use case for that.
--------------------------------------------------------------------------------

谢谢@Vincent Beltman。