另一天另一个问题,对不起所有的帖子。昨天用户“J.F. Sebastian”给了我一个很好的建议,使用LXML.HTML而不仅仅是使用LXML。
我今天将它用于另一个Feed http://feeds.bbc.co.uk/iplayer/search/tv/?q=news
,但我无法访问内容元素中的几个标记。
以下是Feed数据的示例:
<entry>
<title type="text">BBC News at Six: 06/03/2013</title>
<id>tag:feeds.bbc.co.uk,2008:PIPS:b01r27mt</id>
<updated>2013-03-07T00:20:38Z</updated>
<content type="html">
<p>
<a href="http://www.bbc.co.uk/iplayer/episode/b01r27mt/BBC_News_at_Six_06_03_2013/">
<img src="http://ichef.bbci.co.uk/programmeimages/episode/b01r27mt_150_84.jpg" alt="BBC News at Six: 06/03/2013" />
</a>
</p>
<p>
National and international news stories from the BBC News team, followed by weather.
</p>
</content>
<category term="News" />
<category term="TV" />
<link rel="alternate" href="http://www.bbc.co.uk/iplayer/episode/b01r27mt/BBC_News_at_Six_06_03_2013/" type="text/html" title="BBC News at Six: 06/03/2013">
<media:content>
<media:thumbnail url="http://ichef.bbci.co.uk/programmeimages/episode/b01r27mt_150_84.jpg" width="150" height="84" />
</media:content>
</link>
<link rel="self" href="http://feeds.bbc.co.uk/iplayer/episode/b01r27mt" type="application/atom+xml" title="06/03/2013" />
<link rel="related" href="http://www.bbc.co.uk/programmes/b007mpkn/microsite" type="text/html" title="BBC News at Six" />
</entry>
内容标记中的标记似乎是文本,无法正确解析。这是我的代码:
tree = html.parse("http://feeds.bbc.co.uk/iplayer/search/tv/?q=news")
for show in tree.xpath('//entry'):
select = lambda expr: show.cssselect(expr)[0]
icon_url=select("thumbnail").get('url')
print "icon_url: ", icon_url
name=select('title').text_content()
print "name: ", name
stream=select('id').text_content()
print "stream: ", stream
date=select('updated').text_content()
print "date: ", date
content=select('content').text_content()
print "content: ", content
#links = (re.compile ('\n <p>\n <a href=".+?">\n <img src="(.+?)" alt=".+?" />\n </a>\n </p>\n <p>\n ').findall(content))
#print "links: ", links
#short=links
#print "short: ", short
我想将程序描述的第二个p标记放到上面的短变量中,但我似乎无法使用lxml选择此标记,并且我无法使用正则表达式来选择我想要的行..
有什么想法吗?
答案 0 :(得分:1)
您需要取消引用该文本以获取html
,然后再次解析它。
来自here
from xml.sax import saxutils as su
unqoutedHtml = su.unescape(content)
newElement = html.document_fromstring(unqoutedHtml)