以下是HTML:
<div class="ajaxcourseindentfix">
<h3>CPSC 353 - Introduction to Computer Security (3) </h3>
<hr>Security goals, security systems, access controls, networks and security, integrity, cryptography fundamentals, authentication. Attacks: software, network, website; management considerations, security standards in government and industry; security issues in requirements, architecture, design, implementation, testing, operation, maintenance, acquisition, and services.
<br>
<br>Prerequisite: <a href="preview_course_nopop.php?catoid=16&coid=96570" onclick="acalogPopup()">CPSC 253U</a>
<span style="display: none !important"> </span> or <a href="#" onclick="acalogPopup()" target="_blank">CPSC 254</a>
<span style="display: none !important"> </span> and <a href="#" onclick="acalogPopup()" target="_blank">CPSC 351</a>
<span style="display: none !important"> </span>
, declared major/minor in CPSC, CPEN, or CPEI
<br>
</div>
我需要从此HTML中获取以下文字:
从第6行 - 或
从第7行 - 和
,在CPSC,CPEN或CPEI中宣布主要/次要
我能够通过以下XPath获得href [课程编号:CPSC 254等...]:
# This xpath gives me all the tags followed by h3 and then I iterate through them in my script.
//div[@class='ajaxcourseindentfix']/h3/following-sibling::text()[2]/following-sibling::*
更新
然后是带有以下XPath的文本:
# This xpath gives me all the text after the h3 tag.
//div[@class='ajaxcourseindentfix']/h3/following-sibling::text()[2]/following-sibling::text()
我需要像在网址1一样使用这些课程名称/先决条件。
在这种方法中,我首先获得所有HREF,然后是所有文本。有没有更好的方法来实现这一目标?我不想迭代2个XPath来获得HREF,然后是Text,然后将它们组合起来形成先决条件字符串。
1 http://catalog.fullerton.edu/ajax/preview_course.php?catoid=16&coid=99648&show
答案 0 :(得分:2)
尝试使用以下代码获取所需的输出:
div = soup.select("div.ajaxcourseindentfix")[0]
" ".join([word for word in div.stripped_strings]).split("Prerequisite: ")[-1]
输出
'CPSC 253U or CPSC 254 and CPSC 351 , declared major/minor in CPSC, CPEN, or CPEI'