Question

我想将字符串与html页面的内容进行比较。但是HTML页面中的特殊字符使得这种比较更难。所以我想在比较之前从HTML页面中删除所有特殊字符和空格。但所有标签必须保持不变。

<div class="abc bcd">
         <div  class="inner1"> Hai ! this is first inner div;</div>
         <div class="inner2"> "this is second div... " </div>
</div>

这应该转换为

<div class="abc bcd">
          <div class="inner1">Haithisisfirstinnerdiv</div>
          <div class="inner2">thisisseconddiv</div>
</div>

如何做到这一点？

Answer 1

找到所有叶子标签并更改其字符串。

alphabet = 'abcdefghijklmnopqrtsuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ'

def replace(soup):
    for child in soup.children:
        if child.string:
            child.string = ''.join([ch for ch in child.string if ch in alphabet])
        else:
            replace(child)

from bs4 import BeautifulSoup

orig_string = """
<div class="abc bcd">
         <div  class="inner1"> Hai ! this is first inner div;</div>
         <div class="inner2"> "this is second div... " </div>
</div> """

soup = BeautifulSoup(orig_string)
print soup.prettify() # original HTML
replace(soup)
print
print soup.prettify() # new HTML

输出：

<html>
 <body>
  <div class="abc bcd">
   <div class="inner1">
    Hai ! this is first inner div;
   </div>
   <div class="inner2">
    "this is second div... "
   </div>
  </div>
 </body>
</html>

<html>
 <body>
  <div class="abc bcd">
   <div class="inner1">
    Haithisisfirstinnerdiv
   </div>
   <div class="inner2">
    thisisseconddiv
   </div>
  </div>
 </body>
</html>

Answer 2

首先，BeautifulSoup在调用BeautifulSoup()时已经修复了一些损坏的HTML所以：

<div  class="inner1">

转到

<div class="inner1">

以下是摆脱空白和特殊字符的方法：

>>> from bs4 import BeautifulSoup
>>> html = """<div class="abc bcd">
     <div  class="inner1"> Hai ! this is first inner div;</div>
     <div class="inner2"> "this is second div... " </div>
</div>""" 
>>> soup = BeautifulSoup(html)
>>> for divtag in soup.findAll('div'):
...     if 'inner' in divtag['class'][0]:
...         divtag.string = ''.join(i for i in divtag.string if i.isalnum())
>>> print soup
<html><body><div class="abc bcd">
<div class="inner1">Haithisisfirstinnerdiv</div>
<div class="inner2">thisisseconddiv</div>
</div></body></html>

BeautifulSoup删除标签内容的特殊字符

2 个答案: