Question

我遇到了问题，我可以找到解决问题的方法。我正在尝试解析html页面，然后使用Beautiful Soup替换字符串。虽然这个过程看起来是正确的，但是当我打开新的html页面时我没有遇到任何错误，我得到了一些我不想要的utf-8字符。

工作代码示例：

#!/usr/bin/python

import codecs
from bs4 import BeautifulSoup

html_sample = """
<!DOCTYPE html>
<html><head lang="en"><meta charset="UTF-8"><meta name="viewport" content="width=device-width, initial-scale=1"></head>
<body>
<div class="date">LAST UPDATE</div>
</body>
</html>
"""

try:
    my_soup = BeautifulSoup(html_sample.decode('utf-8'), 'html.parser')  # html5lib or html.parser
    forecast = my_soup.find("div", {"class": "date"})
    forecast.tag = unicode(forecast).replace('LAST UPDATE', 'TEST')
    forecast.replace_with(forecast.tag)
    # print(my_soup.prettify())

    f = codecs.open('test.html', "w", encoding='utf-8')
    f.write(my_soup.prettify().encode('utf-8'))
    f.close()
except UnicodeDecodeError as e:
    print('Error, encoding/decoding: {}'.format(e))
except IOError as e:
    print('Error Replacing: {}'.format(e))
except RuntimeError as e:
    print('Error Replacing: {}'.format(e))

在新的html页面中输出utf-8字符：

<!DOCTYPE html>
<html>
 <head lang="en">
  <meta charset="utf-8">
   <meta content="width=device-width, initial-scale=1" name="viewport"/>
  </meta>
 </head>
 <body>
  &lt;div class="date"&gt;TEST&lt;/div&gt;
 </body>
</html>

我认为我已经混淆了编码和解码过程。对这个领域有更多了解的人可以详细说明。我是编码和编码的初学者。

感谢您提前花时间和精力。

Answer 1

这里没有必要进行编码。您可以通过设置element.string来替换Beautiful Soup元素的文本内容，如下所示：

from bs4 import BeautifulSoup

html_sample = """
<!DOCTYPE html>
<html><head lang="en"><meta charset="UTF-8"><meta name="viewport" content="width=device-width, initial-scale=1"></head>
<body>
<div class="date">LAST UPDATE</div>
</body>
</html>
"""

soup = BeautifulSoup(html_sample)
forecast = soup.find("div", {"class": "date"})
forecast.string = 'TEST'
print(soup.prettify())

<强>输出

<!DOCTYPE html>
<html>
 <head lang="en">
  <meta charset="utf-8"/>
  <meta content="width=device-width, initial-scale=1" name="viewport"/>
 </head>
 <body>
  <div class="date">
   TEST
  </div>
 </body>
</html>

如何避免使用replace_with在BeautifulSoup中打印utf-8字符

1 个答案: