Question

我有一个html页面，我想提取标签内部和内部对象_BFD.BFD_INFO的标题。我已经访问了里面的所有数据，但它有很多其他数据，如链接等，现在我不知道如何访问我想要提取的标题。请帮助我。＆＃xA;我编写的代码是

＆＃xA;＆＃xA;

 导入bs4为bs＆＃xA; import urllib3.request＆＃xA; import requests＆＃xA;＆ #xA; sauce =＆＃xA; requests.get（'https://www.meishij.net/zuofa/huaguluobodunpaigutang.html'）＆＃xA; print（sauce.status_code）＆＃xA; soup = bs.BeautifulSoup （sauce.content，'html.parser'）＆＃xA; #print（soup.find_all（“script”，type =“text / javascript”）[9]）＆＃xA; print（soup.find（“script “，type =”text / javascript“）[9]）＆＃xA;

＆＃xA;＆＃xA;

这就是html

＆＃xA; ＆＃xA;

＆＃xD;＆＃xA ;

＆＃xD;＆＃xA;

 ＆lt; script type =“text / javascript” ＆GT;＆＃的xD;＆＃XA; _czc.push（[ '_trackEvent'， 'PC'， 'pc_news']）;＆＃的xD;＆＃XA; _czc.push（[ '_trackEvent'， 'pc'，'pc_news_class_6']）;＆＃xD;＆＃xA; window [“_ BFD”] = window [“_ BFD”] || {};＆＃xD;＆＃xA; _BFD.BFD_INFO = {＆＃xD;＆＃xA;“title”：“花菇萝卜炖排骨汤”，＆＃xD;＆＃xA;＆lt; / script＆gt;

＆＃的xD;＆＃XA;

＆＃的xD;＆＃XA; ＆＃XA;

Answer 1

我对正则表达式并不擅长，可以用它来找到＆＃39;标题＆＃39;在一条线上。我想下面的代码应该可以工作。

import json
import requests
from bs4 import BeautifulSoup
url = 'https://www.meishij.net/zuofa/huaguluobodunpaigutang.html'
headers = requests.utils.default_headers()
headers.update({
    'User-Agent': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0',
})

Link = requests.get(url, headers=headers)
soup =BeautifulSoup(Link.content,"lxml")
scripts = soup.find_all("script")
for script in scripts:
    if "_BFD.BFD_INFO" in script.text:
        text = script.text
        m_text = text.split('=')
        m_text = m_text[2].split(":")
        m_text = m_text[1].split(',')
        encoded = m_text[0].encode('utf-8')
        print(encoded.decode('utf-8'))

获取pic的更新：

for script in scripts:
    text = script.text
    m_text = text.split(',')
    for n in m_text:
        if 'pic'  in n:
            print(n)

输出：

C:\Users\siva\Desktop>python test.py

"pic" :"http://s1.st.meishij.net/r/216/197/6174466/a6174466_152117574296827.jpg"

更新2：

for script in scripts:
text = script.text
m_text = text.split('_BFD.BFD_INFO')
for t in m_text:
    if "title" in t:
        print(t.split(","))

输出：

C:\Users\SSubra02\Desktop>python test.py
[' = {\r\n"title" :"????????"', '\r\n"pic" :"http://s1.st.meishij.net/r/216/197/
6174466/a6174466_152117574296827.jpg"', '\r\n"id" :"1883528"', '\r\n"url" :"http
s://www.meishij.net/zuofa/huaguluobodunpaigutang.html"', '\r\n"category" :[["??"
', '"https://www.meishij.net/chufang/diy/recaipu/"]', '["??"', '"https://www.mei
shij.net/chufang/diy/tangbaocaipu/"]', '["???"', '"https://www.meishij.net/chufa
ng/diy/jiangchangcaipu/"]', '["??"', '"https://www.meishij.net/chufang/diy/wucan
/"]', '["??"', '"https://www.meishij.net/chufang/diy/wancan/"]]', '\r\n"tag" :["
??"', '"??"', '"??"', '"????"', '"????"', '"????"]', '\r\n"author":"????"', '\r\
n"pinglun":"3"', '\r\n"renqi":"4868"', '\r\n"step":"7?"', '\r\n"gongyi":"?"', '\
r\n"nandu":"????"', '\r\n"renshu":"4??"', '\r\n"kouwei":"???"', '\r\n"zbshijian"
:"10??"', '\r\n"prshijian":"<90??"', '\r\n"page_type" :"detail"\r\n};window["_BF
D"] = window["_BFD"] || {};_BFD.client_id = "Cmeishijie";_BFD.script = document.
createElement("script");_BFD.script.type = "text/javascript";_BFD.script.async =
 true;_BFD.script.charset = "utf-8";_BFD.script.src =((\'https:\' == document.lo
cation.protocol?\'https://ssl-static1\':\'http://static1\')+\'.baifendian.com/se
rvice/meishijie/meishijie.js\');']

如果您遇到任何问题，请告诉我。

使用python3中的BeautifulSoup在html <script>中提取标题

1 个答案: