如何从列表中提取一些特定的字符串并将其存储在beautifulsoup中的变量中?

时间:2019-02-16 21:39:50

标签: python-3.x web-scraping beautifulsoup html-parsing

我想从包含多个标签(和字符串)的多个项目的列表中提取特定的字符串。并将它们存储到变量中。

from bs4 import BeautifulSoup
from requests_html import HTMLSession
session = HTMLSession()
r = session.get('https://www.khanacademy.org/profile/DFletcher1990/')
r.html.render(sleep=5)

soup=BeautifulSoup(r.html.html,'html.parser')

user_socio_table=soup.find_all('div', class_='discussion-stat')
print(user_socio_table)

以下是print(user_socio_table)的假定输出:

[<div class="discussion-stat">
            4<span class="discussion-light"> questions</span>
</div>, <div class="discussion-stat">
            444<span class="discussion-light"> votes</span>
</div>, <div class="discussion-stat">
            718<span class="discussion-light"> answers</span>
</div>, <div class="discussion-stat">
            15<span class="discussion-light"> flags raised</span>
</div>, <div class="discussion-stat">
            10<span class="discussion-light"> project help requests</span>
</div>, <div class="discussion-stat">
            38<span class="discussion-light"> project help replies</span>
</div>, <div class="discussion-stat">
            208<span class="discussion-light"> comments</span>
</div>, <div class="discussion-stat">
            11<span class="discussion-light"> tips and thanks</span>
</div>]
  • 我想将4存储到名为questions的变量中,
  • 我想将444存储到名为votes的变量中,
  • 我想将718存储到名为answers的变量中,
  • 我想将15存储到名为flags的变量中,
  • 我想将10存储到名为help_requests的变量中,
  • 我想将38存储到名为help_replies的变量中,
  • 我想将208存储到名为comments的变量中,
  • 我想将11存储到名为tips_thanks的变量中。

感谢您的帮助!

1 个答案:

答案 0 :(得分:1)

您可以将值一一添加到json数组中

data = {}
for gettext in user_socio_table:
   category = gettext.find('span')
   category_text = category.text.strip()  ## get text in span
   number = category.previousSibling.strip() ## get value before span tag
   data[category_text] = number ## add it


print(data)

输出:

{'questions': '4', 'votes': '444', 'answers': '718', 'flags raised': '15', 'project help requests': '10', 'project help replies': '38', 'comments': '208', 'tips and thanks': '11'}

您可以通过专业的方式获得价值

print(data['questions'])

输出:

4