Question

相对来说是初学者。有与此类似的主题，但是我可以看到我的解决方案的工作原理，我只需要帮助连接这最后几个点。我想在没有使用API的情况下从中删除Instagram的关注者人数。这是我到目前为止的内容：

Python 3.7.0
from selenium import webdriver
from bs4 import BeautifulSoup
driver = webdriver.Chrome()

> DevTools listening on ws://.......

driver.get("https://www.instagram.com/cocacola")
soup = BeautifulSoup(driver.page_source)
elements = soup.find_all(attrs={"class":"g47SY "}) 
# Note the full class is 'g47SY lOXF2' but I can't get this to work
for element in elements:
    print(element)

>[<span class="g47SY ">667</span>,
  <span class="g47SY " title="2,598,456">2.5m</span>, # Need what's in title, 2,598,456
  <span class="g47SY ">582</span>]

for element in elements:
    t = element.get('title')
    if t:
        count = t
        count = count.replace(",","")
    else:
        pass

print(int(count))

>2598456 # Success

有没有更简单或更快捷的方法获得2,598,456的电话号码？我最初的希望是，我可以只使用'g47SY lOXF2'类，但是据我所知，该类名称中的空格在BS4中不起作用。只是要确保此代码简洁实用。

Answer 1

我不得不使用无头选项并添加了execute_path进行测试。您可以删除它。

from selenium import webdriver
from bs4 import BeautifulSoup
from selenium.webdriver.chrome.options import Options

options = Options()
options.add_argument("--headless")
driver = webdriver.Chrome(executable_path="chromedriver.exe",chrome_options=options)

driver.get('https://www.instagram.com/cocacola')

soup = BeautifulSoup(driver.page_source,'lxml')

#This will give you span that has title attribute. But it gives us multiple results
#Follower count is in the inner of a tag.
followers = soup.select_one('a > span[title]')['title'].replace(',','')

print(followers)
#Output 2598552

Answer 2

您可以使用正则表达式获取数字。试试这个：

import re

fallowerRegex = re.compile(r'title="((\d){1,3}(,)?)+')
fallowerCount = fallowerRegex.search(str(elements))
result = fallowerCount.group().strip('title="').replace(',','')

使用Python，Selenium和BeautifulSoup抓取标签内容？

2 个答案: