无法使用 Selenium 从网站上抓取文本

时间:2021-07-14 15:39:54

标签: python html selenium selenium-webdriver web-scraping

我想获取附加图片中显示的字段值。这是我的示例代码,它没有获取必填字段,欢迎进行任何更正。

span_xpath = "//div[@id='se-siteDetailsPanel-panel']"
name_xpath = "//div[@id='se-siteDetailsPanel-name']" + span_xpath
site_data.append(browser.find_element_by_xpath(name_xpath).text)

# address:
adrs1_xpath = "//div[@id='se-siteDetailsPanel-firstAddress']" + span_xpath
adrs2_xpath = "//div[@id='se-siteDetailsPanel-address']" + span_xpath
address = browser.find_element_by_xpath(adrs1_xpath).text + \
          browser.find_element_by_xpath(adrs2_xpath).text
site_data.append(address)

# installed: 
installed_xpath = "//div[@id='se-siteDetailsPanel-installationDate']" + span_xpath
site_data.append(browser.find_element_by_xpath(installed_xpath).text)

#updated
updated_xpath = "//div[@id='se-siteDetailsPanel-lastUpdateTime']" + span_xpath
site_data.append(browser.find_element_by_xpath(updated_xpath).text)

# peak:
peak_xpath = "//div[@id='se-siteDetailsPanel-peakPower']" + span_xpath
peak = browser.find_element_by_xpath(peak_xpath).text
site_data.append(peak.split()[0])

Website Needed to be scrapped

2 个答案:

答案 0 :(得分:1)

您可以尝试使用 xpathBy_id

如果找不到 XPath,请尝试在 chrome 中使用 chropath 扩展,您将很容易找到 xpath。

答案 1 :(得分:0)

@itronic1990...你的提示实际上起作用了我看到 xspan 是错误的我更正了跨度路径并开始获取值 –