无法从类似盒子的容器中获取标题

时间:2018-07-20 18:43:29

标签: python python-3.x selenium selenium-webdriver web-scraping

我已经与python一起在selenium中编写了一个脚本,以单击网页地图上可用的一些点。单击一个点时,将弹出一个包含相关信息的小框。

Link to that site

我想解析每个框的标题。当我执行脚本时,单击一个点会引发错误。我怎样才能成功?

这是脚本:

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

link = "replace with above link"

driver = webdriver.Chrome()
driver.get(link)
wait = WebDriverWait(driver, 10)
wait.until(EC.presence_of_element_located((By.CSS_SELECTOR,"#mapDiv_zoom_slider .esriSimpleSliderIncrementButton"))).click()
for item in wait.until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR,"#NWQMC_VM_directory_June2016_3915_0_layer circle"))):
    item.click()

我遇到错误:

line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: unknown error: Element <circle fill="rgb(237, 81, 81)" fill-opacity="1" stroke="rgb(153, 153, 153)" stroke-opacity="1" stroke-width="1" stroke-linecap="butt" stroke-linejoin="miter" stroke-miterlimit="4" cx="720" cy="430" r="4" transform="matrix(1.00000000,0.00000000,0.00000000,1.00000000,0.00000000,0.00000000)" fill-rule="evenodd" stroke-dasharray="none" dojoGfxStrokeStyle="solid"></circle> is not clickable at point (720, 430). Other element would receive the click: <circle fill="rgb(20, 158, 206)" fill-opacity="1" stroke="rgb(153, 153, 153)" stroke-opacity="1" stroke-width="1" stroke-linecap="butt" stroke-linejoin="miter" stroke-miterlimit="4" cx="720" cy="430" r="4" transform="matrix(1.00000000,0.00000000,0.00000000,1.00000000,0.00000000,0.00000000)" fill-rule="evenodd" stroke-dasharray="none" dojoGfxStrokeStyle="solid"></circle>
  (Session info: chrome=67.0.3396.99)
  (Driver info: chromedriver=2.36.540470 (e522d04694c7ebea4ba8821272dbef4f9b818c91),platform=Windows NT 6.1.7601 SP1 x86)

这是弹出框的方式:

enter image description here

2 个答案:

答案 0 :(得分:2)

要回答您的特定问题,您不能像往常一样与svg元素进行交互。为此,您必须使用示例中提供的xPath。另外,您无法像平常一样单击这些元素,但可以使用ActionChains

wait = WebDriverWait(driver, 5)
wait.until(EC.presence_of_element_located((By.CSS_SELECTOR,"#mapDiv_zoom_slider .esriSimpleSliderIncrementButton"))).click()
time.sleep(3)
items = driver.find_elements_by_xpath("//*[name()='svg']//*[name()='circle']")
i = 0
for item in items:
    try:
        time.sleep(1)
        ActionChains(driver).move_to_element(item).click(item).perform()
    except Exception:
        print("Can't click")

此代码有效,将单击每个元素,直到地图被放大。在其中一个元素上,地图被放大,此后将不起作用。为什么?我还没有找到答案,但是您可以自己找到它,或者提出另一个问题,我们将尽力为您提供帮助。

注意: ,您必须添加一些导入:

from selenium.webdriver.common.action_chains import ActionChains
import time

编辑: 我发现了问题,单击后必须关闭每个弹出窗口,然后它才能工作。工作代码如下:

wait = WebDriverWait(driver, 5)
wait.until(EC.presence_of_element_located((By.CSS_SELECTOR, "#mapDiv_zoom_slider .esriSimpleSliderIncrementButton"))).click()
time.sleep(3) # wait until all elements will be ready
items = driver.find_elements_by_xpath("//*[name()='svg']//*[name()='circle']")
for item in items:
    time.sleep(0.5) # small pause before each iteration
    ActionChains(driver).move_to_element(item).click(item).perform()
    wait.until(EC.element_to_be_clickable((By.XPATH, "//div[@title = 'Close']"))).click()

我没有找到避免time.sleep()的方法,在这种情况下可能是不可能的。

答案 1 :(得分:2)

@Andrei Suvorkov真的很接近(+1)

尝试以下代码以获取所需的输出:

from selenium.webdriver.common.action_chains import ActionChains

driver = webdriver.Chrome()
driver.get(link)
wait = WebDriverWait(driver, 5)
driver.maximize_window()

items = wait.until(EC.presence_of_all_elements_located((By.XPATH, "//*[name()='svg']//*[name()='circle']")))
for item in items:
    ActionChains(driver).move_to_element(item).click(item).perform()
    popup = wait.until(EC.visibility_of_element_located((By.CLASS_NAME, "contentPane")))
    print(popup.text)
    wait.until(EC.visibility_of_element_located((By.XPATH, "//div[contains(@class, 'close')]"))).click()