无法滚动元素以查看和单击。蟒蛇硒

时间:2020-12-27 16:39:59

标签: python python-3.x selenium web-scraping

我正在尝试从此页面获取附加组件。如果项目可定制

https://www.swiggy.com/restaurants/imperial-restaurant-shivajinagar-central-bangalore-bangalore-48556

收集所有divs后,我尝试转到页面顶部(不起作用)。我检查 customisable div 是否存在。如果是这样,请将其滚动到视图中,单击添加按钮并获取添加详细信息。我试过,actionChains,没有用。 execute_script 也什么都不做。点击之前可以正常工作,但页面上下滚动有点搞砸了。几个小时以来一直试图做到这一点。非常感谢任何帮助。

    for i in range(6):
        item_dvs = driver.find_elements_by_class_name('_2wg_t')
        driver.execute_script("window.scrollBy(0, 3100)")
    driver.execute_script("window.scrollBy(0,-18500);")
    for div in item_dvs:
        try:
            name = div.find_element_by_class_name('styles_itemNameText__3bcKX')
            price = div.find_element_by_class_name('rupee')
            if div.find_elements_by_class_name('styles_itemDesc__MTsVd'):
                desc = div.find_element_by_class_name('styles_itemDesc__MTsVd').text
            else:
                desc = None
            is_cust = div.find_element_by_class_name('_1C1Fl _23qjy')
            if is_cust:
                driver.execute_script("arguments[0].scrollIntoView();", is_cust)

1 个答案:

答案 0 :(得分:1)

首先,我建议您使用WebDriverWait,因为当元素不存在时,if div.find_elements_by_class_name('styles_itemDesc__MTsVd')is_cust = div.find_element_by_class_name('_1C1Fl _23qjy') 行会抛出异常。使用 WebDriverWait 的另一个原因是等待添加按钮可点击。这里有两个问题的解决方案,您可以使用 try/catch 来处理描述和“可定制”元素的存在,并且您可以等待添加按钮可点击:

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as ec
from selenium import webdriver
from selenium.webdriver.common.action_chains import ActionChains
from selenium.common.exceptions import TimeoutException


driver = webdriver.Chrome()
driver.get("https://www.swiggy.com/restaurants/imperial-restaurant-shivajinagar-central-bangalore-bangalore-48556")
wait = WebDriverWait(driver, 10)

try:
    item_dvs = []
    for i in range(6):
        item_dvs = wait.until(ec.visibility_of_all_elements_located((By.CLASS_NAME, '_2wg_t')))
        driver.execute_script("window.scrollBy(0, 3100)")
    driver.execute_script("window.scrollBy(0,-18500);")

    for div in item_dvs:
        wait_div = WebDriverWait(div, 10)
        name = wait_div.until(ec.visibility_of_element_located((By.CLASS_NAME, 'styles_itemNameText__3bcKX')))
        price = wait_div.until(ec.visibility_of_element_located((By.CLASS_NAME, 'rupee')))

        try:
            desc = wait_div.until(ec.visibility_of_element_located((By.XPATH, ".//div[contains(@class, 'styles_itemDesc__MTsVd')]"))).text
        except TimeoutException:
            desc = None

        try:
            is_cust = wait_div.until(ec.visibility_of_element_located((By.XPATH, ".//div[contains(@class, '_1C1Fl _23qjy')]")))
            add_on = wait_div.until(ec.element_to_be_clickable((By.XPATH, ".//div[contains(@class, 'F8dpS _3L1X9')]")))
            ActionChains(driver).move_to_element(add_on).click().perform()
            # get add on details
            # close add window
        except TimeoutException:
            pass

    driver.close()

except Exception as e:
    driver.close()
    raise e