如何抓取页面的标题?

时间:2021-02-13 16:22:03

标签: python selenium-webdriver xpath css-selectors webdriverwait

我不知道如何抓取页面的标题,下面是我的代码(很简单),但我不知道哪里错了,如果您有任何想法,请告诉我,谢谢。

>

enter image description here

enter image description here

from selenium import webdriver
url="https://sukebei.nyaa.si/?s=seeders&o=desc&p=1"
driver_path = "C:\\webdriver\\chromedriver.exe"
option = webdriver.ChromeOptions()
driver = webdriver.Chrome(driver_path, options=option)
driver.implicitly_wait(10)
driver.get(url)
print(driver.find_element_by_xpath("/html/head/title").text)

2 个答案:

答案 0 :(得分:2)

要抓取页面标题,您必须使用 torrent-list<table> 引入 WebDriverWaitvisibility_of_element_located(),您可以使用以下任一方法以下Locator Strategies

  • 使用 CSS_SELECTOR

    driver.get('https://sukebei.nyaa.si/?s=seeders&o=desc&p=1')
    WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.CSS_SELECTOR, "table.torrent-list")))
    print(driver.title)
    
  • 使用 XPATH

    driver.get('https://sukebei.nyaa.si/?s=seeders&o=desc&p=1')
    WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//table[contains(@class, 'torrent-list')]")))
    print(driver.title)
    
  • 控制台输出:

    Browse :: Sukebei
    
  • 注意:您必须添加以下导入:

    from selenium.webdriver.support.ui import WebDriverWait
    from selenium.webdriver.common.by import By
    from selenium.webdriver.support import expected_conditions as EC
    

答案 1 :(得分:1)

from selenium import webdriver
url="https://sukebei.nyaa.si/?s=seeders&o=desc&p=1"
driver_path = "C:\\webdriver\\chromedriver.exe"
option = webdriver.ChromeOptions()
driver = webdriver.Chrome(driver_path, options=option)
driver.implicitly_wait(10)
driver.get(url)
print(driver.title)