如何使用xpath单击下一页

时间:2019-11-18 09:26:24

标签: python python-3.x selenium-webdriver selenium-chromedriver

from selenium import webdriver
from bs4 import BeautifulSoup as bs
import time

url = 'http://dciindia.gov.in/DentistsSearch.aspx?Reg_Type=D&RegUnder=0&IDRId=&IDRName=&CourseId=0&RegDate=0&CouncilId='

driver = webdriver.Chrome('C:\chromedriver.exe')
driver.get(url)
driver.maximize_window()

soup = bs(driver.page_source, 'html.parser')
table = soup.find('table',{'id':'gvSearchDentistlist'})

next_page = True
while next_page == True:
    soup = bs(driver.page_source, 'html.parser')
    table = soup.find('table',{'id':'gvSearchDentistlist'})
    try:
        rows = table.find_all('tr')
        for row in rows:
            if len(row.find_all('td')) == 6:
                data = row.find_all('td')
                name = data[1].text.strip()
                print("NAME:"+name)
                root_url = data[5].input['onclick'].split(",")[4]
                link ='http://dciindia.gov.in/'+root_url
                print("LINK:"+link)
    except:
        pass
    try:
        driver.find_element_by_xpath('//*[@id="gvSearchDentistlist"]/tbody/tr[52]/td/table/tbody/tr/td[1]').click()
        time.sleep(1)
    except:
        print ('No more pages')
        next_page=False

driver.close()

我无法单击下一页。我不知道结束页面,也没有单击“下一步”按钮,页面分别为1,2,3 ..等。

1 个答案:

答案 0 :(得分:0)

我打开了网站, http://dciindia.gov.in/DentistsSearch.aspx?Reg_Type=D&RegUnder=0&IDRId=&IDRName=&CourseId=0&RegDate=0&CouncilId=

发现页面已记录总数

site

您只需要一些数学。然后获取总页数。

您可以使用这种方法来调整是否有下一页吗?