试图抓取使用硒动态变化的数据?

时间:2020-04-20 12:09:10

标签: python selenium-webdriver web-scraping

我有一个网站,我需要抓取数据https://web.bet9ja.com/Sport/OddsToday.aspx?IDSport=590,当我一次用一个脚本单击时,我需要抓取所有匹配项及其数据。我想要的是我需要单击每个匹配项并获取该匹配项中的数据 到目前为止,我的代码是:

# Here using selenium for scraping
# importing necessary modules
import selenium.webdriver
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.by import By
import mysql.connector
import pymysql

# the relevant url
url = 'https://web.bet9ja.com/Sport/SubEventDetail?SubEventID=77106846'


driver = webdriver.Chrome(r"c:/Users/SATYA/mysite/chromedriver")
driver.get(url)
driver.implicitly_wait(10) # seconds
elements = [
    item.text for item in driver.find_elements_by_css_selector("div.SEOddLnk.ng-binding")]
names = [
    item.text for item in driver.find_elements_by_css_selector("div.SECQ.ng-binding")]
headings=names[0:3]+names[27:31]+names[85:87]+names[61:63]+names[88:90]


values = [
    item.text for item in driver.find_elements_by_css_selector("div.SEOddsTQ.ng-binding")]
keys=values[0:8]+values[148:156]+values[244:248]+values[280:284]

vals=elements[0:8]+elements[148:156]+values[244:248]+values[280:284]

0 个答案:

没有答案