用于汽车搜索的网络抓取python

时间:2021-03-16 04:16:25

标签: python web-scraping beautifulsoup

我想从这个网站寻找小于 100K KM 的 Skoda 2018 https://www.autocenter.co.il/ 但是我找不到正确的方法 这是我所做的

from bs4 import BeautifulSoup
import requests
url = "https://www.autocenter.co.il/"
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')
#print((response.status_code))
first=soup.find_all("div",{"class":"product-wrapper-inner"})
print(first[0].text)

1 个答案:

答案 0 :(得分:1)

正如@Elyes 在评论中提到的,根据您的标准构建您的网址

from bs4 import BeautifulSoup
import requests
url = "https://www.autocenter.co.il/shop/?flr_manufacturer=196&flr_from_year=2018&flr_mileage_range=0-100000"
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')
#print((response.status_code))
first=soup.find_all("div",{"class":"col-lg-11 text-center px-4 px-lg-15"})
[i.text for i in first]

输出: