Question

我正在尝试从Booking.com进行刮板评论。我随机选择了一家酒店，并让硒获取了元素，然后尝试定位以从BeautifulSoup获得评论，如下所示，但结果未返回任何数据。请问您的建议是什么地方出了什么问题以及如何解决？

from selenium import webdriver
from bs4 import BeautifulSoup

driver = webdriver.Chrome(executable_path="./driver/chromedriver.exe")
driver.get("https://booking.com")

driver.find_element_by_css_selector("input[class*='sb-searchbox__input']").send_keys("Eden The Residence at The Sea")
driver.find_element_by_css_selector("button[type='submit']").click()
driver.find_element_by_xpath("//span[contains(text(),'Eden The Residence at The Sea')]").click()
soup = BeautifulSoup(driver.page_source,"html.parser")
containers = soup.find_all("div", {"class": "review_list_container"})
reviews = containers[0].find_all("ul")

Answer 1

您必须将焦点切换到打开的新选项卡。您可以使用

driver.switch_to.window(driver.window_handles[1])

这是最终代码：

from selenium import webdriver
from bs4 import BeautifulSoup
import time

driver = webdriver.Chrome()
driver.get("https://booking.com")

time.sleep(2)
driver.find_element_by_css_selector("input[class*='sb-searchbox__input']").send_keys("Eden The Residence at The Sea")
driver.find_element_by_css_selector("button[type='submit']").click()
driver.find_element_by_xpath("//span[contains(text(),'Eden The Residence at The Sea')]").click()
time.sleep(3)
driver.switch_to.window(driver.window_handles[1])
soup = BeautifulSoup(driver.page_source,"html.parser")

containers = soup.find_all("span", {"class": "c-review__body"})

for span in containers:
    print(span.text)

输出：

“The location is great just few minutes walk to the beach”
“The entire experience was flawless. This is the most beautiful villa I've ever stayed in, let alone, seen. The staff were outstanding and so friendly and professional. The private chefs that cooked breakfast in our Villa was amazing, and SO well pri…
“The staff were great and it was very easy to order meals and have them prepared at a very reasonable price.”
“The villa is spacious and airy with a large private pool.
Bedrooms are large each with their own bathroom facilties.
The staff go above and beyond to make your stay as comfortable as possible.”
“Excellent , friendly helpful staff
Beautiful patio, garden and pool
Very spacious villa 
Fast laundry service
Decorate the villa and bath with flowers for my wife’s birthday ”
“We loved almost everything about Eden Residence from the location, the quality of the villa, the staff, the cost and the room service (cooks came and prepared meals at the cost to buy groceries plus 15%).
The staff are super friendly and we felt ext…
“Great accomodation. Lots of space. Great pool. Good service”
“Everything! The spacious living room, big toilet, beautiful surroundings. Not to forget, fantastic service by all the staff! Sampai jumpa lagi semuanyaaa ??”
“Staff were exceptional. They went above and beyond to meet our needs at all hours of the day/night. Great, convenient location. Large spacious rooms all each with their own bathroom/ensuite. Pool was amazing. Staff cooked traditional suckling pig fo…
“Luxury Villa
Excellent friendly staff
Private pool
Ocean View sunsets from rooftop 
Walking distance to beach”

从侧边栏小部件Selenium Pthon中删除评论

1 个答案: