为什么解析的标签名称不同?

时间:2019-05-09 09:20:59

标签: python beautifulsoup

from bs4 import BeautifulSoup
import requests

web_url = r'https://www.mlb.com/scores/2019-05-12'
get_web = requests.get(web_url).text
soup = BeautifulSoup(get_web,"html.parser")
score = soup.find_all('div',class_='container')
print(score)

我想找到this

但是结果是this

1 个答案:

答案 0 :(得分:0)

将标头发送到API以告诉它“嘿,我是桌面浏览器”,以便从服务器端获取相同的HTML:

user_agent = 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.47 Safari/537.36'
request = requests.get(url, headers={'User-Agent': user_agent})

有用的链接:

  1. How to use Python requests to fake a browser visit?
  2. Sending "User-agent" using Requests library in Python