我想使用机械化库登录网站,然后单击几个按钮以访问要使用BeautifulSoup解析的某个网页。
我已经在Stack Overflow上找到了几个答案,我可以使用机械化库登录并单击按钮以到达所需的页面,但是我无法使用BeautifulSoup解析该链接。这是我的代码:
import mechanize
from bs4 import BeautifulSoup
import requests
br = mechanize.Browser()
br.set_handle_robots(False)
br.open(login page link) # Url that contains signin form
br.select_form(nr=0)
br['username'] = "username"
br['password'] = 'password'
result = br.submit().read()
for link in br.links():
if "link1" in link.url:
to_follow = link
break
br.follow_link(to_follow)
for link in br.links():
if 'link2' in link.url:
to_follow = link
break
br.follow_link(to_follow)
str = str(br.geturl())
page = requests.get(str)
soup = BeautifulSoup(page.text, 'html.parser')
elements_list = soup.find(id_='content')
elements_list_items = elements_list.find_all('a')
for i in elements_list_items:
print(i)
我收到以下错误代码
回溯(最近通话最近): 文件“ C:/Users/user/PycharmProjects/test1/login.py”,第37行,在 对于我在elements_list_items中: TypeError:“ NoneType”对象不可迭代