使用python mechanize提交嵌套表单

时间:2011-08-21 02:38:27

标签: python mechanize python-2.7

我正在尝试在看起来像这样的网页上提交登录表单。我也尝试过提交嵌套表单以及每次提交两个表单,同样的错误。

<form method="post" name="loginform">
     <input type='hidden' name='login' value='1'>
     <form action="#" method="post" id="login">
          Username
          <input type="text" name="username" id="username" />
          Password
          <input type="password" name="password" id="password" />
          <input type="submit" value='Login'  class="submit" />

这是我正在使用的python脚本。我还注意到表单没有用</form>关闭。我不确定这是否与我的问题有关。

from mechanize import Browser

br = Browser()

br.set_handle_robots( False )
br.addheaders = [('User-agent', 'Firefox')]

br.open('http://www.example.com/')

br.select_form(name="loginform")

br['login'] = '1'
br['username'] = 'user'
br['password'] = 'pass'

resp = br.submit()

我得到的错误是

ParseError: nested FORMs

修改

import mechanize
from BeautifulSoup import MinimalSoup 

class PrettifyHandler(mechanize.BaseHandler):
    def http_response(self, request, response):
        if not hasattr(response, "seek"):
            response = mechanize.response_seek_wrapper(response)
        # only use BeautifulSoup if response is html
        if response.info().dict.has_key('content-type') and ('html' in response.info().dict['content-type']):
            soup = MinimalSoup (response.get_data())
            response.set_data(soup.prettify())
        return response

br = mechanize.Browser()
br.add_handler(PrettifyHandler())

br.open('http://example.com/')

br.select_form(nr=1)
br.form['username'] = 'mrsmith'
br.form['password'] = '123abc'
resp = br.submit()

print resp.read()

2 个答案:

答案 0 :(得分:2)

尝试使用ICantBelieveItsBeautifulSoup或MinimalSoup解析器而不是BeautifulSoup,请参阅Is it possible to hook up a more robust HTML parser to Python mechanize?了解实现

答案 1 :(得分:1)

您可以尝试查找页面的违规部分并手动调整。例如,我有一个页面获得嵌套表单问题,我发现有

<FORM></FORM>

坐在另一个表格块内。我还需要删除第一行,因为它的格式也很糟糕。所以你可以尝试这样的事情:

...
resp = br.open(url)  # Load login page
# the [111:0] takes away the first 111 chars of the response
# the .replace('<FORM></FORM>','') removes the bad HTML
resp.set_data(resp.get_data()[111:].replace('<FORM></FORM>',''))  
br.set_response(resp)