提交表单,并在python中使用mechanise获取结果

时间:2016-08-10 11:27:58

标签: python forms web-scraping mechanize

我正在尝试使用机械设备提交网络表单并为我打印结果。输入坐标是从CSV文件中提供的。

def form_scraper(xcord,ycord):
    br = mechanize.Browser()
    br.set_handle_refresh(False)
    br.open('http://www.whoi.edu/marine/ndsf/cgi-bin/NDSFutility.cgi?form=0&from=XY&to=LatLon')

    for form in br.forms():
        print 'Form name:', form.name

    br.select_form('XY2LLForm')

    br.form['Xcord'] = xcord
    br.form['Ycord'] = ycord

    br.form['DecLat'] = '18.10219969497151'
    br.form['DecLon'] = '79.00285162135349'

    response = br.submit()
    form_result = response.read()
    print form_result

这会给我以下错误并且不会产生任何输出。

Traceback (most recent call last):
  File "converter.py", line 31, in <module>
    form_scraper('1', '2')
  File "converter.py", line 20, in form_scraper
    response = br.submit()
  File "/usr/local/lib/python2.7/site-packages/mechanize/_mechanize.py", line 541, in submit
    return self.open(self.click(*args, **kwds))
  File "/usr/local/lib/python2.7/site-packages/mechanize/_mechanize.py", line 203, in open
    return self._mech_open(url, data, timeout=timeout)
  File "/usr/local/lib/python2.7/site-packages/mechanize/_mechanize.py", line 255, in _mech_open
    raise response
mechanize._response.httperror_seek_wrapper: HTTP Error 404: Not Found

我错过了什么?

1 个答案:

答案 0 :(得分:0)

您正在使用的表单的action属性指定了不存在的位置。表单没有提交按钮。在您的浏览器中使用该表单时,该表单的工作原因是单击&#34;转换&#34; button运行一个JavaScript函数,它将进行实际计算并将结果写入页面底部的表格中。

我担心您无法使用机械化来检索结果,因为它无法处理JavaScript。