python - urllib2请求https站点 - 得到400错误

时间:2009-12-19 22:18:36

标签: python https parsing request urllib2

使用以下代码段来访问带有帖子的网址。

我可以使用wget和以下内容获取它:  wget --post-data'p_calling_proc = bwckschd.p_disp_dyn_sched& p_term = 201010'https://spectrumssb2.memphis.edu/pls/PROD/bwckgens.p_proc_term_date

由于某种原因,我的python文本有问题,因为我得到的错误代码为400.(当然浏览器按预期工作)

任何想法/评论等等......

我有的python测试:

// ==========================================

import urllib 
import urllib2
import sys, string
import time
import mechanize

Request = urllib2.Request
urlopen = urllib2.urlopen

headers ={'User-Agent': 'Mozilla/4.0 (compatible; MSIE 5.5; Windows NT)'}
query = "p_calling_proc%3Dbwckschd.p_disp_dyn_sched%26p_term%3D201010"
url1="https://spectrumssb2.memphis.edu/pls/PROD/bwckgens.p_proc_term_date"

req = Request(url1, query, headers)

test1=0
test=0
while test==0:
  print "aaaaattttt \n"
  try: 
    res = urlopen(req)
    #req = Request(url1, query, headers)
    print "aaaappppp \n"
    #urllib2.URLError, (e)
    #print e
  except urllib2.HTTPError, e:
    print "ffff1111 "+str(e.code)+"\n"
    if e.code:
      test1=1
      print "error ..sleep \n"
      time.sleep(1)
    else:
      test1=0
  except urllib2.URLError, e:
    print e.reason
    #print "ffff3333 "+e.code+"\n"
    if e.reason:
      test1=1
      print "error ..sleep \n"
      time.sleep(1)
    else:
      test1=0
  #print "ddd "+e.code +"\n"
  #print e
  if test1==0:
    test=1

print "test1 = "+str(test1)+"\n"
#res = urlopen(req)
print "gggg 000000000000\n"
s = res.read()


任何想法/意见将不胜感激..

感谢

2 个答案:

答案 0 :(得分:1)

尝试不编码查询字符串。 POST数据中的&和s'不需要是urlencoded。如果远程端的Web应用程序不期望查询字符串中的%xx编码,则它将无法解析它。

这是curl的HTTP请求标头:

POST / HTTP/1.1
User-Agent: curl/7.19.4 (universal-apple-darwin10.0) libcurl/7.19.4 OpenSSL/0.9.8k zlib/1.2.3
Host: 127.0.0.1 
Accept: */*
Content-Length: 188
Expect: 100-continue

bwckschd.p_disp_dyn_sched&p_term=201010

这是来自python的HTTP请求标头:

POST / HTTP/1.1
Accept-Encoding: identity
Content-Length: 60
Host: 127.0.0.1
Content-Type: application/x-www-form-urlencoded
Connection: close
User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT)

p_calling_proc%3Dbwckschd.p_disp_dyn_sched%26p_term%3D201010

答案 1 :(得分:0)

我认为您的查询字符串不太正确。尝试使用urllib.urlencode()方法生成查询,la

urllib.urlencode([ ('param1', value1), ('param2',value2) ])