Question

由于谷歌没有找到任何关于错误“http.client.HTTPException：得到超过100个标题”，我创建了这个问题。

>>> import http.client as h
>>> conn = h.HTTPConnection("www.coursefinders.com")
>>> conn.request("HEAD","/")
>>> conn.getresponse();
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.4/http/client.py", line 1148, in getresponse
    response.begin()
  File "/usr/lib/python3.4/http/client.py", line 376, in begin
    self.headers = self.msg = parse_headers(self.fp)
  File "/usr/lib/python3.4/http/client.py", line 267, in parse_headers
    raise HTTPException("got more than %d headers" % _MAXHEADERS)
http.client.HTTPException: got more than 100 headers

此异常是什么意思，我该如何正确处理此类错误？网站在浏览器中正常运行。

Answer 1

这是一个不涉及更改库的py文件的解决方案：

import httplib  # or http.client if you're on Python 3
httplib._MAXHEADERS = 1000

只需将其放在代码顶部

即可

Answer 2

更改＆＃34; _MAXHEADERS＆＃34;的值在C：\ Python27 \ Lib \ httplib.py

中为1000或10000

Answer 3

我打算建议使用requests，但它是使用http.client实现的，并且由于同样的原因而失败。为了验证问题是在库还是服务器中，我尝试了一个telnet会话，结果类似于：

Trying 91.250.81.121...
Connected to www.coursefinders.com.
Escape character is '^]'.
HEAD / HTTP\1.1

HTTP/1.1 200 OK
Date: Mon, 14 Apr 2014 08:35:54 GMT
Server: Apache/2.2.16 (Debian)
X-Powered-By: PHP/5.3.3-7+squeeze19
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Set-Cookie: PHPSESSID=2bnr4dpa4e90r2lmbv01smu1b6; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: c_id=496cc5d32486ac8d944e971ad6ec9eb3649ab23cs%3A3%3A%22235%22%3B; expires=Tue, 15-Apr-2014 08:35:54 GMT; path=/
Set-Cookie: login=-1; path=/
Set-Cookie: wc=1; expires=Thu, 09-Apr-2015 08:35:54 GMT
Set-Cookie: login=-1; path=/
Set-Cookie: login=-1; path=/
[... Many Set-Cookie commands omitted ...]
Set-Cookie: login=-1; path=/
Cache-Control: max-age=1, private, must-revalidate
Vary: Accept-Encoding
Connection: close
Content-Type: text/html; charset=utf-8

Connection closed by foreign host.

所以看起来他们的服务器配置错误，并且喷出了大量多余的Set-Cookie标头。

似乎没有任何方法可以配置httplib来接受大量的标头。我已经尝试搜索未使用httplib实现但没有运气的替代HTTP库。

Answer 4

一个OSX我将其添加到我的代码

import httplib as http_client

然后调试脚本以查找从中加载库的位置。在我的情况下它是

/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py

然后根据Felix的帖子编辑限制

sudo vim /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py

http.client.HTTPException：获得了超过100个标题

4 个答案: