Question

根据docs，它应该如下：

'HTTP/1.1 400 Bad Request\r\n'

但我似乎找不到任何关于如何实现这一目标的例子。

我正在使用pyupdater从bitbucket下载更新并启动最新版本的exe。我正在使用这个库创建一个连接到bitbucket的脚本，但后来它用data = self.http_pool.urlopen('GET', file_url, preload_content=False, retries=max_download_retries)重定向到亚马逊（这是bitbucket auth），这意味着我得到了Python main.py DEBUG:root:Version - 2.5.1 DEBUG:pyupdater.client:PyUpdater Version 2.5.1 Current version is 1.3 {'authorization': 'Basic <redacted>'} DEBUG:pyupdater.client:Setting up directories... DEBUG:pyupdater.client:Downloading key file DEBUG:pyupdater.client.downloader:Url for request: https://api.bitbucket.org/2.0/repositories/ brofewfefwefewef/eee/downloads/keys.gz DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): api.bitbucket.org send: b'GET /2.0/repositories/ brofewfefwefewef/eee/downloads/keys.gz HTTP/1.1\r\nHost: api.bitbucket.org\r\nAccept-Encoding: identity\r\nauthorization: Basic <redacted>\r\n\r\n' reply: 'HTTP/1.1 302 Found\r\n' DEBUG:urllib3.connectionpool:https://api.bitbucket.org:443 "GET /2.0/repositories/brofewfefwefewef/eee/downloads/keys.gz HTTP/1.1" 302 0 DEBUG:urllib3.util.retry:Incremented Retry for (url='https://api.bitbucket.org/2.0/repositories/brofewfefwefewef/eee/downloads/keys.gz'): Retry(total=2, connect=None, read=None, redirect=None, status=None) INFO:urllib3.poolmanager:Redirecting https://api.bitbucket.org/2.0/repositories/ brofewfefwefewef/eee/downloads/keys.gz -> https://bbuseruploads.s3.amazonaws.com/a0e395b6-0c54-4efb-9074-57ec4190020b/downloads/3fc0be6d-ca69-42d3-9711-fbb5cfd2bc38/keys.gz?Signature=<redacted>&Expires=1515976464&AWSAccessKeyId=<redacted>&versionId=n.ymY11KRkq36Xozy25aChvfUT.YzTf5&response-content-disposition=attachment%3B%20filename%3D%22keys.gz%22 DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): bbuseruploads.s3.amazonaws.com header: Server header: Vary header: Content-Type header: X-OAuth-Scopes header: Strict-Transport-Security header: Date header: Location header: X-Served-By header: ETag header: X-Static-Version header: X-Content-Type-Options header: X-Accepted-OAuth-Scopes header: X-Credential-Type header: X-Render-Time header: Connection header: X-Request-Count header: X-Frame-Options header: X-Version header: Content-Length send: b'GET /a0e395b6-0c54-4efb-9074-57ec4190020b/downloads/3fc0be6d-ca69-42d3-9711-fbb5cfd2bc38/keys.gz?Signature=<redacted>&Expires=1515976464&AWSAccessKeyId=<redacted>&versionId=n.ymY11KRkq36Xozy25aChvfUT.YzTf5&response-content-disposition=attachment%3B%20filename%3D%22keys.gz%22 HTTP/1.1\r\nHost: bbuseruploads.s3.amazonaws.com\r\nAccept-Encoding: identity\r\nauthorization: Basic <redacted>\r\n\r\n' reply: 'HTTP/1.1 400 Bad Request\r\n' DEBUG:urllib3.connectionpool:https://bbuseruploads.s3.amazonaws.com:443 "GET /a0e395b6-0c54-4efb-9074-57ec4190020b/downloads/3fc0be6d-ca69-42d3-9711-fbb5cfd2bc38/keys.gz?Signature=<redacted>&Expires=1515976464&AWSAccessKeyId=<redacted>&versionId=n.ymY11KRkq36Xozy25aChvfUT.YzTf5&response-content-disposition=attachment%3B%20filename%3D%22keys.gz%22 HTTP/1.1" 400 None DEBUG:pyupdater.client.downloader:Resource URL: https://api.bitbucket.org/2.0/repositories/brofewfefwefewef/eee/downloads/keys.gz DEBUG:pyupdater.client.downloader:Got content length of: None DEBUG:pyupdater.client.downloader:Content-Length not in headers DEBUG:pyupdater.client.downloader:Callbacks will not show time left or percent downloaded. DEBUG:pyupdater.client.downloader:Using file as storage since the file is too large DEBUG:pyupdater.client.downloader:Block size: 1036 DEBUG:pyupdater.client.downloader:{'total': None, 'downloaded': 519, 'status': 'downloading', 'percent_complete': '-.-%', 'time': '--:--'} DEBUG:pyupdater.client.downloader:{'total': None, 'downloaded': 519, 'status': 'finished', 'percent_complete': '-.-%', 'time': '00:00'} DEBUG:pyupdater.client.downloader:Download Complete DEBUG:pyupdater.client.downloader:No hash to verify WARNING:pyupdater.client.downloader:Downloaded file is very large, reading it in to memory may crash the app DEBUG:pyupdater.client:Failed to decompress gzip file DEBUG:pyupdater.client:Version file download failed header: x-amz-request-id header: x-amz-id-2 header: Content-Type header: Transfer-Encoding header: Date header: Connection header: Server {'authorization': 'Basic <redacted>'} DEBUG:pyupdater.client:Not a gzipped file (b'<?') Traceback (most recent call last): File "C:\Users\Django\AppData\Local\Continuum\miniconda3\lib\site-packages\pyupdater\client\__init__.py", line 440, in _get_key_data decompressed_data = _gzip_decompress(data) File "C:\Users\Django\AppData\Local\Continuum\miniconda3\lib\site-packages\dsdev_utils\helpers.py", line 58, in gzip_decompress data = decompressed_file.read() File "C:\Users\Django\AppData\Local\Continuum\miniconda3\Lib\gzip.py", line 276, in read return self._buffer.read(size) File "C:\Users\Django\AppData\Local\Continuum\miniconda3\Lib\gzip.py", line 463, in read if not self._read_gzip_header(): File "C:\Users\Django\AppData\Local\Continuum\miniconda3\Lib\gzip.py", line 411, in _read_gzip_header raise OSError('Not a gzipped file (%r)' % magic) OSError: Not a gzipped file (b'<?') DEBUG:pyupdater.client:Loading version file... DEBUG:pyupdater.client:Downloading online version file DEBUG:pyupdater.client.downloader:Url for request: https://api.bitbucket.org/2.0/repositories/ brofewfefwefewef/eee/downloads/versions.gz DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): api.bitbucket.org send: b'GET /2.0/repositories/ brofewfefwefewef/eee/downloads/versions.gz HTTP/1.1\r\nHost: api.bitbucket.org\r\nAccept-Encoding: identity\r\nauthorization: Basic <redacted>\r\n\r\n' reply: 'HTTP/1.1 302 Found\r\n' DEBUG:urllib3.connectionpool:https://api.bitbucket.org:443 "GET /2.0/repositories/brofewfefwefewef/eee/downloads/versions.gz HTTP/1.1" 302 0 DEBUG:urllib3.util.retry:Incremented Retry for (url='https://api.bitbucket.org/2.0/repositories/brofewfefwefewef/eee/downloads/versions.gz'): Retry(total=2, connect=None, read=None, redirect=None, status=None) INFO:urllib3.poolmanager:Redirecting https://api.bitbucket.org/2.0/repositories/brofewfefwefewef/eee/downloads/versions.gz -> https://bbuseruploads.s3.amazonaws.com/a0e395b6-0c54-4efb-9074-57ec4190020b/downloads/0b04c4a8-dd59-49d2-9cd7-95d22379a5e6/versions.gz?Signature=<redacted>&Expires=1515976465&AWSAccessKeyId=<redacted>&versionId=jLhOcIbVAU4xRghD3kB2NfB4iLqUr7PM&response-content-disposition=attachment%3B%20filename%3D%22versions.gz%22 DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): bbuseruploads.s3.amazonaws.com header: Server header: Vary header: Content-Type header: X-OAuth-Scopes header: Strict-Transport-Security header: Date header: Location header: X-Served-By header: ETag header: X-Static-Version header: X-Content-Type-Options header: X-Accepted-OAuth-Scopes header: X-Credential-Type header: X-Render-Time header: Connection header: X-Request-Count header: X-Frame-Options header: X-Version header: Content-Length send: b'GET /a0e395b6-0c54-4efb-9074-57ec4190020b/downloads/0b04c4a8-dd59-49d2-9cd7-95d22379a5e6/versions.gz?Signature=<redacted>&Expires=1515976465&AWSAccessKeyId=<redacted>&versionId=jLhOcIbVAU4xRghD3kB2NfB4iLqUr7PM&response-content-disposition=attachment%3B%20filename%3D%22versions.gz%22 HTTP/1.1\r\nHost: bbuseruploads.s3.amazonaws.com\r\nAccept-Encoding: identity\r\nauthorization: Basic <redacted>\r\n\r\n' DEBUG:urllib3.connectionpool:https://bbuseruploads.s3.amazonaws.com:443 "GET /a0e395b6-0c54-4efb-9074-57ec4190020b/downloads/0b04c4a8-dd59-49d2-9cd7-95d22379a5e6/versions.gz?Signature=<redacted>&Expires=1515976465&AWSAccessKeyId=<redacted>&versionId=jLhOcIbVAU4xRghD3kB2NfB4iLqUr7PM&response-content-disposition=attachment%3B%20filename%3D%22versions.gz%22 HTTP/1.1" 400 None reply: 'HTTP/1.1 400 Bad Request\r\n' DEBUG:pyupdater.client.downloader:Resource URL: https://api.bitbucket.org/2.0/repositories/brofewfefwefewef/eee/downloads/versions.gz DEBUG:pyupdater.client.downloader:Got content length of: None DEBUG:pyupdater.client.downloader:Content-Length not in headers DEBUG:pyupdater.client.downloader:Callbacks will not show time left or percent downloaded. DEBUG:pyupdater.client.downloader:Using file as storage since the file is too large DEBUG:pyupdater.client.downloader:Block size: 1036 DEBUG:pyupdater.client.downloader:{'total': None, 'downloaded': 519, 'status': 'downloading', 'percent_complete': '-.-%', 'time': '--:--'} DEBUG:pyupdater.client.downloader:{'total': None, 'downloaded': 519, 'status': 'finished', 'percent_complete': '-.-%', 'time': '00:00'} DEBUG:pyupdater.client.downloader:Download Complete DEBUG:pyupdater.client.downloader:No hash to verify WARNING:pyupdater.client.downloader:Downloaded file is very large, reading it in to memory may crash the app DEBUG:pyupdater.client:Failed to decompress gzip file DEBUG:pyupdater.client:Version file download failed DEBUG:pyupdater.client:Not a gzipped file (b'<?') Traceback (most recent call last): File "C:\Users\Django\AppData\Local\Continuum\miniconda3\lib\site-packages\pyupdater\client\__init__.py", line 417, in _get_manifest_from_http decompressed_data = _gzip_decompress(data) File "C:\Users\Django\AppData\Local\Continuum\miniconda3\lib\site-packages\dsdev_utils\helpers.py", line 58, in gzip_decompress data = decompressed_file.read() File "C:\Users\Django\AppData\Local\Continuum\miniconda3\Lib\gzip.py", line 276, in read return self._buffer.read(size) File "C:\Users\Django\AppData\Local\Continuum\miniconda3\Lib\gzip.py", line 463, in read if not self._read_gzip_header(): File "C:\Users\Django\AppData\Local\Continuum\miniconda3\Lib\gzip.py", line 411, in _read_gzip_header raise OSError('Not a gzipped file (%r)' % magic) OSError: Not a gzipped file (b'<?') DEBUG:dsdev_utils.paths:Changing to Directory --> C:\Users\Django\AppData\Local\any\main DEBUG:pyupdater.client:Found version file on file system DEBUG:pyupdater.client:Loaded version file from file system DEBUG:dsdev_utils.paths:Moving back to Directory --> C:\Users\Django\privacy 4 DEBUG:pyupdater.client:Data type: <class 'bytes'> DEBUG:pyupdater.client:App key is None DEBUG:pyupdater.client:Version Data: {'latest': {'main': {'stable': {'win': '1.4.0.2.0'}}}, 'updates': {'main': {'1.3.0.2.0': {'win': {'file_hash': '807c743b8c29f0053f4f9d9e6a8895b0e037f77480e7065c1470c2aba1cb08a0', 'file_size': 12194381, 'filename': 'main-win-1.3.zip', 'patch_hash': '29fec1006c2736eb78cc859f89e165af942daae6d9ac994a1a686d9b7b418ef6', 'patch_name': 'main-win-5', 'patch_size': 147}}, '1.4.0.2.0': {'win': {'file_hash': 'd59a22a95229f0a9c64909c646bfba31daf6bf8689dc16c9c93180c1602e9d3c', 'file_size': 12195571, 'filename': 'main-win-1.4.zip', 'patch_hash': 'baf3eba3a4b3184919ed9e57c3e8be9494a50862b40b1590ecb64e39e71a4ce3', 'patch_name': 'main-win-6', 'patch_size': 479625}}}}, 'signature': '<redacted>'} DEBUG:dsdev_utils.helpers:Version str: 1.3 DEBUG:pyupdater.client:Failed version file verification。亚马逊不支持基本身份验证。这应该很容易解决，但我在这个问题上找不到多少。

提供的解决方案here，需要手动重新创建每个重定向的请求。如果我必须为我上传的新文件执行此操作，这将成为一个不断增长的列表，并且很快就会变得乏味。它也不会继续执行脚本的其余部分，而是下载到同一目录。

由于这就是Pyupdater处理下载的方式，因此issue可能会解决这个问题。

downloader.py的第366行：

query = """ INSERT INTO public.saferdb_question( "DOT_Number", "Entity_Type", "Operating_Status", "Legal_Name", "Phone", "Address")VALUES ( %s, %s, %s, %s, %s, %s);"""

有关如何解决此问题的任何想法，以便它不再创建此错误。

完整错误（ctrl f - ＆gt; 400）：

{{1}}

对于那些想要为自己复制错误的人，我已经写了我采取的步骤exactly。

Answer 1

我刚检查过，我认为这是pyupdater的问题（我不知道它是什么，从未使用过）。

似乎假设所有响应的主体都将在GZIP中压缩。我找不到任何可以阻止这种假设的旗帜。实际内容实际上根本没有压缩。

以下是pyupdater的一些相关代码：

pyupdater/client/__init__.py:

def _get_manifest_from_http(self):
    log.debug('Downloading online version file')
    try:
        fd = _FD(self.version_file, self.update_urls, verify=self.verify,
                 urllb3_headers=self.urllib3_headers)
        data = fd.download_verify_return()
        try:
            import ipdb
            ipdb.set_trace()
            decompressed_data = _gzip_decompress(data)
        except IOError:
            log.debug('Failed to decompress gzip file')
            # Will be caught down below.
            # Just logging the error
            raise
        log.debug('Version file download successful')
        # Writing version file to application data directory
        self._write_manifest_2_filesystem(decompressed_data)
        return decompressed_data
    except Exception as err:
        log.debug('Version file download failed')
        log.debug(err, exc_info=True)
        return None

以下是我收到的数据示例：

ipdb> data
b'{"type": "error", "error": {"message": "keys.gz"}}'

我相信你应该在https://github.com/JMSwag/PyUpdater打开一张票，看看他们是否可以帮助你。

Answer 2

修改-1：

您需要使用this._deferred.resolve(...); this._deferred.reject(...); this._deferred.then(...); this._deferred.catch(...); let p = this._deferred.promise;的以下代码，而不对main.py
进行任何更改
downloader.py

原始回答 你需要使用猴子补丁。补丁下面应该做的工作

from __future__ import print_function import urllib3.poolmanager orig_urlopen = urllib3.poolmanager.PoolManager.urlopen def new_urlopen(self, method, url, redirect=True, **kw): if "s3.amazonaws.com" in url and 'authorization' in self.headers: self.headers.pop('authorization') return orig_urlopen(self, method, url, redirect, **kw) urllib3.poolmanager.PoolManager.urlopen = new_urlopen import logging from selenium import webdriver logging.basicConfig(level=logging.DEBUG) from client_config import ClientConfig from pyupdater.client import Client, AppUpdate import http.client as http_client http_client.HTTPConnection.debuglevel = 1 def check_for_update(): client = Client(ClientConfig(), refresh=True, headers={'basic_auth': '<username>:<password>'}) app_update = client.update_check(ClientConfig.APP_NAME, ClientConfig.APP_VERSION, channel='stable') if app_update is not None: if app_update.download(): if isinstance(app_update, AppUpdate): app_update.extract_restart() return True else: app_update.extract() return True return False def main(): print('Current version is ', ClientConfig.APP_VERSION) if check_for_update(): print('there\'s a new update :D') # driver = webdriver.Firefox() # driver.get('http://stackoverflow.com') if __name__ == "__main__": main()

使用上述补丁对我进行了样本测试

import urllib3.poolmanager orig_urlopen = urllib3.poolmanager.PoolManager.urlopen def new_urlopen(self, method, url, redirect=True, **kw): if "s3.amazonaws.com" in url and 'Authorization' in self.headers: self.headers.pop('Authorization') return orig_urlopen(self, method, url, redirect, **kw) urllib3.poolmanager.PoolManager.urlopen = new_urlopen

您需要在导入pyupdater
之前执行代码

Answer 3

Requests是一个非常棒的图书馆，不要浪费时间用其他任何东西，除非有一个很好的理由：

import requests
import zlib

def download(url, username, password):
    r = requests.get(url, auth=requests.auth.HTTPBasicAuth(username, password))
    r.raise_for_status()
    return zlib.decompress(r.content, 15 + 32)

download('https://api.bitbucket.org/2.0/repositories/brofewfefwefewef/eee/downloads/keys.gz', 'brofewfefwefewef', your_password)

此外，值得注意的是，不应再使用此处的凭据。 Basic Auth可以非常简单地解码。

没有身份验证的重定向

3 个答案: