不为null的gcs存储桶返回“只能将str(不是“ bytes”)连接到str”

时间:2019-09-05 11:16:48

标签: python python-3.x google-cloud-storage boto3 boto

我对Google Clould存储空间非常陌生。我正在使用教程https://cloud.google.com/storage/docs/boto-plugin使用boto为Google云存储创建存储区。请在下面找到代码:

    import boto
    import gcs_oauth2_boto_plugin
    import time

    GOOGLE_STORAGE = 'gs'
    LOCAL_FILE = 'file'

    CLIENT_ID = "hnsdndsjsksoasjmoadsj"
    CLIENT_SECRET = "jdijeroerierper-er0erjfdkdf"

    gcs_oauth2_boto_plugin.SetFallbackClientIdAndSecret(CLIENT_ID, CLIENT_SECRET)

    now = time.time()

    # Your project ID can be found at https://console.cloud.google.com/
    # If there is no domain for your project, then project_id = 'YOUR_PROJECT'
    project_id = 'my-project-4749485'


    now = time.time()
    CATS_BUCKET = 'cats-%d' % now
    DOGS_BUCKET = 'dogs-%d' % now

    for name in (CATS_BUCKET, DOGS_BUCKET):
      uri = boto.storage_uri(name, GOOGLE_STORAGE)
      try:
        header_values = {"x-goog-project-id": project_id}
        uri.create_bucket(headers=header_values)

        print('Successfully created bucket "%s"' % name)
      except boto.exception.StorageCreateError as e:
        print('Failed to create bucket:', e)

当我运行它时,我得到:

/Users/dilipyadav/githome/elrond/venv/bin/python /Users/dilipyadav/githome/elrond/elrond/deploy3.py -t test -v 0.0.1
Traceback (most recent call last):
  File "/Users/dilipyadav/githome/elrond/elrond/deploy3.py", line 28, in <module>
    uri.create_bucket(headers=header_values)
  File "/Users/dilipyadav/githome/elrond/venv/lib/python3.7/site-packages/boto/storage_uri.py", line 574, in create_bucket
    storage_class)
  File "/Users/dilipyadav/githome/elrond/venv/lib/python3.7/site-packages/boto/gs/connection.py", line 95, in create_bucket
    data=get_utf8_value(data))
  File "/Users/dilipyadav/githome/elrond/venv/lib/python3.7/site-packages/boto/s3/connection.py", line 659, in make_request
    auth_path = self.calling_format.build_auth_path(bucket, key)
  File "/Users/dilipyadav/githome/elrond/venv/lib/python3.7/site-packages/boto/s3/connection.py", line 94, in build_auth_path
    path = '/' + bucket
TypeError: can only concatenate str (not "bytes") to str

Process finished with exit code 1

我在这里找到了类似的问题-Can't collectstatic to s3 via Heroku using boto - s3 bucket returns a NoneType,但没有帮助。

注意:CLIENT_ID,CLIENT_SECRET和project_id已替换为随机字符。

编辑:

    def build_auth_path(self, bucket, key=''):
        key = boto.utils.get_utf8_value(key)
        path = ''
        if bucket != '':
            path = '/' + bucket
        return path + '/%s' % urllib.parse.quote(key)

上面是来自connection.py的代码片段,其中我的代码失败。在调试时,我得到的存储桶名称为“ cats-1567682436”,这是一个字节值。我想用字符串“ /”和字节存储桶创建路径时会失败。因此串联失败。

2 个答案:

答案 0 :(得分:1)

更改此行:

path = '/' + bucket

对此:

path = '/' + bucket.decode('utf-8')

但是,我将更改调用build_auth_path()的代码并将存储桶bytearray转换为string,然后再调用build_auth_path()

答案 1 :(得分:0)

boto/utils.py:871 将线路修补到

value = str(value.encode('utf-8'))

这是 get_utf8_value() 函数的一个错误,它将字符串转换为字节数组。图书馆很旧,不太可能解决这个问题。