无法从云功能正确访问GCS对象

时间:2018-10-11 20:18:55

标签: python google-cloud-storage google-cloud-functions google-cloud-language

每当我尝试获取云存储桶对象并使用支持站点上显示的方法输入时,都会出现错误

  

google.api_core.exceptions.InvalidArgument:400 GCS对象   gcs_content_uri中指定的不存在。

gcs参考在打印时如下所示:

  

gs://lang-docs-in/b'doc1.txt'

我已经尽一切努力使它起作用:编码,解码等似乎已经花费了数小时,但无济于事。有什么想法吗?

main.py

import sys
from google.cloud import language
from google.cloud import storage

storage_client = storage.Client()

DOCUMENT_BUCKET = 'lang-docs-out'

def process_document(data, context):
    # Get file attrs
    bucket = storage_client.get_bucket(data['bucket'])
    blob = bucket.get_blob(data['name'])
    # send to NLP API
    gcs_obj = 'gs://{}/{}'.format(bucket.name, blob.name.decode('utf-8'))
    print('LOOK HERE')
    print(gcs_obj)
    parsed_doc = analyze_document(bucket, blob)
    # Upload the resampled image to the other bucket
    bucket = storage_client.get_bucket(DOCUMENT_BUCKET)
    newblob = bucket.blob('parsed-' + data['name'])     
    newblob.upload_from_string(parsed_doc)

def analyze_document(bucket, blob):
    language_client = language.LanguageServiceClient()
    gcs_obj = 'gs://{}/{}'.format(bucket.name, blob.name.decode('utf-8'))
    print(gcs_obj)
    document = language.types.Document(gcs_content_uri=gcs_obj, language='en', type='PLAIN_TEXT')
    response = language_client.analyze_syntax(document=document, encoding_type= get_native_encoding_type())
    return response

def get_native_encoding_type():
    """Returns the encoding type that matches Python's native strings."""
    if sys.maxunicode == 65535:
        return 'UTF16'
    else:
        return 'UTF32'

requirements.txt

google-cloud-storage
google-cloud-language
google-api-python-client
grpcio
grpcio-tools

1 个答案:

答案 0 :(得分:0)

google.cloud.storage.blob.Blob实例的name属性应该是字符串,因此您完全不需要做.decode()

您似乎确实有一个名为"b'doc1.txt'"的文件,该文件是由于将文件添加到GCS而不是您的Cloud Function的问题而创建的,例如:

>>> blob.name
"b'doc1.txt'"
>>> type(blob.name)
<class 'str'>

而不是:

>>> blob.name
b'doc1.txt'
>>> type(blob.name)
<class 'bytes'>

这真的很难区分,因为它们在打印时看起来相同:

>>> print(b'hi')
b'hi'
>>> print("b'hi'")
b'hi'