您如何追加AWS S3存储桶通知配置

时间:2019-06-19 17:33:32

标签: python amazon-web-services amazon-s3 amazon-sqs bucket

尝试将新通知添加到存储桶。在互联网上找不到任何示例。

我需要将ObjectCreated事件发送到SQS。我需要确定该前缀发送事件的队列。因此,每个通知在相同的存储桶上将具有不同的队列和前缀。

问题是我无法追加新通知。我只是覆盖存储桶中配置的先前通知。

这是我到目前为止的代码:

    bucket_notifications_configuration = {
        'QueueConfigurations': [{
            'Events': ['s3:ObjectCreated:*'],
            'Id': f"Notif_{queue_name}",
            'QueueArn': queue.attributes['QueueArn'] ,
            "Filter": {
                "Key": {
                    "FilterRules": [
                        {
                        "Name": "sufix",
                        "Value": f"{prefix}"
                        }
                    ]
                }
            }               
        }]
    }
    qpolicy = {
        "Version": "2012-10-17",
        "Id": f"{queue_arn}/SQSDefaultPolicy",
        "Statement": [{
            "Sid": f"allow bucket {bucket} to notify queue {queue_name}",
            "Effect": "Allow",
            "Principal": {"AWS": "*"},
            "Action": "SQS:SendMessage",
            "Resource": queue_arn,
            "Condition": {
                "ArnLike": {
                    "aws:SourceArn": f"arn:aws:s3:*:*:{bucket}"
                }
            }
        }]
    }

    queue_attrs = queue.attributes
    queue_attrs = {"Policy": json.dumps(qpolicy), }


    queue.set_attributes(Attributes=queue_attrs)
    logger.debug(f"queue ready with attributes: {queue.attributes}")        

    previous_notif = client.get_bucket_notification_configuration(Bucket=bucket)
    previous_notif.pop('ResponseMetadata')

    try:
        print("apendado")
        previous_notif['QueueConfigurations'].append(bucket_notifications_configuration['QueueConfigurations'][0])            
        print(f"apendado {previous_notif} ")
    except KeyError:
        previous_notif['QueueConfigurations'] = bucket_notifications_configuration['QueueConfigurations'][0]
        print("cread")

    client.put_bucket_notification_configuration(
        Bucket=bucket,
        NotificationConfiguration=bucket_notifications_configuration)

我确保通知ID与其他ID不同,也确保前缀不同。

此代码用新的通知覆盖了先前的通知,而不是附加新的通知。

1 个答案:

答案 0 :(得分:0)

我设法使其与下面的代码一起使用。

它将采用现有配置,添加新配置,然后将其保存回存储桶。该代码假定存在现有配置。

import boto3

s3_client = boto3.client('s3', region_name = 'ap-southeast-2')

queue_name = 'queue2'
queue_arn = 'arn:aws:sqs:ap-southeast-2:123456789012:queue2'
bucket = 'my-bucket'
prefix = 'folder2/'

# Get the current notification configurations
response = s3_client.get_bucket_notification_configuration(Bucket=bucket)
configurations = response['QueueConfigurations']

# New configuration to add
new_configuration = { 
        'Id': f"Notif_{queue_name}",
        'QueueArn': queue_arn,
        'Events': [
            's3:ObjectCreated:*',
        ],
        'Filter': {
            'Key': {
                'FilterRules': [
                    {
                        'Name': 'prefix',
                        'Value': prefix
                    },
                ]
            }
        }
    }
configurations.append(new_configuration)

# Save combined configurations
response = s3_client.put_bucket_notification_configuration(
    Bucket = bucket,
    NotificationConfiguration = {'QueueConfigurations' : configurations}
)