具有云形成的Lambda:将云形成变量传递给python代码

时间:2018-03-27 02:40:58

标签: aws-lambda amazon-cloudformation

嗨下面是clouformation,代码我们有lambda函数s3到s3 copy的python片段.Here无法将目标存储桶从云形成参数传递到python片段作为target_bucket = Ref:dstBucket

我现在正在硬编码target_bucket = destination1但我希望传递为Ref值

我尝试过不同的方法没有成功。

                    ---
                    AWSTemplateFormatVersion: '2010-09-09'
                    Description: 'objects from Prod bucket to Dev data bucket '
                    Parameters:
                      CustomerName:
                        Description: Customer Name
                        Type: String
                        Default: incoming
                      ProjectName:
                        Description: Project Name
                        Type: String
                        Default: TEST
                      ENV:
                        Description: Environment (dev, prd)
                        Type: String
                        Default: dev
                      srcBucket:
                        Description: Source Bucket that receives data from outside
                        Default: source1
                        Type: String
                      dstBucket:
                        Description: Destination Bucket that will receive files
                        Type: String
                        Default: destination1
                    Resources:
                      LambdaRole:
                        Type: AWS::IAM::Role
                        Properties:
                          AssumeRolePolicyDocument:
                            Version: '2012-10-17'
                            Statement:
                            - Effect: Allow
                              Principal:
                                Service:
                                - lambda.amazonaws.com
                                - s3.amazonaws.com
                              Action:
                              - sts:AssumeRole
                          Path:
                            Fn::Sub: "/${ProjectName}/"
                          Policies:
                          - PolicyName:
                              Fn::Sub: "${AWS::StackName}"
                            PolicyDocument:
                              Version: '2012-10-17'
                              Statement:
                              - Sid: AllowLogging
                                Effect: Allow
                                Action:
                                - logs:CreateLogGroup
                                - logs:CreateLogStream
                                - logs:PutLogEvents
                                Resource: "*"
                              - Sid: SrcBucketPrivs
                                Action:
                                - s3:GetObject
                                - s3:List*
                                Resource:
                                - Fn::Sub: arn:aws:s3:::${srcBucket}/*
                                - Fn::Sub: arn:aws:s3:::${srcBucket}
                                Effect: Allow
                              - Sid: DstBucketPrivs
                                Action:
                                - s3:PutObject
                                - s3:List*
                                Resource:
                                - Fn::Sub: arn:aws:s3:::${dstBucket}/*
                                - Fn::Sub: arn:aws:s3:::${dstBucket}
                                Effect: Allow
                      LambdaFunction:
                        Type: AWS::Lambda::Function
                        DependsOn: LambdaRole
                        Properties:
                          Code:
                            ZipFile: |
                               from __future__ import print_function
                               import os
                               import json
                               import boto3
                               import time
                               import string
                               import urllib
                               print('Loading function')
                               s3 = boto3.client('s3')
                               def handler(event, context):
                                  source_bucket = event['Records'][0]['s3']['bucket']['name']
                                  key = event['Records'][0]['s3']['object']['key']


                                  target_bucket     =  Ref: dstBucket
                                  copy_source = {'Bucket':source_bucket, 'Key':key}

                                  try:
                                    s3.copy_object(Bucket=target_bucket, Key=key, CopySource=copy_source)

                                  except Exception as e:
                                    print(e)
                                    print('Error getting object {} from bucket {}. Make sure they exist '
                                       'and your bucket is in the same region as this '
                                       'function.'.format(key, source_bucket))
                                    raise e

                          Description: Copies objects from srcBucket to dstBucket based on S3 Event Trigger
                          FunctionName:
                            Fn::Sub: "${AWS::StackName}"
                          Handler: index.handler
                          MemorySize: 128
                          Role:
                            Fn::GetAtt:
                            - LambdaRole
                            - Arn
                          Runtime: python3.6
                          Timeout: 60
                      LambdaInvokePermission:
                        Type: AWS::Lambda::Permission
                        DependsOn: LambdaFunction
                        Properties:
                          FunctionName:
                            Fn::GetAtt:
                            - LambdaFunction
                            - Arn
                          Action: lambda:InvokeFunction
                          Principal: s3.amazonaws.com
                          SourceAccount:
                            Ref: AWS::AccountId
                          SourceArn:
                            Fn::Sub: arn:aws:s3:::${srcBucket}

嗨下面是clouformation,代码我们有lambda函数s3到s3 copy的python片段.Here无法将目标存储桶从云形成参数传递到python片段作为target_bucket = Ref:dstBucket

我现在正在硬编码target_bucket = destination1但我希望传递为Ref值

我尝试过不同的方法没有成功。

2 个答案:

答案 0 :(得分:3)

您可以在lambda上使用Environment属性

LambdaFunction:
  Type: AWS::Lambda::Function
  DependsOn: LambdaRole
  Properties:
    ...
    Environment:
      Variables:
        DESTINATION_BUCKET: !Ref dstBucket

然后您可以更新代码以阅读环境变量

target_bucket = os.environ['DESTINATION_BUCKET']

或者,如果您真的想使用该引用,可以使用!Sub函数,例如

LambdaFunction:
  Type: AWS::Lambda::Function
  DependsOn: LambdaRole
  Properties:
    Code:
      ZipFile: !Sub |
         ...
            target_bucket     =  "${dstBucket}"
         ...

答案 1 :(得分:0)

RTM

如果您需要更多上下文,还需this

LambdaFunction:
    Type: AWS::Lambda::Function
    DependsOn: LambdaRole
    Properties:
        ...
        Environment:
            ...