Boto不会在AWS Lambda上将s3文件保存到光盘

时间:2015-12-22 01:05:20

标签: python amazon-web-services amazon-s3 aws-lambda boto

我正在研究一个模块,该模块从我的MySQL数据库中获取有关图像序列的信息,然后使用boto库在Lambda上本地下载它们。之后,它应该进行一些图像处理,但我还没有完成。

我一直遇到的错误很奇怪。之后(我相信)它会下载第一张图片,它说它不存在为文件/目录:

    Traceback (most recent call last): File "/var/task/module.py", line 41, in lambda_handler key.get_contents_to_filename(string) 

File "/var/task/boto/s3/key.py", line 1714, in get_contents_to_filename os.remove(filename) OSError: [Errno 2] No such file or directory: '1.png'

我的代码中的第41行可以在这里找到:

# Download and Save all of the cropped images for this company  
count = 1
files_list = []
for image in cropped_images:
    key = bucket.get_key(image)
    string = str(count) + '.png'
    key.get_contents_to_filename(string)
    files_list.append(string) 
    count += 1
print("should be done downloading all of the pictures from S3 ...")

这是我到目前为止所拥有的模块的完整脚本:

from __future__ import print_function
import json, os
import pymysql

import os, glob, subprocess, boto
from boto.s3.connection import S3Connection

conn = pymysql.connect(host='*******', port=3306, user='*****', passwd='******', db='*******')
cur = conn.cursor()

conn = S3Connection('***************','************************')
bucket = conn.get_bucket('**********')

def upload_file(company_friendly, filepath):
    key = bucket.new_key(company_friendly + ".gif")
    key.set_contents_from_filename(filepath)
    key.set_acl('public-read')
    return True

def lambda_handler(event, context):
    ### Grab Company Friendly from DB ###
    cur.execute("SELECT ************ FROM *********** WHERE company_id = %i LIMIT 1" % (event['company_id']))

    company_data = cur.fetchone()
    company_friendly = company_data[0]

    ### Grab all snapshots from DB ###
    cur.execute("SELECT *********** FROM ************ WHERE company_id = %i ORDER BY date ASC" % (event['company_id']))
    snapshot_data = cur.fetchall()  

    cropped_images = []
    for snapshot in snapshot_data:
        cropped_images.append(snapshot[0])

    ### Download and Save all of the cropped images for this company  ###
    count = 1
    files_list = []
    for image in cropped_images:
        key = bucket.get_key(image)
        string = str(count) + '.png'
        key.get_contents_to_filename(string)
        files_list.append(string) #this makes sure that the animated gif compiles the images in order
        count += 1
    print("should be done downloading all of the pictures from S3 ...")

    return(json.dumps({'status_code':200, 'msg':"company friendly name is " + company_friendly}, sort_keys=True))

为什么它不保存图像文件的任何想法?我正在使用Lambda控制台建议的默认S3角色

1 个答案:

答案 0 :(得分:4)

您可以尝试将该行更改为:

string = '/tmp/' + str(count) + '.png'

无法知道您是否在lambda机器上的当前目录中具有写访问权限。但/tmp会让你写。

来自:AWS Lambda FAQ

  

问:如果我的AWS Lambda函数需要磁盘空间,该怎么办?

     

每个Lambda函数接收500MB的非持久性磁盘空间   它自己的/ tmp目录。