如何使用S3与sdk将整个“文件夹”复制到另一个路径?

时间:2012-12-14 18:37:32

标签: ruby amazon-s3

当我为单个文件执行时,它可以工作:

    aws_s3 = AWS::S3.new(S3_CONFIG)
    bucket = aws_s3.buckets[S3_CONFIG["bucket"]]

    object = bucket.objects["user/1/photos/image_1.jpg"]
    new_object = bucket.objects["users/1/photos/image_1.jpg"]
    object.copy_to new_object, {:acl => :public_read}

但我想移动整个“/ photos”文件夹抛出No Such Key。可能s3键只是每个文件的完整路径。怎么做?

    aws_s3 = AWS::S3.new(S3_CONFIG)
    bucket = aws_s3.buckets[S3_CONFIG["bucket"]]

    object = bucket.objects["user/1/photos"]
    new_object = bucket.objects["users/1/photos"]
    object.copy_to new_object, {:acl => :public_read}

谢谢!

3 个答案:

答案 0 :(得分:5)

做到了:

bucket.objects.with_prefix("user/1/photos").each do |object|
   ...
end

答案 1 :(得分:1)

我需要额外的代码来实现这一目标。基本上从源前缀中删除基数,然后将其添加到目标前缀:

def copy_files_s3(bucket_name, source, destination)
  source_bucket = @s3.buckets[bucket_name]
  source_bucket.objects.with_prefix(source).each do |source_object|
    new_file_name = source_object.key.dup
    new_file_name.slice! source
    new_object = source_bucket.objects["#{destination}#{new_file_name}"]
    source_object.copy_to new_object, {acl: :public_read}
  end
end

答案 2 :(得分:1)

“文件夹”不是S3中的对象,这就是您无法通过键获取它的原因,但文件夹路径实际上是文件夹所包含对象的所有键的前缀。

另一个重要的事情是,您必须对密钥进行url编码,否则您可能会遇到未知的密钥错误。

require 'aws-sdk'
require 'aws-sdk-s3'
require 'securerandom'
require 'uri'
require "erb"
include ERB::Util

def copy_folder(folder, destination)
    bucket_name = 'your_bucket'
    credentials = Aws::Credentials.new('key', 'secret')
    s3_client = Aws::S3::Client.new(region:'the_region', credentials: credentials)
    enumerate_keys_with_prefix(source).each do |source_object|
       source_key = url_encode(source_object.key)
       destination_key = source_object.key.dup.sub(source, "")
       s3_client.copy_object({bucket: bucket_name, copy_source: bucket_name+'/'+source_key, key: destination+'/'+destination_key, acl: "public-read"})
    end
end

def enumerate_keys_with_prefix(prefix)
    bucket_name = 'your_bucket'
    credentials = Aws::Credentials.new('key', 'secret')
    s3 = Aws::S3::Resource.new(region:'the_region', credentials:credentials)
    return s3.bucket(bucket_name).objects(prefix: prefix)
end