使用aws-sdk-go将文件保存到S3

时间:2015-05-05 17:41:01

标签: amazon-web-services go amazon-s3 aws-sdk-go

使用AWS S3 go sdk(https://github.com/awslabs/aws-sdk-go)在golang中保存文件时遇到了一些麻烦。

这就是我所拥有的:

import (
        "fmt"
        "bytes"

        "github.com/awslabs/aws-sdk-go/aws"
        "github.com/awslabs/aws-sdk-go/aws/awsutil"
        "github.com/awslabs/aws-sdk-go/service/s3"
)

func main() {    
    cred := aws.DefaultChainCredentials
    cred.Get() // i'm using environment variable credentials and yes, I checked if they were in here
    svc := s3.New(&aws.Config{Region: "us-west-2", Credentials:cred, LogLevel: 1})
    params := &s3.PutObjectInput{
                    Bucket:         aws.String("my-bucket-123"),
                    Key:            aws.String("test/123/"),
                    Body:         bytes.NewReader([]byte("testing!")),
            }
    resp, err := svc.PutObject(params)
    fmt.Printf("response %s", awsutil.StringValue(resp))
}

我一直收到301 Moved Permanently回复。

编辑:我手动创建了存储桶。 编辑#2:示例响应:

---[ RESPONSE ]--------------------------------------
HTTP/1.1 301 Moved Permanently
Transfer-Encoding: chunked
Content-Type: application/xml
Date: Tue, 05 May 2015 18:42:03 GMT
Server: AmazonS3

POST标志也是http。

2 个答案:

答案 0 :(得分:3)

根据Amazon

  

Amazon S3支持所有地区的虚拟托管样式和路径样式访问。但是,路径样式语法要求您在尝试访问存储桶时使用特定于区域的端点。例如,如果您有一个名为mybucket的存储桶驻留在EU中,您希望使用路径样式语法,并且该对象名为puppy.jpg,正确的URI为http://s3-eu-west-1.amazonaws.com/mybucket/puppy.jpg。如果您尝试使用以下任一方式的路径样式语法访问美国标准区域之外的存储桶,您将收到“PermanentRedirect”错误,HTTP响应代码301以及指示资源的正确URI的消息:

     

我认为问题在于您尝试访问错误区域的存储桶。您的要求是:

https://my-bucket-123.s3-us-west-2.amazonaws.com/test/123

因此,请确保my-bucket-123实际位于us-west-2。 (我用自己的水桶尝试了这个,效果很好)

我还通过包装调用验证它正在使用HTTPS :(他们的日志消息是错误的)

type LogReadCloser struct {
    io.ReadCloser
}

func (lr *LogReadCloser) Read(p []byte) (int, error) {
    n, err := lr.ReadCloser.Read(p)
    log.Println(string(p))
    return n, err
}

type LogRoundTripper struct {
    http.RoundTripper
}

func (lrt *LogRoundTripper) RoundTrip(req *http.Request) (*http.Response, error) {
    log.Println("REQUEST", req)
    res, err := lrt.RoundTripper.RoundTrip(req)
    log.Println("RESPONSE", res, err)
    res.Body = &LogReadCloser{res.Body}
    return res, err
}

然后:

svc := s3.New(&aws.Config{
    Region:      "us-west-2",
    Credentials: cred,
    LogLevel:    0,
    HTTPClient:  &http.Client{Transport: &LogRoundTripper{http.DefaultTransport}},
})

答案 1 :(得分:0)

我认为您最好使用S3上传器。这是我的代码中的一个示例,它是一个Web应用程序,我使用gin框架,以我为例,我从Web表单获取文件,将其上传到s3,然后检索URL以其他HTML形式显示页面:

// Create an S3 Uploader
  uploader := s3manager.NewUploader(sess)

  // Upload 
  result, err := uploader.Upload(&s3manager.UploadInput{
   Bucket: aws.String(bucket),
   Key: aws.String(fileHeader.Filename),
   Body: f,
  })
  if err != nil {
   c.HTML(http.StatusBadRequest, "create-project.html", gin.H{
    "ErrorTitle":   "S3 Upload Failed",
    "ErrorMessage": err.Error()})
  } else {
   // Success, print URL to Console.
   ///"result.Location is the URL of an Image"
   fmt.Println("Successfully uploaded to", result.Location)
  }

您可以在此处找到完整的示例,并逐步说明: https://www.matscloud.com/docs/cloud-sdk/go-and-s3/