将155 GB文件上载到S3存储桶

时间:2017-03-07 16:41:22

标签: amazon-web-services amazon-s3

我使用S3Express上的Windows使用以下命令将155GB文件上传到S3存储桶:

put E:\<Folder-name>\<File-name>.csv s3://data.<company-name>.org/<Folder-name>/ -mul:100 -t:2

但上传似乎并未开始。它被困在以下地方:

Max. Threads: 2
Using MULTIPART UPLOADS (part size:100MB)
S3 Bucket: s3:
S3 Folder: data.<company-name>.org/<Folder-name>/
Selecting Files ...
Press 'Esc' to stop ...
Selected Files to Upload: 1 (154.61GB = 166013845848B) - Use [-showfiles] to list files.
Uploading files to S3...
Press 'Esc' to stop ...
[s=Status] [p=in Progress] [e=Errors] [w=Warnings] [k=sKipped] [d=Dupl] [o=Out]

之前抛出以下错误:

Error initializing upload for file : E:\<Folder-name>\<File-name>.csv
E:\<Folder-name>\<File-name>.csv: com_err:7 - Failed to connect to s3 port 443: Timed out - Failed to retrieve list of active multipart uploads
------------------------------------------------------------------------------
Done.
Errors (1):
E:\<Folder-name>\<File-name>.csv - com_err:7 - Failed to connect to s3 port 443: Timed out - Failed to retrieve list of active multipart uploads
------------------------------------------------------------------------------
Threads: 0 - Transf.: 0B (0B/sec) ET: 0h 25m 30s
Current Bandwidth: 0B/sec (0B left) - Temporary Network Errors: 4
Compl. Files: 0 of 1 (0B of 154.61GB) (0%) - Skip: 0 - Err: 1 (154.61GB)

我是S3ExpressAWS的新手。

非常感谢任何帮助。

TIA。

1 个答案:

答案 0 :(得分:2)

从目的地的开头删除s3://。根据文档,格式为bucket_name/object_name。没有s3://前缀。

这些行应该是一个线索,你的调用有问题:

S3 Bucket: s3:
S3 Folder: data.<company-name>.org/<Folder-name>/