大家好:我试图通过s3在EMR集群中获取s3 distcp jar文件:
s3cmd get s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.1/s3distcp.jar
然而," get"命令无效:
ERROR: Skipping libs/s3distcp/: No such file or directory
此文件也存在于其他s3区域,所以我甚至尝试过:
s3cmd get s3://us-east-1.elasticmapreduce/libs/s3distcp/1.0.1/s3distcp.jar
但是这个命令仍然失败了。但是唉 - 这个.jar文件清晰存在,当我们运行" s3cmd ls"时,我们可以看到它列出来了。有关详细信息,请参见下文(欧洲西部地区的示例):
hadoop@ip-10-58-254-82:/mnt$ s3cmd ls s3://eu-west-1.elasticmapreduce/libs/s3distcp/
Bucket 'eu-west-1.elasticmapreduce':
2012-06-01 00:32 3614287 s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.1/s3distcp.jar
2012-06-05 17:14 3615026 s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.2/s3distcp.jar
2012-06-12 20:52 1893078 s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.3/s3distcp.jar
2012-06-20 01:17 1893140 s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.4/s3distcp.jar
2012-06-27 21:27 1893846 s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.5/s3distcp.jar
2012-03-15 21:21 3613175 s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0/s3distcp.jar
2012-06-27 21:27 1893846 s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.latest/s3distcp.jar
以上似乎证实,实际上该文件存在。
* 如何启用" get"命令为这个文件工作? *
答案 0 :(得分:1)
jar工作正常,你可以粘贴get命令后得到的错误信息吗?
:s3cmd ls s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.1/s3distcp.jar
2012-06-01 00:32 3614287 s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.1/s3distcp.jar
:s3cmd get s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.1/s3distcp.jar
s3://eu-west-1.elasticmapreduce/libs/s3distcp/1.0.1/s3distcp.jar -> ./s3distcp.jar [1 of 1]
3614287 of 3614287 100% in 3s 1008.86 kB/s done