以编程方式创建s3cmd配置文件

时间:2014-05-14 09:16:10

标签: amazon-s3 s3cmd

我正在使用s3cmd将一些内容上传到S3存储桶。问题是,如何以编程方式向其提供一些配置变量?

我没有使用1.5版,因此我没有--access_key--secret_key标志。我只有--configure,它创建了一个配置文件交互式,以及-c,它必须提供一个配置文件。但是,我如何实际构建该配置文件?由--configure构建的配置文件在那里添加了许多选项;我只需要将访问密钥和密钥传递给我的s3cmd命令。

1 个答案:

答案 0 :(得分:1)

我一直在努力解决同样的问题,但幸运的是,因为我正在使用docker我可以在图像构建期间生成配置文件。

Dockerfile:

FROM ubuntu:xenial

ARG ACCESS_KEY
ARG SECRET_KEY

COPY template.s3cfg /tmp/template.s3cfg

RUN apt-get -y update; \
    apt-get -y install python-setuptools wget gettext-base; \
    wget http://netix.dl.sourceforge.net/project/s3tools/s3cmd/1.6.0/s3cmd-1.6.0.tar.gz; \
    tar xvfz s3cmd-1.6.0.tar.gz; \
    cd s3cmd-1.6.0; \
    python setup.py install

RUN ACCESS_KEY=$ACCESS_KEY \
    SECRET_KEY=$SECRET_KEY \
    bash -c '/usr/bin/envsubst < "/tmp/template.s3cfg" > "/root/.s3cfg";'

CMD [<whatever you wanna run>]

template.s3cfg:

[default]
access_key = ${ACCESS_KEY}
access_token = 
add_encoding_exts = 
add_headers = 
bucket_location = US
ca_certs_file = 
cache_file = 
check_ssl_certificate = True
check_ssl_hostname = True
cloudfront_host = cloudfront.amazonaws.com
default_mime_type = binary/octet-stream
delay_updates = False
delete_after = False
delete_after_fetch = False
delete_removed = False
dry_run = False
enable_multipart = True
encrypt = False
expiry_date = 
expiry_days = 
expiry_prefix = 
follow_symlinks = False
force = False
get_continue = False
gpg_command = None
gpg_decrypt = %(gpg_command)s -d --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
gpg_encrypt = %(gpg_command)s -c --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
gpg_passphrase = 
guess_mime_type = True
host_base = nyc3.digitaloceanspaces.com
host_bucket = %(bucket)s.nyc3.digitaloceanspaces.com
human_readable_sizes = False
invalidate_default_index_on_cf = False
invalidate_default_index_root_on_cf = True
invalidate_on_cf = False
kms_key = 
limit = -1
limitrate = 0
list_md5 = False
log_target_prefix = 
long_listing = False
max_delete = -1
mime_type = 
multipart_chunk_size_mb = 15
multipart_max_chunks = 10000
preserve_attrs = True
progress_meter = True
proxy_host = 
proxy_port = 0
put_continue = False
recursive = False
recv_chunk = 65536
reduced_redundancy = False
requester_pays = False
restore_days = 1
restore_priority = Standard
secret_key = ${SECRET_KEY}
send_chunk = 65536
server_side_encryption = False
signature_v2 = False
signurl_use_https = False
simpledb_host = sdb.amazonaws.com
skip_existing = False
socket_timeout = 300
stats = False
stop_on_error = False
storage_class = 
urlencoding_mode = normal
use_http_expect = False
use_https = True
use_mime_magic = True
verbosity = WARNING
website_endpoint = http://%(bucket)s.s3-website-%(location)s.amazonaws.com/
website_error = 
website_index = index.html

现在。在构建图像时,您只需指定ACCESS_KEYSECRET_KEY参数,就可以了。

当然,您可以通过这种方式指定更多值。您可以创建一个bash脚本,您可以将配置回显到文件中,这样您就不会丢失当前存在的配置文件。你根本就没有使用docker,这只是我的用例。

长话短说:使用envsubst