boto在docker中的奇怪行为

时间:2016-01-11 02:09:15

标签: python docker boto

我正在运行以下image

docker run -it --rm python:3.4-slim  /bin/bash

里面(作为root),我安装了:

root@dab02ca9c61d:~# apt-get update && apt-get install nano

然后boto

root@dab02ca9c61d:~# pip install boto

然后我在/root/.boto中写了以下内容:

[Credentials]
aws_access_key_id = some_long_string
aws_secret_access_key = another_bigger_string

[Boto]
debug = 2
num_retries = 10

(此文件与我在主机上的文件相同)

版本是:

root@dab02ca9c61d:~# python -V
Python 3.4.4
root@dab02ca9c61d:~# pip list
boto (2.38.0)
pip (7.1.2)
setuptools (18.2)
root@dab02ca9c61d:~# 

(与我在主机/本地机器中完全相同)

如果我解雇了python控制台:

root@dab02ca9c61d:~# python
Python 3.4.4 (default, Jan  8 2016, 00:24:55) 
[GCC 4.9.2] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import boto
>>> boto.connect_s3()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
    return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
  File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
    validate_certs=validate_certs, profile_name=profile_name)
  File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 569, in __init__
    host, config, self.provider, self._required_auth_capability())
  File "/usr/local/lib/python3.4/site-packages/boto/auth.py", line 987, in get_auth_handler
    'Check your credentials' % (len(names), str(names)))
boto.exception.NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were checked. ['HmacAuthV1Handler'] Check your credentials
>>> 

如果我激活日志记录:

>>> boto.set_stream_logger('boto')
>>> boto.connect_s3()                                                                                                                                                                                                
2016-01-11 01:53:23,577 boto [DEBUG]:Using access key found in config file.
2016-01-11 01:53:23,577 boto [DEBUG]:Using secret key found in config file.
2016-01-11 01:53:23,577 boto [DEBUG]:Retrieving credentials from metadata server.
--- Logging error ---
Traceback (most recent call last):
  File "/usr/local/lib/python3.4/logging/__init__.py", line 978, in emit
    msg = self.format(record)
  File "/usr/local/lib/python3.4/logging/__init__.py", line 828, in format
    return fmt.format(record)
  File "/usr/local/lib/python3.4/logging/__init__.py", line 573, in format
    record.exc_text = self.formatException(record.exc_info)
  File "/usr/local/lib/python3.4/logging/__init__.py", line 523, in formatException
    traceback.print_exception(ei[0], ei[1], tb, None, sio)
  File "/usr/local/lib/python3.4/traceback.py", line 169, in print_exception
    for line in _format_exception_iter(etype, value, tb, limit, chain):
  File "/usr/local/lib/python3.4/traceback.py", line 146, in _format_exception_iter
    for value, tb in values:
  File "/usr/local/lib/python3.4/traceback.py", line 125, in _iter_chain
    context = exc.__context__
AttributeError: 'NoneType' object has no attribute '__context__'
Call stack:
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
    return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
  File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
    validate_certs=validate_certs, profile_name=profile_name)
  File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 555, in __init__
    profile_name)
  File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 200, in __init__
    self.get_credentials(access_key, secret_key, security_token, profile_name)
  File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 376, in get_credentials
    self._populate_keys_from_metadata_server()
  File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 391, in _populate_keys_from_metadata_server
    data='meta-data/iam/security-credentials/')
  File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 394, in get_instance_metadata
    return _get_instance_metadata(metadata_url, num_retries=num_retries, timeout=timeout)
  File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 234, in _get_instance_metadata
    return LazyLoadMetadata(url, num_retries, timeout)
  File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 244, in __init__
    data = boto.utils.retry_url(self._url, num_retries=self._num_retries, timeout=self._timeout)
  File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 224, in retry_url
    boto.log.exception('Caught exception reading instance data')
Message: 'Caught exception reading instance data'
Arguments: ()
2016-01-11 01:53:24,582 boto [ERROR]:Unable to read instance data, giving up
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
    return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
  File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
    validate_certs=validate_certs, profile_name=profile_name)
  File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 569, in __init__
    host, config, self.provider, self._required_auth_capability())
  File "/usr/local/lib/python3.4/site-packages/boto/auth.py", line 987, in get_auth_handler
    'Check your credentials' % (len(names), str(names)))
boto.exception.NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were checked. ['HmacAuthV1Handler'] Check your credentials
>>> 

(此示例在我的本地计算机上运行)

我已阅读Boto Credential Error with Python on Windows Boto: Dynamically get aws_access_key_id and aws_secret_access_key in Python code from config?和其他问题。什么都行不通。

之后,我查看了boto.pyami的源代码,如果我逐行执行则没有。

例如:

>>> boto.config.sections()
['Credentials', 'Boto']
>>> boto.config.get_value('Credentials', 'aws_access_key_id')
>>> 

请注意,最后一个命令返回None

boto.config使用ConfigParser,如果我使用它,它可以工作:

>>> import configparser
>>> config = configparser.ConfigParser()
>>> config.read('~/.boto')
[]
>>> config.read('/root.boto')                                         
['/root/.boto']
>>> config.get('Credentials', 'aws_access_key_id')
'some_long_string'
>>> 

(注意,如果我使用相对路径它不起作用)

最后,如果我使用:

>> boto.connect_s3('some_long_string', 'another_bigger_string')
2016-01-11 02:05:33,636 boto [DEBUG]:Using access key provided by client.
2016-01-11 02:05:33,636 boto [DEBUG]:Using secret key provided by client.
S3Connection:s3.amazonaws.com
>>> 

我做了另一项测试:我安排awscli并且它没有问题,将配置文件放在/etc/boto.cfg中并且无效。

我已经在这周末度过了所有的想法吗?

1 个答案:

答案 0 :(得分:2)

由于我无法发表评论,我会将此作为答案,但不完全确定Docker的问题是什么,但我也能够复制问题。可能想在boto上提出问题,看看有人可以提供帮助。但是我能够通过设置环境变量AWS_ACCESS_KEY_IDAWS_SECRET_ACCESS_KEY然后启动python来使其工作。不知道这是否有所帮助,但只是想把它扔出去,因为我花了一些时间来看它。