使用s3 logdir的Tensorboard / tensorflow-curl返回错误代码6

时间:2018-08-14 16:40:33

标签: tensorflow amazon-s3 tensorboard

曾尝试使用多种设置/ env-vars / tf-versions,但无法使用。.

在我的本地计算机上,此工作AWS_ACCESS_KEY_ID=XXX AWS_SECRET_ACCESS_KEY=XXX AWS_REGION=eu-west-1 tensorboard --logdir="s3://my-bucket/tflogs/"

在一个AWS实例上,它将抛出:

I tensorflow/core/platform/s3/aws_logging.cc:54] Creating HttpClient with max connections2 and scheme http
I tensorflow/core/platform/s3/aws_logging.cc:54] Initializing CurlHandleContainer with size 2
I tensorflow/core/platform/s3/aws_logging.cc:54] Creating Instance with default EC2MetadataClient and refresh rate 900000
I tensorflow/core/platform/s3/aws_logging.cc:54] Found secret key
I tensorflow/core/platform/s3/aws_logging.cc:54] Initializing CurlHandleContainer with size 25
I tensorflow/core/platform/s3/aws_logging.cc:54] Found secret key
I tensorflow/core/platform/s3/aws_logging.cc:54] Pool grown by 2
I tensorflow/core/platform/s3/aws_logging.cc:54] Connection has been released. Continuing.
E tensorflow/core/platform/s3/aws_logging.cc:60] Curl returned error code 6
W tensorflow/core/platform/s3/aws_logging.cc:57] If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.
W tensorflow/core/platform/s3/aws_logging.cc:57] Request failed, now waiting 0 ms before attempting again.
I tensorflow/core/platform/s3/aws_logging.cc:54] Found secret key
2018-08-14 16:32:18.725199: I tensorflow/core/platform/s3/aws_logging.cc:54] Connection has been released. Continuing.
E tensorflow/core/platform/s3/aws_logging.cc:60] Curl returned error code 6
W tensorflow/core/platform/s3/aws_logging.cc:57] If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.


https://github.com/tensorflow/tensorflow/issues/16397

中找不到任何提示

并且没有明确的区别可能在哪里,我已经确保具有相同的tensorflow / tensorboard版本(1.8.0)。在指定s3 tensorboard logdir的情况下运行tensorflow也会发生。

1 个答案:

答案 0 :(得分:0)

像这样解决它:

export AWS_ACCESS_KEY_ID=<access key id>
export AWS_SECRET_ACCESS_KEY=<secret access key>
export AWS_REGION=us-west-2
export S3_REGION=us-west-2
export S3_ENDPOINT=s3.us-west-2.amazonaws.com
export S3_USE_HTTPS=1
export S3_VERIFY_SSL=0

tensorboard --logdir=s3://<path>