使用S3存储桶的过滤器更新生命周期配置失败

时间:2019-06-17 11:06:25

标签: amazon-web-services amazon-s3

我正在使用Java SDK管理我的S3存储桶。此时,我想为此存储桶引入一个新的用例,即我想存储相似的对象,但保留期不同。我了解到可以通过前缀设置生命周期策略。我想利用S3提供的这种便利,使我存储在存储桶中的新对象具有不同的生命周期配置,并可以使用不同的前缀来标识。

这是我的Java程序:

package com.something.aws.s3;

import com.amazonaws.services.s3.AmazonS3;
import com.amazonaws.services.s3.AmazonS3ClientBuilder;
import com.amazonaws.services.s3.model.Bucket;
import com.amazonaws.services.s3.model.BucketLifecycleConfiguration;
import com.amazonaws.services.s3.model.lifecycle.LifecycleFilter;
import com.amazonaws.services.s3.model.lifecycle.LifecyclePrefixPredicate;
import org.junit.Before;
import org.junit.Test;

import java.util.List;

public class S3ClientTest {
    private AmazonS3 s3;

    @Before
    public void setup() {
        s3 = AmazonS3ClientBuilder.defaultClient();
    }

    @Test
    public void test_getBuckets() {
        for (Bucket b : s3.listBuckets()) {
            System.out.println(b.getName());
        }
    }

    @Test
    public void test_addPrefixRules() {
        String bucketName = "test-bucket";
        BucketLifecycleConfiguration.Rule rule = new BucketLifecycleConfiguration.Rule()
                .withId("new-lifecycle-id")
                .withExpirationInDays(1)
                .withFilter(new LifecycleFilter(new LifecyclePrefixPredicate("remote/")));
        List<BucketLifecycleConfiguration.Rule> bucketLifecycleConfigurationRules =
                s3.getBucketLifecycleConfiguration(bucketName).getRules();
        bucketLifecycleConfigurationRules.add(rule.withStatus(BucketLifecycleConfiguration.ENABLED));
        BucketLifecycleConfiguration updatedBucketLifecycleConfiguration =
                new BucketLifecycleConfiguration().withRules(bucketLifecycleConfigurationRules);
        s3.setBucketLifecycleConfiguration(bucketName, updatedBucketLifecycleConfiguration);
    }
}

我的测试test_addPrefixRules尝试获取为存储桶定义的所有生命周期配置规则,为前缀对象添加新规则,并使用新规则集更新存储桶。

运行此命令时,遇到以下异常:

 com.amazonaws.services.s3.model.AmazonS3Exception: Filter element can only be used in Lifecycle V2. (Service: Amazon S3; Status Code: 400; Error Code: InvalidRequest; Request ID: 6E24BE84B13B6440; S3 Extended Request ID: Y5VyIEuXcbGVBoddgdT7TVVa670dU6V1v5Oizlq/UU2pSDNjiAxyzrc155uf0MTfZxPw1GyUvGM=)
, S3 Extended Request ID: Y5VyIEuXcbGVBoddgdT7TVVa670dU6V1v5Oizlq/UU2pSDNjiAxyzrc155uf0MTfZxPw1GyUvGM=
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1639)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1304)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1056)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:743)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:717)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:699)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:667)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:649)
    at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:513)
    at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4325)
    at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4272)
    at com.amazonaws.services.s3.AmazonS3Client.setBucketLifecycleConfiguration(AmazonS3Client.java:2326)
    at com.amazonaws.services.s3.AmazonS3Client.setBucketLifecycleConfiguration(AmazonS3Client.java:2293)
    at com.appdynamics.eum.aws.s3.S3ClientTest.test_addPrefixRules(S3ClientTest.java:53)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
    at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
    at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
    at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
    at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
    at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
    at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
    at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
    at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
    at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
    at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
    at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
    at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
    at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47)
    at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242)
    at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)

我在论坛上发现很少的文档和讨论可以解释此错误。有人可以帮助我了解我在这里做错了什么吗?

1 个答案:

答案 0 :(得分:0)

如果您在单个生命周期策略中同时具有 PrefixFilter 基本标记,则会引发此异常。这些标签不能组合在一个策略中。您现有的政策可能已经有一些 Prefix 基本标签,因此在您尝试添加带有 Filter 基本标签的新规则时会引发错误。

一种可能的解决方法是用 Prefix 标签包裹 Filter 基本标签。

参考:https://forums.aws.amazon.com/message.jspa?messageID=812878