Apache Storm - Kinesis Spout抛出AmazonClientException后退

时间:2016-02-02 23:04:19

标签: apache-storm amazon-kinesis

2016-02-02 16:15:18 c.a.s.k.s.u.InfiniteConstantBackoffRetry [DEBUG] Caught exception of type com.amazonaws.AmazonClientException, backing off for 1000 ms.

我使用Streams和Get请求测试了GET和PUT - 两者都完美无缺。我有3个变种Batch,Storm和Spark。 Spark - 使用KinesisStreams - 工作批处理:你能得到和放置 - 工作风暴:计划使用Kinesis的KinesisSpout库。它没有任何线索。

final KinesisSpoutConfig config = new KinesisSpoutConfig(streamname, zookeeperurl);
config.withInitialPositionInStream(ipis);
config.withRegion(Regions.fromName(regionName));
config.withCheckpointIntervalMillis(Integer.parseInt(checkinterval));
config.withZookeeperPrefix("kinesis-zooprefix-" + name);

System.setProperty("aws.accessKeyId", key);
System.setProperty("aws.secretKey", keysecret);
SystemPropertiesCredentialsProvider scp = new SystemPropertiesCredentialsProvider();
final KinesisSpout spout = new KinesisSpoutConflux(config, scp, new ClientConfiguration());

我做错了什么?

风暴日志:

2016-02-02 16:15:17 c.a.s.k.s.KinesisSpout [INFO] KinesisSpoutConflux[taskIndex=0] open() called with topoConfig task index 0 for processing stream Kinesis-Conflux
2016-02-02 16:15:17 c.a.s.k.s.KinesisSpout [DEBUG] KinesisSpoutConflux[taskIndex=0] activating. Starting to process stream Kinesis-Test
2016-02-02 16:15:17 c.a.s.k.s.KinesisHelper [INFO] Using us-east-1 region

我没有看到" nextTuple"被叫。

我的版本:

  • storm = 0.9.3
  • kinesis-storm-spout = 1.1.1

0 个答案:

没有答案