Apache Storm:后期元组会被确认还是失败?

时间:2018-11-26 01:55:08

标签: apache-storm

我的日志中包含以下信息。

问题1:这是否会使喷口接收失败的消息?导致该元组所属的元组树失败?

第二季度:为什么这些晚元组要延迟几分钟,但是UI中显示的完整延迟仍然是几百毫秒?

Q3:当输入速率为10 tuples / s时没有延迟元组,但是当增加到100 tuples / s时它将大量出现,因此它将无法正常工作。我该怎么办才能解决这个问题?

2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=project, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-9-count_bolt-executor[53 53] [INFO] Received a late tuple {word=free, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=full, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-9-count_bolt-executor[53 53] [INFO] Received a late tuple {word=almost, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=for, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-9-count_bolt-executor[53 53] [INFO] Received a late tuple {word=whatsoever., timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=project, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=for, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=others., timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=project, timestamp=1543194524005} with ts 1543194524005. This will not be processed.

更新

我的拓扑:KafkaSpout ---> SpilitBolt ---> EventTimeWindowCountBolt ---> KafkaSink

暴风雨版本:1.2.1

CountBolt:

 builder.setBolt("count_bolt", new CountBlot()
                .withTumblingWindow(new Duration(time_windowsize, TimeUnit.SECONDS))   //3s
                .withLag (new Duration(time_windowlag, TimeUnit.SECONDS))  // 1s
                .withTimestampField("timestamp")
                , parallelism)
                .fieldsGrouping("split_bolt", new Fields("word"));

0 个答案:

没有答案