我的日志中包含以下信息。
问题1:这是否会使喷口接收失败的消息?导致该元组所属的元组树失败?
第二季度:为什么这些晚元组要延迟几分钟,但是UI中显示的完整延迟仍然是几百毫秒?
Q3:当输入速率为10 tuples / s时没有延迟元组,但是当增加到100 tuples / s时它将大量出现,因此它将无法正常工作。我该怎么办才能解决这个问题?
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=project, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-9-count_bolt-executor[53 53] [INFO] Received a late tuple {word=free, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=full, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-9-count_bolt-executor[53 53] [INFO] Received a late tuple {word=almost, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=for, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-9-count_bolt-executor[53 53] [INFO] Received a late tuple {word=whatsoever., timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=project, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=for, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=others., timestamp=1543194524005} with ts 1543194524005. This will not be processed.
2018-11-26 09:23:55.056 o.a.s.t.WindowedBoltExecutor Thread-11-count_bolt-executor[40 40] [INFO] Received a late tuple {word=project, timestamp=1543194524005} with ts 1543194524005. This will not be processed.
更新:
我的拓扑:KafkaSpout ---> SpilitBolt ---> EventTimeWindowCountBolt ---> KafkaSink
暴风雨版本:1.2.1
CountBolt:
builder.setBolt("count_bolt", new CountBlot()
.withTumblingWindow(new Duration(time_windowsize, TimeUnit.SECONDS)) //3s
.withLag (new Duration(time_windowlag, TimeUnit.SECONDS)) // 1s
.withTimestampField("timestamp")
, parallelism)
.fieldsGrouping("split_bolt", new Fields("word"));