NiFi生成巨大的日志文件 - 持续记录 - 流控制器执行任务已被取消

时间：2016-08-04 00:30:58

标签： logging apache-nifi

我的Nifi实例正在疯狂地反复生成大量相同的日志。我的流程由ExecuteStreamCommand组成，它在内部调用Java可排除的jar。另外，看看NiFi UI，该处理器似乎卡在1活动线程中。即使我重新启动NiFi，似乎这种状态仍然存在并且它仍在继续发生。正如您在下面所看到的，它在一秒钟内记录了数千行相同的日志。疯狂！

    016-08-03 17:21:12,904 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@3fe940f' has been cancelled.
2016-08-03 17:21:12,904 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5c02799' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@52871b90' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5c488f85' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2be136ef' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2f1930e5' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4528e50d' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5d046e8a' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7ff06d8b' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1908e488' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1b8a6a29' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@650437ec' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@196492f2' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@471609f2' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@f05e81b' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4bfa0540' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@76b4fdcf' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@19a2372' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@21ff466a' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@3ab48710' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6bbf5f0c' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@3b6e60ba' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@60f9bdab' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7eeb3aa3' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6f3d5d4d' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@271e8ba0' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@aa77e0d' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2d3e73d8' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@286c9407' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7bfc4921' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4a1a0745' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@14640d6d' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@58646f4a' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@41488026' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5b728765' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6f49e603' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@14acca9f' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@11e0219c' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5e66d56a' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7e3f595b' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@c359c31' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1c49a0ea' has been cancelled.

1 个答案:

答案 0 :(得分：2)

看起来org.apache.nifi正在调试级别进行日志记录，这可以解释为什么您会看到这么多日志。默认情况下，NiFi附带的logback.xml记录在INFO级别。

FlowEngine是一个线程池执行器，它执行流的所有任务，并且在检查完成任务的结果时会发生您看到的日志记录语句。你是正确的，当处理器计划在0秒运行时，它会尽可能快地执行，这会执行很多任务。我不完全确定为什么这么多任务报告为已取消和常规完成。

相关问题
最新问题