Question

按照设计，我的应用程序有时会产生重复错误，这些错误会填满日志文件并使其难以阅读。它看起来像是：

WARNING:__main__:CRON10: clock unset or no wind update received in 60 sec -> supressed rrd update
WARNING:__main__:CRON10: clock unset or no wind update received in 60 sec -> supressed rrd update
WARNING:__main__:CRON10: clock unset or no wind update received in 60 sec -> supressed rrd update
WARNING:__main__:CRON10: clock unset or no wind update received in 60 sec -> supressed rrd update

如何使用Python日志记录模块来抑制重复消息并输出更多rsyslog样式（http://www.rsyslog.com/doc/rsconf1_repeatedmsgreduction.html）：

WARNING:__main__:CRON10: clock unset or no wind update received in 60 sec -> supressed rrd update
--- The last message repeated 3 times

有没有办法扩展日志记录，还是我必须编写一个完全自己的记录器？

我用于记录的代码是：

logging.basicConfig(format='%(asctime)s %(message)s')
logging.basicConfig(level=logging.info)
logger = logging.getLogger(__name__)
hdlr = logging.FileHandler(LOGFILE)
hdlr.setFormatter(formatter)
logger.addHandler(hdlr)

有关于此的任何想法吗？

Answer 1

您可以创建一个logging.Filter来跟踪上次记录的记录并过滤掉任何重复（类似）记录，例如：

import logging

class DuplicateFilter(logging.Filter):

    def filter(self, record):
        # add other fields if you need more granular comparison, depends on your app
        current_log = (record.module, record.levelno, record.msg)
        if current_log != getattr(self, "last_log", None):
            self.last_log = current_log
            return True
        return False

然后将其添加到您使用的记录器/处理程序（即hdlr.addFilter(DuplicateFilter())）或根记录器以过滤所有默认日志。这是一个简单的测试：

import logging

logging.warn("my test")
logging.warn("my repeated test")
logging.warn("my repeated test")
logging.warn("my repeated test")
logging.warn("my other test")

logger = logging.getLogger()  # get the root logger
logger.addFilter(DuplicateFilter())  # add the filter to it

logging.warn("my test")
logging.warn("my repeated test")
logging.warn("my repeated test")
logging.warn("my repeated test")
logging.warn("my other test")

这将打印出来：

WARNING:root:my test
WARNING:root:my repeated test
WARNING:root:my repeated test
WARNING:root:my repeated test
WARNING:root:my other test
WARNING:root:my test
WARNING:root:my repeated test
WARNING:root:my other test

在Python日志记录模块AKA日志压缩中抑制具有相同内容的多条消息

1 个答案: