找不到配置了日志记录的库的处理程序

Question

我配置了日志记录，但我似乎错过了一个步骤。在这个例子中，我使用的是suds，但是我在使用这种日志方法记录任何库时遇到了这个问题。

这有效

host-03:~ # python2.7
Python 2.7.7 (default, Aug 27 2014, 16:51:46)
[GCC 4.3.4 [gcc-4_3-branch revision 152973]] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import logging
>>> logging.basicConfig()
>>> from suds.client import Client
>>> logging.getLogger('suds.client').setLevel(logging.DEBUG)
>>> client = Client('https://10.10.10.10:8443/path/to/wsdl?wsdl')
>>> user = 'User'
>>> password = 'pass'
>>> client.service.checkAuthentication(user, password)
DEBUG:suds.client:sending to (https://10.10.10.10:8443/path/to/wsdl)
message:
<?xml version="1.0" encoding="UTF-8"?>
<SOAP-ENV:Envelope xmlns:ns3="http://www.w3.org/2001/XMLSchema" xmlns:SOAP-ENC="http://schemas.xmlsoap.org/soap/encoding/" xmlns:ns0="http://schemas.xmlsoap.org/soap/encoding/" xmlns:ns1="http://DefaultNamespace" xmlns:ns2="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/" SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/">
   <SOAP-ENV:Header/>
   <ns2:Body>
      <ns1:checkAuthentication>
         <username xsi:type="ns3:string">User</username>
         <password xsi:type="ns3:string">pass</password>
      </ns1:checkAuthentication>
   </ns2:Body>
</SOAP-ENV:Envelope>
DEBUG:suds.client:headers = {'SOAPAction': '""', 'Content-Type': 'text/xml; charset=utf-8'}
DEBUG:suds.client:HTTP succeeded:
<?xml version="1.0" encoding="utf-8"?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><soapenv:Body><ns1:checkAuthenticationResponse soapenv:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/" xmlns:ns1="http://DefaultNamespace"><checkAuthenticationReturn xsi:type="xsd:boolean">true</checkAuthenticationReturn></ns1:checkAuthenticationResponse></soapenv:Body></soapenv:Envelope>
True
>>>

但是，当我按照以下方式配置文件和控制台日志记录时，我发送的任何消息（通过使用logger.debug等）都按预期工作，但是，来自库的任何日志始终显示“未找到处理程序”。

from datetime import datetime
import logging
import logging.handlers
import os

class CustomFormatter(logging.Formatter):
    """used for colored terminal logging"""
    BLACK, RED, GREEN, YELLOW, BLUE, MAGENTA, CYAN, WHITE = range(8)
    colors = dict(
        CRITICAL='\33[1;9%dm' % RED,
        ERROR='\33[9%dm' % RED,
        WARNING='\33[9%dm' % YELLOW,
        INFO='\33[1;9%dm' % GREEN,
        DEBUG='\33[9%dm' % BLUE,
        NOTSET='\33[%dm' % BLACK,  # reset
    )
    def __init__(self, fmt=None, datefmt=None, color=False):
        fmt = fmt if fmt else ('%(asctime)s %(module)-11s %(levelname)-9s '
                               '%(threadName)-10s %(message)s')
        logging.Formatter.__init__(self, fmt, datefmt)
        self.color = color
    def formatTime(self, record, datefmt=None):
        create_time = datetime.fromtimestamp(record.created)
        if datefmt:
            s = create_time.strftime(datefmt)
        else:
            t = create_time.strftime("%Y-%m-%d %H:%M:%S")
            s = "%s.%03d" % (t, record.msecs)
        return s
    def format(self, record):
        s = super(CustomFormatter, self).format(record)
        if self.color:
            s = self.colors[record.levelname] + s + self.colors['NOTSET']
        return s

# get logger
logger = logging.getLogger(__name__)
logger.setLevel(logging.DEBUG)

# configure file handler
path_to_log = '/app/logs/app.log'
filehandler = logging.handlers.RotatingFileHandler(path_to_log, backupCount=5)
filehandler.setLevel(logging.DEBUG)
filehandler.setFormatter(CustomFormatter())
if os.path.isfile(path_to_log):
    filehandler.doRollover()

# configure stream handler
console = logging.StreamHandler()
console.setLevel(logging.DEBUG)
console.setFormatter(CustomFormatter(color=True))

# add handlers to logger
logger.addHandler(filehandler)
logger.addHandler(console)

# configure client
from suds.client import Client
logging.getLogger('suds.client').setLevel(logging.DEBUG)

client = Client('https://10.10.10.10:8443/path/to/wsdl?wsdl')
user = 'User'
password = 'pass'
client.service.checkAuthentication(user, password)


>>> client.service.checkAuthentication(user, password)
No handlers could be found for logger "suds.client"
True
>>>

当我直接调用

时，

日志记录正常工作

>>> logger.debug('some test message')
2015-01-15 09:10:18.523 <stdin>     DEBUG     MainThread some test message
>>>
host-03:~ # cat /app/logs/app.log
2015-01-15 09:10:18.523 <stdin>     DEBUG     MainThread some test message

我的日志记录配置中缺少什么导致库找不到我的日志记录处理程序？

Answer 1

所以我确实设法解决了这个问题。什么不明显......当你使用除basicConfig，file或dict config之外的任何类型的日志配置时，现有的记录器被禁用。如果库使用

logger = logging.getLogger('your app or module')

然后它会工作，但因为他们都抓住了

logger = logging.getLogger(__name__)

然后滚动自己的记录器离开lib而没有配置的处理程序。你有几个选择。

将lib设置为空处理程序（如上面的帖子suds.client）

logging.getLogger('suds.client').addHandler(logging.NullHandler())

但如果您想查看消息

，那就不是很有用了

或者您可以使用file或dictConfig并指定disable_existing_loggers=False

但我仍对结果不满意。如果将默认日志级别设置为debug，则libs将污染您的输出，但如果将默认值设置为warning，则这对您自己的日志记录不是很有用。你可以独立设置库，但这可能有点痛苦。

我最终做的是将级别设置为DEBUG，但我添加了一个lib过滤器，它将任何日志记录从库发送到它自己的文件。然后在运行我的应用程序实例后，我查看了日志以确定我认为有用的内容，然后降低了那些被认为没有必要的WARN级别。

logging.getLogger('suds.client').setLevel(logging.DEBUG)
logging.getLogger('suds.transport.http').setLevel(logging.WARN)

我最终离开了lib过滤器，因为对我来说有一些详细的库跟踪很有用，但对我的标准日志来说太过分了。我还添加了一些初始化，以删除应用程序的每个实例的任何以前的日志。

以下是一个类似于我现在使用的片段。

"""some sample log"""
import os
import logging
import logging.config
import logging.handlers
from datetime import datetime

logger = logging.getLogger(__name__)


class CustomFormatter(logging.Formatter):
    """used for colored terminal logging"""
    BLACK, RED, GREEN, YELLOW, BLUE, MAGENTA, CYAN, WHITE = range(8)
    colors = dict(
        CRITICAL='\33[1;9%dm' % RED,
        ERROR='\33[9%dm' % RED,
        WARNING='\33[9%dm' % YELLOW,
        INFO='\33[1;9%dm' % GREEN,
        DEBUG='\33[9%dm' % BLUE,
        NOTSET='\33[%dm' % BLACK,  # reset
    )

    def __init__(self, fmt=None, datefmt=None, color=False):
        fmt = fmt if fmt else ('%(asctime)s %(module)-11s %(levelname)-9s '
                               '%(threadName)-10s %(message)s')
        logging.Formatter.__init__(self, fmt, datefmt)
        self.color = color

    def formatTime(self, record, datefmt=None):
        create_time = datetime.fromtimestamp(record.created)
        if datefmt:
            s = create_time.strftime(datefmt)
        else:
            t = create_time.strftime("%Y-%m-%d %H:%M:%S")
            s = "%s.%03d" % (t, record.msecs)
        return s

    def format(self, record):
        s = super(CustomFormatter, self).format(record)
        if self.color:
            s = self.colors[record.levelname] + s + self.colors['NOTSET']
        return s


class LibFilter(logging.Filter):
    """custom filter to send suds logging to a separate file"""
    def filter(self, record):
        if [x for x in '__main__', __name__.split('.', 1)[0]
                if x in record.name]:
            return True
        else:
            create_time = datetime.fromtimestamp(record.created)
            t = create_time.strftime("%Y-%m-%d %H:%M:%S")
            s = "%s.%03d" % (t, record.msecs)
            with open('logs/%s.log' % record.name, 'a') as f:
                f.write(s + '\n')
                f.write(record.getMessage() + '\n\n')
            return False


def setup_logging():
    """use dictConfig to setup logging"""
    log_file = 'logs/app.log'
    doRollover = os.path.isfile(log_file)
    logging.config.dictConfig(
        dict(
            version=1,
            disable_existing_loggers=False,
            filters=dict(libfilter={'()': LibFilter}),
            formatters=dict(
                colorformatter={'()': CustomFormatter, 'color': True},
                fileformatter={'()': CustomFormatter}),
            handlers=dict(
                console={
                    'class': 'logging.StreamHandler',
                    'filters': ['libfilter'],
                    'formatter': 'colorformatter',
                    'level': 'DEBUG'},
                filehandler={
                    'class': 'logging.handlers.RotatingFileHandler',
                    'filename': log_file,
                    'backupCount': 3,
                    'filters': ['libfilter'],
                    'formatter': 'fileformatter',
                    'level': 'DEBUG'}),
            root=dict(level='INFO', handlers=['console', 'filehandler'])
        )
    )
    if doRollover:
        for handler in logging.getLogger('').handlers:
            if getattr(handler, 'doRollover', None):
                handler.doRollover()

我的测试应用

"""
    test logging configuration
"""
import logging

from mod import log
log.setup_logging()

logger = logging.getLogger(__name__)

logger.debug('debug msg')
logger.info('info msg')
logger.warning('warning msg')
logger.error('error msg')
logger.exception('exception msg')

现在我的控制台和文件日志和以前一样，对于我的所有库，我为每个库获取一个单独的文件。我没有实现翻转逻辑，但在我的应用程序中，我每次运行应用程序时都会删除之前的库日志。