Scrapy自定义日志和系统日志按级别输出到不同文件

当时搞了好久，代码就下面几行，太懒了直接贴吧：

import time, os, logging

# get my_logger
def get_logger(domain, start_time = time.strftime('%Y%m%d%H%M%S', time.localtime())):
    start_time = start_time[:12]
    path = '/home/scrapy/scrapy_spider_logs/'
    if not os.path.exists(path):
        os.makedirs(path)
    path_log = path + start_time

    my_logger = logging.getLogger(domain)
    my_logger.setLevel(logging.INFO)
    formatter = logging.Formatter('%(asctime)s %(levelname)s %(filename)s[line:%(lineno)d] %(message)s')

    scrapy_logger = logging.getLogger('scrapy')
    #scrapy_logger = logging.getLogger()
    scrapy_logger.setLevel(logging.WARNING)

    handler_info = logging.FileHandler('%s_info.log' % path_log, 'a', encoding='UTF-8')
    handler_info.setLevel(logging.INFO)
    handler_info.setFormatter(formatter)
    my_logger.addHandler(handler_info)
    scrapy_logger.addHandler(handler_info)

    handler_warning = logging.FileHandler('%s_warning.log' % path_log, 'a', encoding='UTF-8')
    handler_warning.setLevel(logging.WARNING)
    handler_warning.setFormatter(formatter)
    my_logger.addHandler(handler_warning)
    scrapy_logger.addHandler(handler_warning)

    handler_error = logging.FileHandler('%s_error.log' % path_log, 'a', encoding='UTF-8')
    handler_error.setLevel(logging.ERROR)
    handler_error.setFormatter(formatter)
    my_logger.addHandler(handler_error)
    scrapy_logger.addHandler(handler_error)

    my_logger.info('Get my_logger success !!!')

    return my_logger

使用时如下：

my_logger = get_logger(spider_name,start_time=start_time)
my_logger.info('Info logger')

my_logger.warning('Warning logger')

my_logger.error('Error logger')

对应级别的日志会输出到一时间戳命名的文件中。

转载于:https://my.oschina.net/u/2411067/blog/854497