CODEWITHSUNDEEP
pythonlogging
tekken
tekken

Reputation: 43

change config file's format dynamically for python

I have the following questions about python logging module.

  1. Can I change the format defined in configuration file dynamically from code?

  2. Can one module in my application get its format configured by a config file while other modules get their format and other properties configured through a python script?

  3. I want to add contextual info to my logs but I am using a config file to define logger properties. How can I go about this?

P.S. I can provide some code and application structure if required.

Structure -

1.) Agent - calls logging_setup script to set up logger configuration 2.) Modules

I have a logging_setup script that has the following methods:

logging_setup.py

import logging
import logging.handlers

LOGGER_FORMAT="%(asctime)s %(CMDID)s %(levelname)s %(message)s"

class testFormatter(logging.Formatter):
  def format(self,record):
    record.message=record.getMessage()
    if string.find(self._fmt,"%(asctime)") >= 0:
      record.asctime = self.formatTime(record, self.datefmt)

    if threading.currentThread().getName() in cmdidDict:
      record.CMDID=cmdidDict[threading.currentThread().getName()]
    else:
      record.CMDID="Oda_EnvId"
    return self._fmt % record.__dict__

def initLogging(loggername,newCMDID):
  global CMDID
  global newCMDID
  logger=logger.getLogger(loggername)
  format=testFormatter(LOGGER_FORMAT)
  *set up other config*

So I wanted to set up CMDID variable in my logs dynamically which i achieved by using the testFormatter class and initializing logger with that class. There is a bit more to it but I hope u get the idea.

LOGGER_FORMAT="%(asctime)s %(CMDID)s %(levelname)s"

But now I want to change the log level of logs from the modules themselves keeping the format same throughout. So I decided to create a universal config file that could set up the logging configuration for me throughout the application. My problem is how do I make this config file set the CMDID variable in the format.

config file

[loggers]
keys=root,testModule

[formatters]
keys=generic

[handlers]
keys=fh

[logger_root]
level=DEBUG
handlers=fh

[logger_testModule]
level=ERROR        <<-- setting my log level here
handlers=fh
qualname=testModule
propagate=0

[handler_fh]
class=handlers.RotatingFileHandler
level=DEBUG
formatter=generic
maxBytes=1000
args=('spam.log',)

[formatter_generic]
format=%(asctime)s %(levelname)s %(message)s   <<---This should somehow set CMDID var

Upvotes: 0

Views: 2295

Answers (2)

Siva Cn
Siva Cn

Reputation: 947

You Could Try This:

import sys
import ConfigParser

CONFIG = ConfigParser.ConfigParser()

CONFIG.read('config.ini')  # This is your Config file

print "BEFORE CHANGE"
CONFIG.write(sys.stdout)

## Try printing any option under any section
#print CONFIG.get('section1', 'option1')

CONFIG.set('section1', 'option1', value=1234)

print "AFTER CHANGE"
CONFIG.write(sys.stdout)

OUTPUT:

BEFORE CHANGE
[section1]
option1 = aaaa
option2 = bbbb

[sectin2]
option1 = cccc
option2 = dddd

AFTER CHANGE
[section1]
option1 = 1234
option2 = bbbb

[sectin2]
option1 = cccc
option2 = dddd

Upvotes: 1

JonathanV
JonathanV

Reputation: 2504

I think providing that code and application structure may be needed.

  1. It is not clear what you mean by changing the format. The format of what?

  2. Sure. When you assign a value to variable_1 pull it from the config, then when you assign variable_2 get the value from somewhere else.

  3. What contextual information do you want in your logs? You can configure your logs to have a field that is not predetermined and logs a variable value into them. So then all you have to do is set the value of that variable based on what is happening in your code and write it to the log.

Upvotes: 0

Related Questions