CODEWITHSUNDEEP
pythonpython-3.x
Pawan Bhandarkar
Pawan Bhandarkar

Reputation: 304

Accessing common properties from multiple python modules

I'm not entirely sure if the title is appropriate for this question but here's what I am trying to achieve: I have a directory structure like this:

models/
   modelA/
      src/
         modelA.py
      __init__.py
   modelB/
      src/
          modelB.py
      __init__.py
scripts/
   sandbox.py

The __init__.py file within each model folder contains the following code:

from .src.modelA import modelA as Model

MODEL_NAME = "modelA"
MODEL_VERSION = "1.0.0"

INPUT_FEATURES_TYPES = [ ("feature1", "1.0.0"), ("feature2", "1.0.0") ]
INPUT_TYPE = "images"

Now from within sandbox.py, I want to be able to create an array containing the list of models and their properties by parsing each of the __init__.py files. The final result I want to achieve is something like this: 

[{
    name : "modelA",
    version: "1.0.0",
    inputFeat : [("feature1", "1.0.0"), ("feature2", "1.0.0")],
    inputType : "images"
 }, 
 {
    name : "modelB",
    version: "1.0.0",
    inputFeat : [("feature1", "1.0.0"), ("feature2", "1.0.0")],
    inputType : "text"
 },
 ...
]

Is there any easy way to do this? or do I HAVE to create and update a static file that lists all these details? My intention is that I can keep adding new models in the future and still be able to easily extract this list whenever needed.

Upvotes: 0

Views: 66

Answers (1)

gohu
gohu

Reputation: 151

You can use pkgutil to iterate over the submodules:

import pkgutil
import importlib

for importer, modname, ispkg in pkgutil.iter_modules('/path/to/models', '.src.'):
   module = importlib.import_module(modname)
   from module import MODEL_NAME, MODEL_VERSION, INPUT_FEATURES_TYPES, INPUT_TYPE

Then you can create your dictionary.

I haven't tested the previous code but it works on one my own packages using the module name:

pkgutil.iter_modules(module.__path__, module.__name__ + '.')

Upvotes: 1

Related Questions