Mohammad
Mohammad

Reputation: 589

Preventing Duplicate Task Names Across Multiple Celery Workers

I want to prevent registering tasks with duplicate names in a Celery setup with multiple workers. The following approach works when running a single worker:

    def gen_task_name(self, name, module):
        if name in self.tasks.keys():
            raise ValueError(f'Task {name} already registered')
        return name

However, when using multiple workers, this check raises exceptions even for unique tasks because each worker independently registers tasks.

Upvotes: 0

Views: 17

Answers (0)

Related Questions