CODEWITHSUNDEEP
pythonmultithreadingcelerycelery-task
MKM
MKM

Reputation: 503

task with number of task can run along that in celery

As I see in celery, It can get number of tasks for a worker, that can run them at a same time.

I need run a task and set number of tasks can run simultaneously with this task.

celery with workers

Therefore, If I set this number to 2 and this task send to worker with 10 threads, worker can run just one another task.

Upvotes: 0

Views: 416

Answers (1)

Olexander Yermakov
Olexander Yermakov

Reputation: 397

Worker will reserve tasks for each worker's tread. If you want to limit the number of tasks worker can execute the same time, you should configure your concurrency (e.g. to limit 1 task at the time, you need worker with 1 process -c 1).

You can also check prefetch configuration, but it only defines the number of tasks reserved for each process of the worker.

Here is Celery documentation where prefetch configuration explained: http://celery.readthedocs.org/en/latest/userguide/optimizing.html

Upvotes: 1

Related Questions