CODEWITHSUNDEEP
pythonweb-servicesmultiprocessing
ballade4op52
ballade4op52

Reputation: 2267

Are there any web applications with user-driven multiprocessing tasks?

I have a long-running python script that needs to be executed by an arbitrary number of users for an arbitrary number of files. Multiprocessing and scalability are essential. 

Based on a post regarding the multiprocessing module, it appears that a user reloading or resubmitting may be a problem as well as the server dropping tasks that run too long.

Is a desktop interface the best option, or are there any examples of a similar web application?

Upvotes: 1

Views: 80

Answers (1)

ballade4op52
ballade4op52

Reputation: 2267

Web2py's scheduler may be a solution for up to about 50 concurrent processes. For more processes, state-of-the-art async processing (e.g., Celery) should be necessary.

Upvotes: 1

Related Questions