Reputation: 19873
I need to interact with slurm on a cluster through python. Specifically, I need to submit a bunch of jobs, check which ones succeeded, resubmit those that failed, collect the results, etc. In R, there is a package called BatchJobs
which provides this functionality. What is the equivalent in Python?
I saw PySlurm around but it looks like that is still under development and wouldn't have all the functionality that I need.
Upvotes: 1
Views: 277
Reputation: 59330
One tool fitting this requirement is gc3pie. You might also find fireworks interesting although it is a full-fledge workflow system.
Upvotes: 1