CODEWITHSUNDEEP
submitslurmlauncherfb-hydra
Andrea Gobbi
Andrea Gobbi

Reputation: 41

Slurm Job Array and quotas

I'm using hydra to launch parallel jobs on a slurm cluster. I can set the maximum number or running jobs using the keyword: array_parallelism = 3. Supposing I want to submit 20 jobs, hydra will create a .sh file with the option --array=0-19%3 as mentioned in the slurm repository (https://slurm.schedmd.com/job_array.html).

The policy of our cluster is that a user can not have more than 10 jobs counting both the running and pending jobs. Using squeue I see that this command spawns 20 jobs but only 3 (at maximum) are effectively running. This is correct in the sense that I can control the number of running jobs but not the number of queued jobs.

I would like to know if there is a combination of slurm arguments for having at maximum 10 jobs (pending or running) avoiding to break the rules but still use the power of the job array.

Upvotes: 0

Views: 95

Answers (0)

Related Questions