CODEWITHSUNDEEP
kubernetes
magladde
magladde

Reputation: 634

What is the maximum number of jobs that you can submit to a kubernetes cluster?

I have a Kubernetes cluster and I have tested submitting 1,000 jobs at a time and the cluster has no problem handling this. I am interested in submitting 50,000 to 100,000 jobs and was wondering if the cluster would be able to handle this?

Upvotes: 2

Views: 1816

Answers (1)

Wytrzymały Wiktor
Wytrzymały Wiktor

Reputation: 13878

Yes you can but only if only don't run out of resources or you don't exceed this criteria regarding building large clusters.

Usually you want to limit your jobs in some way in order to better handle memory and CPU or to adjust it in any other way according to your needs.

So the best practice in your case would be to:

  • set as many jobs as you want (bear in mind the building large clusters criteria)
  • observe the resource usage
  • if needed use for example Resource Quotas in order to limit resources used by the jobs

I hope you find this helpful.

Upvotes: 2

Related Questions