CODEWITHSUNDEEP
google-cloud-platform
Matt Durrant
Matt Durrant

Reputation: 45

Autoscaling instance groups used for HTCondor batch workloads?

I've set up an HTCondor cluster using google cloud, following this tutorial.

I like it other than the autoscaling feature. I want something simpler than a target cpu utilization average across all instances in the group. I'd like to just delete a machine if HTCondor has no use for it, once there are not enough jobs to use all of the available clusters.

I could try using instances that delete themselves after a certain amount of time without any use. But then the autoscaler would just spin up another machine. I'd need to change automatically delete the machine and lower the maximum number of replicas.

Any ideas for how to do this?

Upvotes: 0

Views: 113

Answers (1)

Sergiusz
Sergiusz

Reputation: 1245

Tutorial you linked sets instance group to have 2 instance at all times. I assume you already adjusted that. You can edit autoscaling behavior of your HTCondor instance group by entering Compute Engine → Instance groups → HTCondor group name → Edit group and pressing pencil under Autoscaling policy

Example metric: autoscaling

More information about autoscaling an instance group can be found here.

Upvotes: 1

Related Questions