Reputation: 1760
We are using Azure Databricks to spin up multiple Job clusters during our Production runs, and we need to run more scripts at the same time; however, the organization has defined Quota limits for each Family of Computes, and we have thresholds we do want to cross.
We can check the current status of the Quota through the Azure Portal > Quotas > Computes. However, it only shows the current Quota status and there is no option to check the logs of historic quota utilization.
After a given run, we want to check the Quota usage during the run, and map Quota usage peaks with script runtimes. Right now, we have to keep checking the Quota Page manually continuously and log it manually somewhere like an excel to get a rough idea.
Is there a better way to log and query the Quota Usage history?
Upvotes: 1
Views: 643
Reputation: 193
You might looking for getting VM usage quota which you can get for example from Get-AzVMUsage
It provides you list of current usage for different compute families:
Upvotes: 1