CODEWITHSUNDEEP
google-app-enginegoogle-bigquerygoogle-cloud-platformbigdata
Sarit Sotangkur
Sarit Sotangkur

Reputation: 21

Monitoring: Quota exceeded: Your table exceeded quota for imports or query appends per table

We're getting this error periodically despite what I believe to be usage well under the 1000 batch daily updates per table.

My problem is that there's no way to inspect what Google believes the current usage is for a particular table. This makes it impossible to isolate the underlying process that is responsible for the majority of the quota usage.

How can we view/inspect the current usage levels for this quota?

Upvotes: 1

Views: 600

Answers (1)

Pentium10
Pentium10

Reputation: 208042

I would start by enabling audit logs and inspecting the logs.

Audit logs are available via Google Cloud Logging, where they can be immediately filtered to provide insights on specific jobs or queries, or exported to Google Cloud Pub/Sub, Google Cloud Storage, or BigQuery.

To analyze your aggregated BigQuery usage using SQL, set up export of audit logs back to BigQuery. For more information about setting up exports from Cloud Logging, see Overview of Logs Export in the Cloud Logging documentation.

Analyzing Audit Logs Using BigQuery: https://cloud.google.com/bigquery/audit-logs

Upvotes: 2

Related Questions