CODEWITHSUNDEEP
google-bigquery
Funmi
Funmi

Reputation: 38

Export BigQuery Job API response for analysis

Is there an existing service that enables export of the Job GET Endpoint response into Biquery for analysis?

We already export and analyze BigQuery Audit Logs in BQ, but those logs don't include the query plan & other important metrics

Upvotes: 0

Views: 53

Answers (2)

yan-hic
yan-hic

Reputation: 1544

Until query plan stats are logged in Stackdriver (and exported to Bigquery), consider creating your own endpoint !

If your bq jobs complete within 9 min, you can write a simple Cloud Function that runs the input job config and streams the job log to SD or BQ directly.

Look at the Google Cloud Client library for the language of your choice.

Upvotes: 1

F10
F10

Reputation: 2883

No, there's no service that can do this, you could fill a feature request for the BigQuery engineering team to consider having this functionality.

Upvotes: 1

Related Questions