Reputation: 318
From time to time we getting error from google while working with BigQuery API
File "../.venv/lib/python3.4/site-packages/google/cloud/bigquery/dataset.py", line 452, in exists query_params={'fields': 'id'})
File "../.venv/lib/python3.4/site-packages/google/cloud/_http.py", line 293, in api_request raise exceptions.from_http_response(response) google.cloud.exceptions.ServiceUnavailable: 503 GET https://www.googleapis.com/bigquery/v2/projects//datasets/?fields=id: Error encountered during execution. Retrying may solve the problem.
Caused by python code
destination_dataset.exists()
Our system:
Last time this error has occurred:
Any ideas why it happening and how we can avoid this error?
Upvotes: 0
Views: 1285
Reputation: 1516
Adding here documentation links, to the excellent comment by Graham Polley. You may read "Truncated Exponential Backoff" and the "Exponential Backoff" sub-chapter of the "Loading Data into BigQuery from a Local Data Source" documentation page.
Upvotes: 0