CODEWITHSUNDEEP
google-bigquerygoogle-cloud-storage
Graham Polley
Graham Polley

Reputation: 14791

BigQuery failed load job - was unable to access a GCS file

We encountered an error in one of our scheduled load jobs for BigQuery yesterday. We've never seen this error before. In addition, re-running the job soon afterwards (without any changes) worked fine. Thus, cannot reproduce.

We're loading the files in from GCS. Here's the error that BigQuery/GCS came back with:

Access Denied: Google Storage File [file name removed]: Access Denied

Just that one file out of ~50 source uri's was not accessible. The job id of failed job:

job_TFuRwMrEWVAMD-PNuc29Yx_PXkk

The job id of the re-run job later in the day which worked fine again (no changes made):

job_Pt9usLRO9elxIBlmuOwCGB-drxI

Anyone have an idea why this happened?

Upvotes: 0

Views: 992

Answers (1)

Jordan Tigani
Jordan Tigani

Reputation: 26637

I looked up the job logs in the BigQuery import workers... from what I can tell when we tried to get the file size of one of Cloud Storage files we hit an ACCESS_DENIED error. Are you certain that the ACL did not change before the second job was run? It may have been a temporary glitch in Cloud Storage.

Upvotes: 1

Related Questions