CODEWITHSUNDEEP
google-bigquerystoragetransfer
Srinivas Nallapati
Srinivas Nallapati

Reputation: 29

Not able to update Big query table with Transfer from a Storage file

I am not able to update a big query table from a storage file. I have latest data file and transfer runs successfully. But it say "8:36:01 AM Detected that no changes will be made to the destination table.". Tried multiple ways.
Please help. Thanks, -Srini

Upvotes: 1

Views: 1539

Answers (1)

lordofmax
lordofmax

Reputation: 793

You have to wait 1 hour after your file has been updated in Cloud Storage: https://cloud.google.com/bigquery-transfer/docs/cloud-storage-transfer?hl=en_US#minimum_intervals

I had the same error. I created two transfers from GCS to BigQuery, with write preference set to MIRROR and APPEND. I got the logs below (no error). The GCS file was uploaded less than one hour before.

  • MIRROR: Detected that no changes will be made to the destination table. Summary: succeeded 0 jobs, failed 0 jobs.
  • APPEND: None of the 1 new file(s) found matching "gs://mybucket/myfile" meet the requirement of being at least 60 minutes old. They will be loaded in next run. Summary: succeeded 0 jobs, failed 0 jobs.

Both jobs went through one hour later.

Upvotes: 3

Related Questions