CODEWITHSUNDEEP
google-cloud-platformgoogle-bigquery
Omar Shabab
Omar Shabab

Reputation: 521

Schedule BigQuery backfill programmatically

I need to schedule the backfill in transfer service for at least a few 100 times for several data sources.

The REST API is deprecated and the python client is not helping either.

How can I automate this?

Upvotes: 0

Views: 932

Answers (1)

Kevin Quinzel
Kevin Quinzel

Reputation: 1428

@Yun Zhang is right. I will elaborate more on this.

The deprecated method required you to setup transfers in a specific schedule. The creation of regular ones was different and used another endpoint.

Now, by using the ScheduledOptions argument, we can set times for the transfers to start. We are able to now schedule (or not) the transfers. This is why using that endpoint is the right path.

Hope this is helpful! :)

Upvotes: 1

Related Questions