Kareem Rashwan
Reputation: 57
Is there a way to change BigQuery's Data Transfer wait / idle time between Run Dates?
I am using BigQuery Data Transfer to transfer my Google Ads data to BQ, I see that it's recommended that I use the Refresh Window parameter, as google may update historical records, I have it set to fetch the previous 3 days worth of data.. Each Run Date takes around 3-4 minutes, however Data Transfer automatically waits for around 30 minutes between each Run Date and the other. Is there a way to reduce this wait time, or remove it.. as this brings my total job time from excepted 9 - 12 minutes to 1+ hours.
I haven't found any task configuration parameters to change or disable this wait time!
Upvotes: 0
Views: 92
Answers (0)
Related Questions
- How to fix data discrepancy in conversions from Google Ads into Google Bigquery via BigQuery Data Transfer Service for Google Ads
- BigQuery Google Ads Transfer - Duplicate data
- BigQuery - is there a way to find missing dates in a data sequence?
- Bigquery data transfers from S3 and efficiency of filtering data by last modification datetime
- Why does querying a report from google play console by the google cloud BigQuery API give incomplete results
- Does Google Analytics to BigQuery continuous refresh wait until the session is closed?
- youtube bigquery transfer backfill on the same table on the same date, I got different counts when I run it in June comparing with run in Sept
- Lag between 'Created Time' and 'Start Time' in GCS import job to BigQuery