CODEWITHSUNDEEP
google-bigqueryexecution-timetableau-api
Vishal Gupta
Vishal Gupta

Reputation: 326

Increase Tableau online Query execution time

Is there any way to change query execution time on tableau online. I have to extract 100 M records from Google Bigquery which will take around 3 hr on tableau online but my process stops after 2 hrs with error com.tableausoftware.nativeapi.dll.TableauCancelException: Operation canceled

which is query execution time limit

Upvotes: 1

Views: 1590

Answers (1)

Sam M
Sam M

Reputation: 4166

My #1 suggestion is to make sure your BigQuery tables and queries are optimized as much as possible. Your question doesn't give details on your schema design, query, or indexing, but that is the first place to start. Look at the query plan and timeline to get an idea of where the bottlenecks are in the query execution.

My #2 suggestion is to look at what aggregations your visualizations are doing and see if you can offload that aggregation to the database instead. That will reduce the amount of data needed in your extract file.

Tableau has an excellent Knowledge Base article on this topic, found at https://kb.tableau.com/articles/issue/error-operation-cancelled-query-time-resource-limit-7200-refreshing-tableau-online-extract. Much of my answer below is copy/pasted from the KB article.

Here are some options that the KB article gives. Options 3 is easy to do and can make a noticeable difference. Option 2 may be easy to implement, depending on your schema design.

Option 1 Use live connections instead of extracts. See Keep Data Fresh for identifying which cloud-based data sources are capable of connecting live on Tableau Online.

Option 2 Use incremental extracts.

Option 3 Decrease the size of the data extract. Do this by hiding unused columns and adding filtering to the extract.

Option 4 Refresh the published extract using Tableau Bridge, the Command Line Utility, or manually using Tableau Desktop.

Option 5 Try scheduling extract refreshes at different times of day, or at night.

Upvotes: 1

Related Questions