CODEWITHSUNDEEP
mysqldatabasepostgresqloracle-sqldevelopertableau-api
fzhurd
fzhurd

Reputation: 169

How to handle very large data with Tableau

All,

I am using Tableau 9.0 to do data analysis. My data set is very large containing 100 billion records.

I want to use filter to filter out the data firstly. But, when I try to add filter on the specific column of the data in Tableau, it keep running... for ever. The reason is tableau wants to display all this field value to me with ascending order, then allow me to make selection. e.g to select only one or two value to filter...

But it keeps running due to 100 billion records. How to solve this problem? Could I switch off this function (display all specific field value..)? How to filter so large data sets?

Thank you in advance

Upvotes: 2

Views: 10255

Answers (3)

girish
girish

Reputation: 56

you can improve your performance by considering the following tips-

Use custom sql query in tableau to filter the data source to get the smaller working data.(data filtered at backend will be added advantage)

Hide unwanted fields from the data source pane.

Publish your data set to tableau server and then connect the tde server extract to tableau.

Upvotes: 1

Bernardo
Bernardo

Reputation: 3348

I don't feel Tableau is the right tool for such a large data set. But check out this article on performance.
http://kb.tableau.com/articles/knowledgebase/database-query-performance

Upvotes: -1

Alex Blakemore
Alex Blakemore

Reputation: 11921

Pause Auto-Updates via the toolbar pause button before dragging a field to the filter shelf (or doing anything that you don't want to trigger a query refresh). Then either hit refresh or turn auto-updates back on when you want to run a query.

For discrete dimension filter, you can enter custom value lists to avoid querying to fill a list of items in the filter dialog.

Upvotes: 3

Related Questions