CODEWITHSUNDEEP
olapmondriansaiku
DEVANG PANDEY
DEVANG PANDEY

Reputation: 157

Saiku,Mondrian performance degrades with large amount of data

We are using mondrian olap schema with saiku to analyse our records.We are using star schema model.We have one fact table which contains around 3000000 records. We have four dimension tables timestamp,rank,path and domain. Timestamp is almost unique for each entry . Now after deploying schema in saiku when we are performing analysis saiku takes a lot of time to return results. It takes 10 minutes to fetch 3000 records and if number of records are more than 50000 saiku dies.Please suggest me on what should I do in order to boost performance of saiku and mondrian.

Upvotes: 0

Views: 2258

Answers (2)

Tomas Greif
Tomas Greif

Reputation: 22653

You can easily figure out if this is database issue or saiku/mondrian problem:

  1. Enable sql logging facility in saiku-server/tomcat/webapps/saiku/WEB-INF/classes/log4j.xml (uncomment section below Special Log File specifically for Mondrian SQL Statements text
  2. Restart server
  3. Do couple of typical analysis in Saiku
  4. Get used queries from log
  5. Analyze performance of queries directly in database (e.g. for PostgreSQL there is explain analyze command)

If performance of queries is as slow as in Saiku then you have identified your problem.

Btw. If you really have dimension for timestamp (by second?) than you should consider splitting it into two dimensions with days and seconds.

Upvotes: 2

Alex Chevelev
Alex Chevelev

Reputation: 91

It's hard to understand what is your particular problem.

Two things helped us when we struggle with saiku performance problems:

  • indices on all fields and sometimes their combinations that may be used as dimensions - helps like everywhere in DB

  • we avoided joines with other tables denormalizing our data

Upvotes: 0

Related Questions