CODEWITHSUNDEEP
mongodbredisfeed
Wen
Wen

Reputation: 411

How to improve the performance of feed system using mongodb

I have a feed system using fan-out on write. I keep a list of feed ids in redis sorted set, and save the feed content in mongodb, so every time when i read 30 feeds, i have to do 30 query to mongodb, is there anyway to improve it ?

Upvotes: 1

Views: 599

Answers (1)

Vivek Bajpai
Vivek Bajpai

Reputation: 1615

Its depend upon your setup of database. MongoDb has a vast documentation about how to increase simultaneous read and write MongoDb conncurrency

  1. If you need so many writes in database with less latency starts using sharding Deployment Sharding.

  2. If you need to increase number of reads in data base deploy each shards as replica set and rout your read query in secondary node Read Prefences

  3. Also each query should covered by index Better indexing, you can check your query time by simply adding explain after a find it will show you the time and all facts 

    db.collection.find({a:"abcd"}).explain()

  4. Make sure you have enough ram so that your data set fits with ram atleast your index should fit inside the ram coz each time a data fetched from disk is 10 times slower than RAM.

  5. Check your sever status with running MongoStat it will measures your database performance , page fault , lock , query opertaion manny detail.

  6. Also measure your hardware performance with program like iostat and make sure io wait is low and less than 1%.

  7. Few good links to deployment of mongodb and performance tuning.

    1. Production deployment of mongodb

    2. Performance tuning of mongodb By 10gen

    3. Using redis before mongodb to cache query and result object

    4. Example of redis and mongo

Upvotes: 1

Related Questions