CODEWITHSUNDEEP
node.jsmongodbmongodb-query
Andrea Limoli
Andrea Limoli

Reputation: 155

How manage big data in MongoDb collections

I have a collection called data which is the destination of all the documents sent from many devices each n seconds.

What is the best practice to keep the collection alive in production without documents overflow?

How could I "clean" the collection and save the content in another one? Is it the correct way?

Thank you in advance.

Upvotes: 1

Views: 1234

Answers (2)

Alan Mroczek
Alan Mroczek

Reputation: 1199

You cannot overflow, if you use sharding you have almost unlimited space.

https://docs.mongodb.com/manual/reference/limits/#Sharding-Existing-Collection-Data-Size

Those are limits for single shard, and you have to start sharding before reaching them.

It depends on your architecture, however limit (in worst case) of 8.19200 exabytes (or 8,192,000 terabytes) is unreachable for most of even big data apps, if you multiply number of shard possible in replica set by max collection size in one of them.

See also:

What is the max size of collection in mongodb

Upvotes: 1

Rohit Kumar
Rohit Kumar

Reputation: 446

Mongodb is a best database for storing large collection. You can do below steps for better performance.

  • Replication

Replication means copying your data several times on a single server or multiple server. It provides a backup of your data every time when you insert data in your db.

Embedded document

Try to make your collection with refreences. It means that try to make refrences in your db.

Upvotes: 1

Related Questions