CODEWITHSUNDEEP
node.jsmongodbmongoosestream
Alberto Gimeno
Alberto Gimeno

Reputation: 45

How to stream data in a Node JS + Mongo DB REST API?

I am developing a Rest API in Node JS + Mongo DB, handled with Mongoose's middleware, in which one of the methods allows the recovery of contents asociated to a certain user.

So far I've been retrieving all of the user's content, but the amount of data is starting to grow, and now I need to stream the data somehow.

The behaviour I want to implement would be for the server to answer the request with a stream of 10-20 items, and then, if the client needs more data, it would need to send another request, which would be answered with the following 10-20 items.

All I can come up with would be to answer with those first 10-20 items, and then, in case the client needs more data, to provide a new (optional) parameter for my method, which would allow the client to send the last item's id, so the server can send back the following 10-20 items.

I know that this approach will work, but I feel like it's too raw; there's gotta be a cleaner way to implement this behaviour, since it's the kind of behaviour a lot of web applications must implement.

So, my question would be: Do you know of any better way to solve this problem?

Thanks in advance.

Upvotes: 0

Views: 322

Answers (1)

Brant
Brant

Reputation: 1788

Provide the ability to read an offset and a limit from the request, then do something like:

db.collection.find().skip(20).limit(10)

Also, set defaults on APIs you build so that someone can't request a million records at once. Maybe max results is always 200, and if the request doesn't have the above params set, return up to the first 200 results.

Upvotes: 1

Related Questions