Reputation: 55
Parsing a very long JSON file in NodeJS
I'm using a Nuxt App that has it's own Express based API, it looks to be working fine, but I'm scared of overusing someone else's services.
And I found a JSON that has everything I need to deliver before-hand.
The problem is, that it is 4MB long, and I don't think it would be a very efficient progress to retrieve and add data from it.
If I want to efficiently parse a huge JSON, and use it for the server (As in, to serve parts of it according to the requests I receive).
How would you go around it? Any ideas?
Upvotes: 0
Views: 173
Answers (1)
Reputation: 2133
Is only 4MB, you should just load it to memory, any other thing you want to do probably is overkill, literally, fs.readFile, then JSON.parse, that's it, in memory.
Trying to come up with a more sophisticated and "efficient" way on this context is probably not worth the trouble and maybe is just not posible, if you end up using another service just to store and manage those 4mb of data, the IO needed for that is orders of magnitude more than just keeping it on ram.
Upvotes: 1
Related Questions
- Parse large JSON file in Nodejs
- Parse large JSON file in Nodejs and handle each object independently
- Extract and Parse Huge incomplete JSON in NodeJS
- How do I read a Huge Json file into a single object using NodeJS?
- How to parse through large JSONL data Node js
- How to read large json file in node js?
- Nodejs unable to TCP/Parse long JSON file
- How to figure out the structure of a large JSON file with Node?
- Node.js parsing through a large(3000+ lines) of JSON data
- NodeJS: Very large JSON from remote resource parsing