Eyal Greif
Reputation: 11
Out of memory when using readStream on big files
I tried to download 50GB File from Google Cloud Platform to my local machine. I used GCP's getReadStream function, and I saw that the memory usage was increasing dramatically until the process crashed.
What is the best practice for using your readStream? Or is there any workaround for that problem?
Thanks!
Github issue for @google-cloud/storage NPM package: https://github.com/googleapis/nodejs-storage/issues/492
Upvotes: 1
Views: 239
Answers (0)
Related Questions
- Downloading large files using nodejs piped stream causes huge memory usage and OOM Error
- Node.js read big file with fs.readFileSync
- Node.js memory leak when reading and writing large files
- why does attempting to write a large file cause js heap to run out of memory
- Google Cloud Storage throwing error for multiple large file uploads concurrently
- Reading large files from cloud storage and writing to datastore
- Getting ESOCKETTIMEOUT, ECONNRESET or socket hang up with large file when streaming to GCP through file.createWriteStream()
- Streaming large files (2GB+) to Google Cloud Storage bucket by way of Node/Express server
- "JavaScript heap out of memory" while streaming large file
- Node.js is running out of memory on large bit-by-bit file read