How to pass buffer/binary file to Bull Queue in NestJS/Node?

Question

I want to pass buffer of a file uploaded (which can be large - 100MB) which i input as form data to Bull Queue, but bull Queue doesnt accept binary or buffer.

How can I pass it?

I can change multer destination to /tmp and try to read from that location in Bull Queue Task Processor, but /tmp files might be deleted before processing

Answer 1

You can encode the buffer to base64 and decode it back to buffer in your service etc. (This is only recommended if your buffers are small). Large files should be stored in persistent storages like S3.

Check this issue for more