Mule ESB Large File Handling

Question

I have some scenario where I need to handle very large file like with file size as 20 GB or more. How I can handle these file in Anypoint Studio. Any suggestion will be helpful.

Answer 1

When it comes to large files, use Batch in Mule is the best option. This component handles large file and processes them faster.
Please find the details in below URLs:

• Error handling in Mule Salesforce Batch - Stack Overflow

Edit: Removed the old URL as it is not exist anymore.

• In Mule4 Use this link for batch component reference https://docs.mulesoft.com/mule-runtime/4.4/batch-processing-concept#:~:text=The%20components%20are%20the%20Batch,data%20sets%20while%20providing%20reliability.

Answer 2

Your best bet is to use Batch to read such big file. but if you can't then as as it is a file stream don't load the complete file in mememory, work with the file stream reader.