CODEWITHSUNDEEP
javaamazon-web-servicesamazon-s3
Pavel Vyazankin
Pavel Vyazankin

Reputation: 1580

Amazon S3 Java SDK multiple files upload

What I need is to download many files from Internet and upload them to S3 as fast as it possible. For now I open every file as a stream and upload them one after another. The average speed of this approach is one picture per second. What's the fastest way to achieve this?

Upvotes: 6

Views: 11693

Answers (1)

Julio Faerman
Julio Faerman

Reputation: 13501

Split in parts and upload in parallel would be a good start, the TransferManager class can help with that. Also, the article "Pushing the Limits of S3 Upload Performance" has some nice ideas on the subject.

Upvotes: 7

Related Questions