CODEWITHSUNDEEP
amazon-web-servicesfile-uploadgoamazon-s3
Topo
Topo

Reputation: 5002

Upload big file to S3 without passing through server

I'm developing a web app that allows users to upload big files to the server and I'm using S3 to store those files. In order to be able to upload files of any size, I'm using s3manager.Uploader to simplify doing the multipart upload.

Because some of the files are going to be big (~15gb) I wanted to know if it's possible to do something like the presigned URLs, but for multipart uploads? I want to avoid having to upload the data to my server and then upload it to S3. Ideally I would want an URL where I can just direct a POST in a html form and avoid using my web server as a proxy for the files.

Upvotes: 1

Views: 1814

Answers (2)

Sreedhar
Sreedhar

Reputation: 1

The limit for each object to the store is 5TB, Here you can found the reference link

Upvotes: 0

Topo
Topo

Reputation: 5002

@michael-sqlbot was right. Just doing posts there's a limit of 5GB per file. You can do a multipart upload if you presign each request before uploading, which means you need to manage the splitting of the file and asking the server to sign each request before uploading.

I ended up following @fl0cke advice and using https://github.com/TTLabs/EvaporateJS to manage the upload. It does all the file managing and you just have to implement the server side function to sign the request for each file.

Upvotes: 1

Related Questions