CODEWITHSUNDEEP
c#.netamazon-s3
BrianK
BrianK

Reputation: 2705

Write Zip file to AWS as a stream

Using C#, I would like to create a zip file in AWS S3, add file entries to it, then close the stream. System.IO.Compression.ZipArchive can be created from a System.IO.Stream. Is it possible to get a writeable stream into an S3 bucket? I am using the .NET SDK FOR S3.

Upvotes: 2

Views: 3891

Answers (2)

AveryTheAvian
AveryTheAvian

Reputation: 112

You'll probably want to take a look at this answer here for an existing discussion around this.

This doc page seems to suggest that there is an Upload method can take a stream (with S3 taking care of re-assembling the multi-part upload). Although this is for version 1 so might not be available in version 3.

Upvotes: 1

Norm Johanson
Norm Johanson

Reputation: 3177

An object uploaded to S3 must have a known size when the request is made. Since the size of the zip file won't be known till the stream is closed you can't do what you are asking about. You would have to create the zip file locally then upload it to S3.

The closest you could get to what you are asking for is using S3's multi part upload. I would use a MemoryStream as the underlying stream for the ZipArchive and each time you add a file to the zip archive check to see if the MemoryStream is larger than 5 megabytes. If it is take the byte buffer from the MemoryStream and upload a new part to S3. Then clear the MemoryStream and continue adding files to the zip archive.

Upvotes: 2

Related Questions