Continuously write to S3 file

Question

I want to store user action logs continuously to s3 file for that session.

Requirements:

1. for a session single file
2. continuous write operations to s3
3. should be able to download that file at the end of the session.

Dont want to create new file for single session, want to update same file. Please suggest only AWS solutions.

Do i need to create stream and use it with s3 or using mediator storage system and push once in while.

Answer 1

Objects in Amazon S3 are immutable -- they cannot be modified after they are created.

From your description, a good solution would be to use Amazon Kinesis Data Firehose. Your app can stream data to the Firehose and it will combine data together based on size or time. A long session might therefore produce multiple output files, so you would need a separate process that combines those files together into a single file.