CODEWITHSUNDEEP
amazon-s3amazon-kinesisamazon-kinesis-firehose
arjunj
arjunj

Reputation: 1516

Is there a way to specify file extension to the file saved to s3 by kinesis firehose

I am setting up a kinesis firehose stream and everything works well with the files getting created on s3 which are delimited. But i was wondering if there is a way to specify an extension to this file since the consumer of this file require it to be either a csv or txt. Is there any way of doing this?

Thanks

Upvotes: 10

Views: 2475

Answers (2)

Kannaiyan
Kannaiyan

Reputation: 13035

You can create an s3 trigger to lambda and rename from there.

Upvotes: 3

arjunj
arjunj

Reputation: 1516

I was not able to get an extension for the files generated by firehose but I ended up using data pipeline to do this by using the ShellCommandActivity component which allows one to run shell commands on the files in Amazon S3 and write the resulting files to either S3 or any other location that you'd like.

Upvotes: 1

Related Questions