CODEWITHSUNDEEP
amazon-web-servicesamazon-kinesis
John
John

Reputation: 17

Multi destinations for Kinesis stream at same time

Can we have multiple destinations from single Kinesis Streams? I am getting output in Splunk but now I also want to add an S3 bucket as the destination. If I add another Amazon Kinesis Data Firehose, will it affect the performance of Splunk reading? Splunk pulls directly from Kinesis. If I add another destination will it affect Will it affects our current read and writes?

Upvotes: 1

Views: 2568

Answers (1)

Chris Williams
Chris Williams

Reputation: 35188

One of the benefits of using Kinesis is that you can do exactly this behaviour.

Each consumer application becomes responsible for which events it has read from the shard. There is no concept of an entry being processed already between 2 seperate applications.

One recommendation from AWS to bare in mind for high throughput for multiple consumers is to use enhanced fanout.

Each consumer registered to use enhanced fan-out receives its own read throughput per shard, up to 2 MB/sec, independently of other consumers.

Upvotes: 1

Related Questions