CODEWITHSUNDEEP
node.jsamazon-web-servicesamazon-s3amazon-snsamazon-ses
AstroBoogie
AstroBoogie

Reputation: 498

Is it possible to an SNS Topic indefinitely?

I'm interested in publishing SES analytics data to SNS and publishing the SNS topic to somewhere (S3?) to store the data permanently.

Our control flow is as follows:

  1. Create SES config set
  2. Create SNS topic
  3. Set config set destination to SNS topic
  4. publish topic to s3?

The SNS subscribe() function says after confirming the subscription, it will last for 3 days. I'd like to make it last indefinitely so we can gather email analytics longer than 3 days.

If this is a reasonable approach, how would someone remove that expiration?

If this is the wrong approach, how should I approach storing SES analytics data permanently?

Thank you!

Upvotes: 0

Views: 287

Answers (1)

Kannaiyan
Kannaiyan

Reputation: 13055

Going through SNS is too much round trip.

SES (Events) --> Firehose --> (S3 / Redshift / Elastisearch)

You can configure SES to send analytics data to Kinesis Firehose. You can configure Kinesis Firehose to deliver to S3 or Redshift or Elastisearch, depending upon your needs.

SES Events to Firehose:

http://docs.aws.amazon.com/ses/latest/DeveloperGuide/event-publishing-retrieving-firehose-contents.html

Event Data Transformation with Lambda:

With an intermediate Data transformation with Lambda you can manipulate the data before sending it to the desired destination.

http://docs.aws.amazon.com/firehose/latest/dev/data-transformation.html

Hope it helps.

Upvotes: 1

Related Questions