CODEWITHSUNDEEP
node.jsamazon-web-servicesexpressaws-lambda
nera
nera

Reputation: 41

Handling time consuming operations using Nodejs and AWS

The current setup of the project I am working on is based on Nodejs/Express and AWS. AWS Lambda is triggered on a daily basis and is used to call an API endpoint which is expected to fire a varying number of emails via Sendgrid (hundreds to thousands). With a lower number of emails it worked fine but when the number of emails was around 1000 the Lambda timed out and the API crashed.

The limit on Lambda was 1 minute. Raising it up to 5 minutes might make this case of 1000 emails pass but might fail when the number is several thousands. Apart from that we would like to avoid keeping the server busy for several minutes because of which it was set to 1 minute initially.

We are now looking for better solutions to this specific situation. What would be a better approach, is it an option to use SNS Queue, or Serverless with moving all the code that sends the emails to Lambda?

Thanks for any inputs in advance and if more information is required please let me know.

Upvotes: 0

Views: 163

Answers (1)

RoberMP
RoberMP

Reputation: 1356

Lambdas are not designed for long running operations. You can use Elastic Beanstalk Workers https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/using-features-managing-env-tiers.html

Briefly, the lambda publish the task to an SQS queue and an elastic beanstalk app handles it.

Upvotes: 1

Related Questions