CODEWITHSUNDEEP
amazon-web-servicesamazon-redshift
Piyush Patil
Piyush Patil

Reputation: 14533

How to Automate Redshift Cluster Start/Stop for night time?

I have a AWS Redshift Cluster dc2.8xlarge and currently I am paying huge bill each month for running the cluster 24/7.

Is there a way I can automate the cluster uptime so that the cluster will be running in day time and I can stop the cluster at 8PM in evening and again start it in 8AM in morning.

Upvotes: 2

Views: 3299

Answers (4)

Rajesh A
Rajesh A

Reputation: 389

Good news:

Now, we are able to pause and resume the Redshift cluster (both Console and CLI)

Check out this link.

Upvotes: 3

John Rotenstein
John Rotenstein

Reputation: 269550

Update: Stop/Start is now available. See: Amazon Redshift launches pause and resume

Amazon Redshift does not have a Start/Stop concept. However, there are a few options...

You could resize the cluster so that it is a lower-cost. A Redshift Cluster is sized for Compute and for Storage. You could reduce the number of nodes as long as you retain enough nodes for your Storage needs.

Also, Amazon Redshift has introduced RA3 nodes with managed storage enabling independent compute and storage scaling, which means you might be able scale-down to a single node. (This is a new node type, I'm not sure of how it works.)

Another option is to take a Snapshot and Shutdown the cluster. This will result in no costs for the cluster (but the Snapshot will be charged). Then, create a new cluster from the Snapshot when you want the cluster again.

Scheduling the above can be done in Amazon CloudWatch Events, which can trigger an AWS Lambda function. Within the function, you can make the necessary API calls to the Amazon Redshift service.

If you are concerned with the general cost of your cluster, you might want to downside from the dc2.8xlarge. You could either use multiple dc2.large nodes, or even consider a move to ds2.xlarge, which is a lower cost per TB of data stored.

Upvotes: 3

kapilt
kapilt

Reputation: 284

its pretty easy to use opensource https://cloudcustodian.io to automate nightime/weekend off hours on redshift and other aws resources.

Upvotes: 0

abhijitcaps
abhijitcaps

Reputation: 594



Now we can pause and resume an AWS Redshift cluster.
We can also schedule the pause and the resume, which is a very important feature to check on the costs.

Link: https://aws.amazon.com/blogs/big-data/lower-your-costs-with-the-new-pause-and-resume-actions-on-amazon-redshift/

This will help you in automating the cluster uptime & downtime so that the cluster will be running in day time and is paused automatically at a specific time in the evening and again start in the morning automatically.

Upvotes: 0

Related Questions