CODEWITHSUNDEEP
amazon-redshift
user1801395
user1801395

Reputation: 1

Redshift Workload Managment: Memory

I want to setup Redshift Workload Management to handle

I'm wondering what happens to un-allocated memory as my ETL only runs at night?

What happens to the 50% memory my ETL queue is allocated for in the day time when that queue is idle?

I read the Redshift documentation and it only says

Any unallocated memory is managed by Amazon Redshift

and is not descriptive.

Upvotes: 0

Views: 959

Answers (1)

John Rotenstein
John Rotenstein

Reputation: 269370

Workload Management (WLM) is a way of dividing available memory amongst queues.

If you allocate 50% to the ETL queue and you are not running any ETL jobs, then you have wasted 50% of the cluster's memory for that period of time.

A better approach might be to create separate queues based upon the workload. For example:

  • One queue for small, quick queries (eg used on real-time Dashboards)
  • Another queue for larger queries

Amazon Redshift is getting 'smarter' at figuring out how to prioritize queries but you can certainly tweak it with thoughtful use of WLM.

Upvotes: 1

Related Questions