CODEWITHSUNDEEP
hadoopclouderaimpala
Ujjwal Siddharth
Ujjwal Siddharth

Reputation: 25

What happens if an Impala query runs out of memory?

What happens if an Impala query runs out of memory:

  1. Does the Impala daemon crash?
  2. Does it write to the disk?

A detailed explanation would help!

Upvotes: 0

Views: 2048

Answers (1)

Matt
Matt

Reputation: 4334

It depends on the version of Impala and how it's configured.

In general, Impala will kill queries when they run out of memory. There is a process-wide memory limit at which point any query that requests memory will be killed. There is also another optional, per-query memory limit.

Impala 2.0 and later support "spilling" large join and aggregation operators which help avoid these out of memory conditions.

Upvotes: 3

Related Questions