Kobe-Wan Kenobi
Kobe-Wan Kenobi

Reputation: 3864

Ambari YARN container settings

I'm interested in CPU settings on Ambari, concretely, I see CPU options such as:

Percentage of physical CPU allocated for all containers on a node

Number of virtual cores

And per container:

Minimum Container Size (VCores)

Maximum Container Size (VCores)

I saw similar settings regarding the RAM and I was able to find some recommendations about it, but I found none for the case of CPU.

Concretely, I'm interested whether I should keep a number of VCores for the system (as in the case of memory), or should I use it all for containers? That is, should the Number of virtual cores be set to maximal value or not? And what to use as Percentage?

Upvotes: 0

Views: 643

Answers (1)

Adishesh Kishore
Adishesh Kishore

Reputation: 119

I would suggest that you keep a minimum of 2 cores per node for the operating system and a minimum of 2 gigs of memory for the same. The remaining you could safely utilise for your applications being launched on yarn. That being said, you can use it all but it might choke your system in case you run extremely cpu intensive jobs.

Upvotes: -1

Related Questions