CODEWITHSUNDEEP
hadoop
Anonymous
Anonymous

Reputation: 193

What is Physical memory in hadoop cluster?

What is physical memory in Hadoop cluster? Is it the total ram size in the all the nodes?

Upvotes: 1

Views: 637

Answers (1)

Ajay Kharade
Ajay Kharade

Reputation: 1525

The physical memory on Hadoop cluster is nothing but shared part of RAM of each data node form total cluster memory. Its not total RAM size in all node, as some part of RAM of data node is reserved for OS and other applications.

The total available RAM for YARN and MapReduce should take into account the Reserved Memory. Reserved memory is the RAM needed by system processes and other Hadoop processes (such as HBase):

reserved memory = stack memory reserve + HBase memory reserve (if HBase is on the same node)

enter image description here

Upvotes: 2

Related Questions