CODEWITHSUNDEEP
hadoophdfshadoop-yarnhadoop2
Hafiz Muhammad Shafiq
Hafiz Muhammad Shafiq

Reputation: 8670

Configure Yarn with Hadoop 2.7.4 resources issue

I have configured hadoop 2.7.4 by following this tutorial. DataNode, NameNode and SecondaryNameNode are working properly.

But when I run yarn, NodeManager goes down with the following message

org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed, Message from ResourceManager: NodeManager from localhost doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the NodeManager.

My system has 8 cpu with 8 GB RAM. How to configure yarn with these resources? I have found a lot such as this but could not find any solution that solve my problem.

Upvotes: 4

Views: 409

Answers (1)

RubioRic
RubioRic

Reputation: 2468

I had the same problem during a course. We were using Amazon virtual machines with 2 cores.

After various modifications in yarn-site.xml, we got our NodeManager running setting the following properties

<property>
    <name>yarn.nodemanager.resource.memory-mb</name>
    <value>4096</value>
</property>

<property>
    <name>yarn.nodemanager.resource.cpu-vcores</name>
    <value>2</value>
</property>

In your case, you may need to establish 8 virtual cores.

Upvotes: 1

Related Questions