CODEWITHSUNDEEP
hdfshadoop-yarnhadoop2
不好笑
不好笑

Reputation: 105

Yarn UI shows no active node while it appeared in HDFS UI

I've setup Hadoop in my laptop, and when I submit a job on Hadoop (though MapReduce and Tez), the status always ACCEPTED, but the progress always stuck at 0% and description wrote something like "waiting for AM container to be allocated".

When I check the node through YARN UI(localhost:8088), it shows that the active node is 0

enter image description here

But from HDFS UI(localhost:50070), it shows that there are one live node.

enter image description here

Is that the main reason that cause the job stuck since there are no available node? If that's the case, what should I do?

Upvotes: 1

Views: 2650

Answers (2)

Shawn
Shawn

Reputation: 61

First thing you should do is check if NodeManager is up and running. If not, then there'll be no active node showing up in Resourcemanager UI.

So, in terminal, run:

jps

If you don't see NodeManager listed in the result, then run:

yarn --daemon start nodenamager

Upvotes: 0

tk421
tk421

Reputation: 5967

In your YARN UI, it shows you have zero vcores and zero memory so there is no way for any job to ever run since you lack computing resources. The datanode is only for storage (HDFS in this case) and does not matter as far as why your application is stuck.

To fix your problem, you need to update your yarn-site.xml and provide settings for the memory and vcore properties described in the following:

http://blog.cloudera.com/blog/2015/10/untangling-apache-hadoop-yarn-part-2/

You might consider using a Cloudera QuickStart VM or Hortonworks Sandbox (at least as a reference for configuration values for the yarn-site.xml).

https://www.cloudera.com/downloads/quickstart_vms/5-10.html https://hortonworks.com/products/sandbox/

Upvotes: 1

Related Questions