CODEWITHSUNDEEP
hadoopmapreducejobsfreezehadoop-yarn
Kenny Basuki
Kenny Basuki

Reputation: 735

Why hadoop yarn mapreduce stuck or hanging on running job state?

I have a wordcount sample mapreduce job and I ran it with YARN mode. But why my mapreduce job stop and not continue while running job step? It's like this :

15/04/04 17:18:21 INFO impl.YarnClientImpl: Submitted application application_1428142358448_0002
15/04/04 17:18:21 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1428142358448_0002/
15/04/04 17:18:21 INFO mapreduce.Job: Running job: job_1428142358448_0002

I've try to tweak in yarn-site.xml and mapred-site.xml and nothing happend. That's still hang on that's state. It's about memory or about my wrong configuration.

I need your suggest all...Thanks

Upvotes: 2

Views: 7339

Answers (3)

Kazuhiro Kazuhiro
Kazuhiro Kazuhiro

Reputation: 11

You should check the content of yarn-site.xml In the file, if the value of yarn.node.manager.aux-service contains invalid characters such as '.' the job don't work.

<property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce.shuffle</value>
</property>

If the value contains such a character, you should replace the character '_',then the stacking job are working.

Upvotes: 1

Abhimanyu
Abhimanyu

Reputation: 1218

I faced the same situation. My wordcount program got stuck at Running Job: job_xxxxxxxxxx. What I did was I rebooted the system and gave it a try again and it worked. I was using ubuntu on oracle virtual box. Hope it helps

Upvotes: 2

221B
221B

Reputation: 851

Check the status of the job in your resource manager port. By default, 8088 is the port number where resource manager will be available. You should be able to see the status of the job and job history and etc.

Upvotes: 1

Related Questions