CODEWITHSUNDEEP
hadooploggingmapreducesandboxhortonworks-data-platform
Manikandan Kannan
Manikandan Kannan

Reputation: 9014

HDP 2.3 sandbox mapreduce log

I have System.out.printlns in my mapreduce program; The MR ran successfully, but i am not able to see the logs anywhere. I tried with "yarn log -applicationId ...", but i still don't get to see my logs.

Is there any special setting required to enable the logs? If not, what is the log file location?

Upvotes: 1

Views: 923

Answers (3)

S.K.Mathew
S.K.Mathew

Reputation: 31

Port 8088 shows all the MR jobs on the cluster. Click on the MR job and click on tracking history.

Upvotes: 3

Clyde D'Cruz
Clyde D'Cruz

Reputation: 2065

If you have configured log aggregation, then you will find your logs in /tmp/logs on HDFS . This hdfs directory is set using the property yarn.nodemanager.remote-app-log-dir (the default is /tmp/logs) .

Hence you should be able to see the users's application log directories on the namenode using the command:

hdfs dfs -ls /tmp/logs

Upvotes: 1

Durga Viswanath Gadiraju
Durga Viswanath Gadiraju

Reputation: 3956

When you run the job in first few lines, it will provide you a link to track the job. You can paste that link in a browser and navigate through task level logs to see the details.

Having System.out.println in map reduce is not good practice.

Upvotes: 0

Related Questions