CODEWITHSUNDEEP
hadoopmapreduce
Mark Roddy
Mark Roddy

Reputation: 27936

Programmatically Find Failed TaskAttempts for a running Hadoop Job

If I go into the task tracker and look at a running job I can easily see running/completed/failed/killed task attempts, and drill into more information about each them.

I'd like to be able to access this information programatically as well, but the JobClient class doesn't seem to have any methods to access this information directly. The TaskReport class returned by the JobClient.getMapTaskReports() and JobClient.getReduceTaskReports() functions seem the closest thing, but this only seems to have information about running or completed task attempts. Is there a way to access information about all task attempts for a given task?

Upvotes: 1

Views: 289

Answers (1)

Amar
Amar

Reputation: 12010

There might be a better way, but this is what I can think of:

Get the list of TaskAttemptID using following method of RunningJob:

 TaskCompletionEvent[] getTaskCompletionEvents(int startFrom)

And then, get each tasks status from following method of TaskCompletionEvent: 

TaskCompletionEvent.Status getTaskStatus()

Upvotes: 1

Related Questions