LPD
LPD

Reputation: 2883

Mapper task completion event

We have a map reduce task set up on HBase. I have a requirement that I need to know once a mapper instantiated by the framework completes its task.

Is there any event that I have to look upon? Thanks.

Upvotes: 0

Views: 133

Answers (2)

SSaikia_JtheRocker
SSaikia_JtheRocker

Reputation: 5063

To add to Tariq's answer, you can actually override the setup() and cleanup() methods from the Mapper class. So, for each map task, the cleanup() method gets called once at the end. Please, do your final processing there.

Upvotes: 1

Tariq
Tariq

Reputation: 34184

You can dump that data inside the cleanup() method. cleanup() gets called for the mappers once they are done with everything so it should serve the purpose, IMHO.

Upvotes: 3

Related Questions