CODEWITHSUNDEEP
hadoopmapreducehadoop2
msciwoj
msciwoj

Reputation: 772

Where MapReduce History Server stores its data?

Based on the documentation: MapReduce History Server API, I can get all the information using different REST calls.

Does anyone know where that data is originally stored/read from by History Server? Also what format is that in?

Upvotes: 0

Views: 374

Answers (1)

Durga Viswanath Gadiraju
Durga Viswanath Gadiraju

Reputation: 3956

It stores the data in HDFS. It will be under /user/history/done and owned by mapred in Cloudera and Hortonworks distributions.

We can also provide custom locations using parameters mapreduce.jobhistory.done-dir and mapreduce.jobhistory.intermediate-done-dir.

Upvotes: 1

Related Questions