Jeff Yang
Reputation: 11
output of map task written to local file system?
If output of map task written to local file system, what will happened if the input of map tasks is so big that output exhausts the written disk?
Upvotes: 0
Views: 94
Answers (1)
Chris White
Reputation: 30089
The map task attempt will fail, and the task will be scheduled to run elsewhere. The cleanup for the failed attempt should remove the task files too.
Upvotes: 2
Related Questions
- Why Map tasks outputs are written to the local disk and not to HDFS?
- how to output to HDFS from mapper directly?
- How hadoop stores map output in local if data size is large?
- hadoop writing output to hdfs file
- Where Mapper output in Hadoop is saved?
- In Hadoop where does the framework save the output of the Map task in a normal Map-Reduce Application?
- Hadoop Mapredce Map output
- Output of reducer sent to HDFS where as map output is stored in data node local disk?
- Writing to local file during map phase in hadoop
- output of map task written to local file system or HDFS?