user1261215
Reputation:
output of map task written to local file system or HDFS?
I read that the Hadoop Map tasks write their output to local disk.
Suppose if i have map only tasks without any reducers, still the map outputs will be written to local file system ?
Upvotes: 1
Views: 1233
Answers (1)
Ravi Kadaboina
Reputation: 8574
Yes, it will still write the output to the path set by FileOutputFormat.setOutputPath(JobConf, Path) and there will no sorting or partitioning.
UPDATE: As mentioned by Chris White, it will be written directly to HDFS and not the local file system.
Upvotes: 2
Related Questions
- When does a mapper store its output to its local hard disk?
- Why Map tasks outputs are written to the local disk and not to HDFS?
- how to output to HDFS from mapper directly?
- How hadoop stores map output in local if data size is large?
- Hadoop: Where the mapper output stored (local or HDFS) if no reducer job available?
- Where Mapper output in Hadoop is saved?
- In Hadoop where does the framework save the output of the Map task in a normal Map-Reduce Application?
- Output of reducer sent to HDFS where as map output is stored in data node local disk?
- Writing to local file during map phase in hadoop
- output of map task written to local file system?