CODEWITHSUNDEEP
hadoop
Vengadanathan Srinivasan
Vengadanathan Srinivasan

Reputation: 381

Run a Hadoop job without output file

Is it possible to run a hadoop job without specifying output file ? When i try to run a hadoop job , no output file specified Exception is thrown . can any one please give any procedure to do so using Java.

I am writing the data processed by reduce to a non relational database so i no longer require it to write to HDFS.

Upvotes: 9

Views: 4009

Answers (1)

Donald Miner
Donald Miner

Reputation: 39893

Unfortunately, you can't really do this. Writing output is part of the framework. When you work outside of the framework, you basically have to just deal with the consequences.

You can use NullOutputFormat, which doesn't write any data to HDFS. I think it still creates the folder, though. You could always let Hadoop create the folder, then delete it.

Upvotes: 5

Related Questions