CODEWITHSUNDEEP
serializationhadoopmapreducebinaryfilesbinary-data
Arsen Zahray
Arsen Zahray

Reputation: 25297

What is the best way of reading/writing binary input/output files with MapReduce?

In all samples I've seen so far, mapreduce apps take text files as input and write text as output.

I'd like my app to read objects from the binary file and write objects back to output file.

What is the best way to do that in MapReduce?

I'm writing the app in java

Upvotes: 2

Views: 1650

Answers (1)

Praveen Sripati
Praveen Sripati

Reputation: 33495

SequenceFile provides a persistent data structure for binary key-value pairs. You can find more information in the below URL.

http://wiki.apache.org/hadoop/SequenceFile

http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/io/SequenceFile.html

Upvotes: 1

Related Questions