CODEWITHSUNDEEP
hadoopmapreduce
Lijju Mathew
Lijju Mathew

Reputation: 2091

File sizes for Map Reduce Programming and QA Testing of the code

  1. What is the size of files(and no of records) generally fed to map reduce programs in real time production systems ?

  2. How do we test the code say unit testing and QA testing? Is it with few records ?

Upvotes: 0

Views: 37

Answers (1)

Rishav Rohit
Rishav Rohit

Reputation: 114

  1. In my experience we used hadoop to process daily loads of at least 100GB (in terms of records around 1billion with over 1000 fields).
  2. For unit testing MR programs you can use few records or MRUnit.

Upvotes: 2

Related Questions