Reputation: 21
Is MapReduce the reason for the instant search results produced by google or is it just used to index the massive web page data ? I mean is MApreduce at work behind every search query that I enter ? I was confused because to my understanding there is a latency associated with running Hadoop so it can not be the tool used the seach the indexed data for a query.
Upvotes: 2
Views: 486
Reputation: 13057
MapReduce was used by Google until 2010 to build the search index. Your search query is fired against that index which then returns quick responses. The issue with MapReduce was, that the update frequency was too low to keep up with the updates of the web. Since 2010 Google uses Caffeine, which is based on BigTable. See also here and here.
Upvotes: 2