Win a copy of Functional Reactive Programming this week in the Other Languages forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Why MapReduce algorithm is considered a "Google invention"?

 
Hussein Baghdadi
clojure forum advocate
Bartender
Posts: 3479
Clojure Mac Objective C
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hey,
Map and reduce functions are old, well know in Functional programming languages.
Why MapReduce algorithm is considered a "Google invention"?
Did they introduce anything new in it?
Thanks.
 
David Newton
Author
Rancher
Posts: 12617
IntelliJ IDE Ruby
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
It's not considered a Google invention. MapReduce (note no spaces and camel-casing), on the other hand, *is* a Google framework. The wikipedia article sums it up nicely.
 
David Newton
Author
Rancher
Posts: 12617
IntelliJ IDE Ruby
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I'm not sure I'm happy with my statement saying people don't consider it a google invention: clearly map and reduce have been around for a *long* time... But MapReduce really isn't just map and reduce concatenated.

The following paper might help you to understand:

http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.104.5859&rep=rep1&type=pdf
 
Chuck Lam
author
Greenhorn
Posts: 12
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
The word "invention" is a bit loaded so I'll sidestep it a little bit. Certainly the concept of map and reduce functions have been around for a long time, but MapReduce is a new framework for processing data sets in a scalable way. It's not just putting map and reduce function together.

Similarly you can argue that Google did not invent link analysis, but that misses the point. Their PageRank algorithm had applied link analysis in a scalable way to a new problem domain (Web) that it certainly stands on its own as a useful invention.
 
Tibi Kiss
Ranch Hand
Posts: 47
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Some developmental psychology researcher even 30 years ago were mentioned the fact that a kind of map and reduce (very similar to MapReduce) decomposition take place naturally while the human mind is thinking. (of course this is a short summary only). Therefore childrens learning to think in a more map-reduce way to solve problems, are getting much more creative.
If this is so, then my conclusion is that we have to expect a huge move forward to the success of MapReduce itself... because it's a natural approach to many problems.
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic