This week's book giveaway is in the OCPJP forum.
We're giving away four copies of OCA/OCP Java SE 7 Programmer I & II Study Guide and have Kathy Sierra & Bert Bates on-line!
See this thread for details.
The moose likes Hadoop and the fly likes Algorithms not suited for mapreduce Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of OCA/OCP Java SE 7 Programmer I & II Study Guide this week in the OCPJP forum!
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Algorithms not suited for mapreduce" Watch "Algorithms not suited for mapreduce" New topic
Author

Algorithms not suited for mapreduce

andre mantei
Greenhorn

Joined: Sep 12, 2013
Posts: 5
Hi there,

I would like to know a few algorithms that are not well suited for mapreduce and why they are not suited. I read, that svm is one of those algorithms but I don't know why.

Greetings, Andre
chris webster
Bartender

Joined: Mar 01, 2009
Posts: 1790
    
  16

Not sure about specific algorithms, but map-reduce is probably most useful when you can run the map tasks independently in parallel. But if each task depends on output from another task, then you can't run them in parallel. So it will depend on how far you can break your job up into these parallel tasks or successive map-reduce steps. But you could explore ways to use higher-level tools - Hive, Cascading etc - which might allow you to define your task at a higher level and let the tools work out how to map-reduce it.


No more Blub for me, thank you, Vicar.
 
 
subject: Algorithms not suited for mapreduce