aspose file tools*
The moose likes Hadoop and the fly likes Algorithms not suited for mapreduce Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Algorithms not suited for mapreduce" Watch "Algorithms not suited for mapreduce" New topic
Author

Algorithms not suited for mapreduce

andre mantei
Greenhorn

Joined: Sep 12, 2013
Posts: 5
Hi there,

I would like to know a few algorithms that are not well suited for mapreduce and why they are not suited. I read, that svm is one of those algorithms but I don't know why.

Greetings, Andre
chris webster
Bartender

Joined: Mar 01, 2009
Posts: 1846
    
  16

Not sure about specific algorithms, but map-reduce is probably most useful when you can run the map tasks independently in parallel. But if each task depends on output from another task, then you can't run them in parallel. So it will depend on how far you can break your job up into these parallel tasks or successive map-reduce steps. But you could explore ways to use higher-level tools - Hive, Cascading etc - which might allow you to define your task at a higher level and let the tools work out how to map-reduce it.


No more Blub for me, thank you, Vicar.
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Algorithms not suited for mapreduce