Hi
I wanted to know your thoughts on the same. Recently I was going through the open source map reduce framework called Hadoop. I currently have a standalone
java application. The target users of this app would invoke providing input details by some front end mechanism which our client will develop. Our part was to just develop the java app.
Our java app basically does some mathematical calculations after interacting with the database using an OR mapping framework called Hibernate.
Now there is a new requirement that our application will have another invocation mechanism (batch jobs). There will be a file which will have 1000 or more invocations and we have to execute the above mentioned application that many number of times. If I go by the current batch process it will call the application in a sequential order.
Recently i read about map-reduce style open source implementation called Hadoop. Which basically divides the tasks into some pre-defined size and then spawns
thread to execute the divided number of tasks.
Do you think map reduce style of execution can expedite the batch process job. First I would like to know if map reduce is a feasible solution for this sort of problem.
Mohit