*
The moose likes Hadoop and the fly likes Hadoop work for Small database of about 1-2 GB Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of OCM Java EE 6 Enterprise Architect Exam Guide this week in the OCMJEA forum!
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Hadoop work for Small database of about 1-2 GB" Watch "Hadoop work for Small database of about 1-2 GB" New topic
Author

Hadoop work for Small database of about 1-2 GB

Vishal Baid
Ranch Hand

Joined: Jul 18, 2012
Posts: 42
    
    1
Hi Guys !
I am new In Hadoop. But I heard lot abut hadoop.
My Manager want is to use in a project. So I check Hadoop and I find very interesting.

But I want to know that Will Hadoop work for Small database of about 1-2 GB.

Right know we all are using MYSql Database.

Will hadoop work for us ?
Please Reply. Thanks in advance.
Hussein Baghdadi
clojure forum advocate
Bartender

Joined: Nov 08, 2003
Posts: 3479

It will works but 1~2 GB is really a small amount of data.
Hadoop shines when the dataset it -really, really- big.
Check your requirements and write a prototype to see whether Hadoop is going to be helpful or not.
You might find that a hand-crafted solution is more vital (and less memory-stresser) than Hadoop.
chris webster
Bartender

Joined: Mar 01, 2009
Posts: 1671
    
  14

You can certainly run Hadoop with small amounts of data on a single machine e.g. to explore how it works. But Hadoop and map-reduce in general are really designed for "big data" problems that are suitable for this kind of parallel batch processing across lots of machines e.g. bit ETL processes,or analysing huge amounts of data, etc. In your example, 2GB is not "Big Data" - 2GB will fit in RAM on most laptops these days, and you could store more data than that on your phone! - so as Hussein says, a normal database might be a better solution. Also, you need to think about what you want to do with your data, as map-reduce might not be particularly relevant for your needs if you are doing lots of OLTP or serving data to busy websites, for example.

No more Blub for me, thank you, Vicar.
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Hadoop work for Small database of about 1-2 GB