This week's giveaway is in the Spring forum.
We're giving away four copies of REST with Spring (video course) and have Eugen Paraschiv on-line!
See this thread for details.
The moose likes Hadoop and the fly likes Hadoop work for Small database of about 1-2 GB Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of REST with Spring (video course) this week in the Spring forum!
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Hadoop work for Small database of about 1-2 GB" Watch "Hadoop work for Small database of about 1-2 GB" New topic

Hadoop work for Small database of about 1-2 GB

Vishal Baid
Ranch Hand

Joined: Jul 18, 2012
Posts: 42
Hi Guys !
I am new In Hadoop. But I heard lot abut hadoop.
My Manager want is to use in a project. So I check Hadoop and I find very interesting.

But I want to know that Will Hadoop work for Small database of about 1-2 GB.

Right know we all are using MYSql Database.

Will hadoop work for us ?
Please Reply. Thanks in advance.
Hussein Baghdadi
clojure forum advocate

Joined: Nov 08, 2003
Posts: 3479

It will works but 1~2 GB is really a small amount of data.
Hadoop shines when the dataset it -really, really- big.
Check your requirements and write a prototype to see whether Hadoop is going to be helpful or not.
You might find that a hand-crafted solution is more vital (and less memory-stresser) than Hadoop.
chris webster

Joined: Mar 01, 2009
Posts: 2254

You can certainly run Hadoop with small amounts of data on a single machine e.g. to explore how it works. But Hadoop and map-reduce in general are really designed for "big data" problems that are suitable for this kind of parallel batch processing across lots of machines e.g. bit ETL processes,or analysing huge amounts of data, etc. In your example, 2GB is not "Big Data" - 2GB will fit in RAM on most laptops these days, and you could store more data than that on your phone! - so as Hussein says, a normal database might be a better solution. Also, you need to think about what you want to do with your data, as map-reduce might not be particularly relevant for your needs if you are doing lots of OLTP or serving data to busy websites, for example.

No more Blub for me, thank you, Vicar.
I agree. Here's the link:
subject: Hadoop work for Small database of about 1-2 GB
It's not a secret anymore!