big data and Java

[Rakesh Kannan]

How java is going to be used in Big data Technologies.Please share if there is any real time examples

[Hussein Baghdadi]

What do you mean exactly?
Cassandra, HBase, Hadoop, Mahout, SenseiDB, Storm (and many others) are written in Java programming language.

[Rakesh Kannan]

Hi Hussein,

My question is what are the Java-based programming frameworks available, that supports the processing of large data sets in a distributed computing environment

Cheers,
Rakesh

[Sumit Bisht]

Rakesh, did you do a google search for the tools/frameworks/databases listed by Hussein?

[Hussein Baghdadi]

Rakesh Kannan wrote:Hi Hussein,

My question is what are the Java-based programming frameworks available, that supports the processing of large data sets in a distributed computing environment

Cheers,
Rakesh

Hadoop, Storm, Cascading, Cascalog and Mahout (targeted toward machine learning) are some frameworks to mention.

[Rakesh Kannan]

Thanks a lot guys for your reply.....

[chris webster]

There's also some interesting ideas coming up around other languages and Big Data on the JVM, especially in functional programming. People are finding ways to use FP languages like Clojure and Scala for Big Data processing, taking advantage of features that support parallelism, streaming etc. And the Map-Reduce model is itself inspired by well-established concepts in FP. So I think there are lots of interesting opportunities available to make good use of the JVM in Big Data applications, even going beyond the current Java/Hadoop mainstream.

[Joe San]

I'm with Chris on this. The ideas and concepts that are prevalent in the FP domain fits like a glove to Big Data.

[chris webster]

Joe Harry wrote:I'm with Chris on this. The ideas and concepts that are prevalent in the FP domain fits like a glove to Big Data.

Dean Wampler (of Typesafe) described "copious" data as the killer app for functional programming last year.