• Post Reply Bookmark Topic Watch Topic
  • New Topic

big data and Java  RSS feed

 
Rakesh Kannan
Greenhorn
Posts: 3
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
How java is going to be used in Big data Technologies.Please share if there is any real time examples
 
Hussein Baghdadi
clojure forum advocate
Bartender
Posts: 3479
Clojure Mac Objective C
  • Likes 3
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
What do you mean exactly?
Cassandra, HBase, Hadoop, Mahout, SenseiDB, Storm (and many others) are written in Java programming language.
 
Rakesh Kannan
Greenhorn
Posts: 3
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Hussein,

My question is what are the Java-based programming frameworks available, that supports the processing of large data sets in a distributed computing environment

Cheers,
Rakesh
 
Sumit Bisht
Ranch Hand
Posts: 331
Python Ruby Ubuntu
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Rakesh, did you do a google search for the tools/frameworks/databases listed by Hussein?
 
Hussein Baghdadi
clojure forum advocate
Bartender
Posts: 3479
Clojure Mac Objective C
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Rakesh Kannan wrote:Hi Hussein,

My question is what are the Java-based programming frameworks available, that supports the processing of large data sets in a distributed computing environment

Cheers,
Rakesh


Hadoop, Storm, Cascading, Cascalog and Mahout (targeted toward machine learning) are some frameworks to mention.
 
Rakesh Kannan
Greenhorn
Posts: 3
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Thanks a lot guys for your reply.....
 
chris webster
Bartender
Posts: 2407
33
Linux Oracle Postgres Database Python Scala
  • Likes 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
There's also some interesting ideas coming up around other languages and Big Data on the JVM, especially in functional programming. People are finding ways to use FP languages like Clojure and Scala for Big Data processing, taking advantage of features that support parallelism, streaming etc. And the Map-Reduce model is itself inspired by well-established concepts in FP. So I think there are lots of interesting opportunities available to make good use of the JVM in Big Data applications, even going beyond the current Java/Hadoop mainstream.
 
Joe Harry
Ranch Hand
Posts: 10128
3
Eclipse IDE Mac PPC Ubuntu
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I'm with Chris on this. The ideas and concepts that are prevalent in the FP domain fits like a glove to Big Data.
 
chris webster
Bartender
Posts: 2407
33
Linux Oracle Postgres Database Python Scala
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Joe Harry wrote:I'm with Chris on this. The ideas and concepts that are prevalent in the FP domain fits like a glove to Big Data.

Dean Wampler (of Typesafe) described "copious" data as the killer app for functional programming last year.
 
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!