Win a copy of Succeeding with AI this week in the Artificial Intelligence and Machine Learning forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Paul Clapham
  • Ron McLeod
  • Liutauras Vilda
  • Junilu Lacar
Sheriffs:
  • Tim Cooke
  • Jeanne Boyarsky
  • Knute Snortum
Saloon Keepers:
  • Stephan van Hulst
  • Tim Moores
  • Tim Holloway
  • Carey Brown
  • Piet Souris
Bartenders:
  • salvin francis
  • fred rosenberger
  • Frits Walraven

big data and Java

 
Greenhorn
Posts: 3
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
How java is going to be used in Big data Technologies.Please share if there is any real time examples
 
clojure forum advocate
Posts: 3479
Mac Objective C Clojure
  • Likes 3
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
What do you mean exactly?
Cassandra, HBase, Hadoop, Mahout, SenseiDB, Storm (and many others) are written in Java programming language.
 
Rakesh Kannan
Greenhorn
Posts: 3
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Hussein,

My question is what are the Java-based programming frameworks available, that supports the processing of large data sets in a distributed computing environment

Cheers,
Rakesh
 
Ranch Hand
Posts: 331
Python Ruby Ubuntu
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Rakesh, did you do a google search for the tools/frameworks/databases listed by Hussein?
 
Hussein Baghdadi
clojure forum advocate
Posts: 3479
Mac Objective C Clojure
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

Rakesh Kannan wrote:Hi Hussein,

My question is what are the Java-based programming frameworks available, that supports the processing of large data sets in a distributed computing environment

Cheers,
Rakesh



Hadoop, Storm, Cascading, Cascalog and Mahout (targeted toward machine learning) are some frameworks to mention.
 
Rakesh Kannan
Greenhorn
Posts: 3
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Thanks a lot guys for your reply.....
 
Bartender
Posts: 2407
36
Scala Python Oracle Postgres Database Linux
  • Likes 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
There's also some interesting ideas coming up around other languages and Big Data on the JVM, especially in functional programming. People are finding ways to use FP languages like Clojure and Scala for Big Data processing, taking advantage of features that support parallelism, streaming etc. And the Map-Reduce model is itself inspired by well-established concepts in FP. So I think there are lots of interesting opportunities available to make good use of the JVM in Big Data applications, even going beyond the current Java/Hadoop mainstream.
 
Ranch Hand
Posts: 10192
3
Mac PPC Eclipse IDE Ubuntu
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I'm with Chris on this. The ideas and concepts that are prevalent in the FP domain fits like a glove to Big Data.
 
chris webster
Bartender
Posts: 2407
36
Scala Python Oracle Postgres Database Linux
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

Joe Harry wrote:I'm with Chris on this. The ideas and concepts that are prevalent in the FP domain fits like a glove to Big Data.


Dean Wampler (of Typesafe) described "copious" data as the killer app for functional programming last year.
 
All that thinking. Doesn't it hurt? What do you think about this tiny ad?
Building a Better World in your Backyard by Paul Wheaton and Shawn Klassen-Koop
https://coderanch.com/wiki/718759/books/Building-World-Backyard-Paul-Wheaton
    Bookmark Topic Watch Topic
  • New Topic