Only 44 hours left in the trailboss' kickstarter!

New rewards and stretch goals. CLICK HERE!



  • Post Reply Bookmark Topic Watch Topic
  • New Topic

Analyzing massive data with Clojure  RSS feed

 
Hussein Baghdadi
clojure forum advocate
Bartender
Posts: 3479
Clojure Mac Objective C
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Here is an article about analyzing massive data with Clojure programming language:
https://github.com/jonase/mlx/wiki/Analyzing-Stack-Overflow-data
The article comes in the right time as I'm about to start to code something similar.
 
Sean Corfield
Ranch Hand
Posts: 312
14
Clojure Linux Mac OS X Monad
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I just wrote a program to read PowerMTA accounting files and record email bounces. Clojure's lazy data structures make it possible to process large amounts of data in very reasonable amounts of memory - and pretty fast too. In less than 140 lines of very well-commented Clojure, I have a complete email event processing library and it can process 450,000 lines of CSV file, extract 46,000 bouncing emails and record their status in MySQL, in about 80 seconds. I continue to be more and more impressed by Clojure...
 
Hussein Baghdadi
clojure forum advocate
Bartender
Posts: 3479
Clojure Mac Objective C
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Clojure is a "44 Magnum Revolver" when it comes to parsing and analyzing massive data. Absolutely stunning.
 
With a little knowledge, a cast iron skillet is non-stick and lasts a lifetime.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!