Win a copy of Learn Spring Security (video course) this week in the Spring forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Hadoop and Python

 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Alex,

Currently, I am using python for some projects, and I am wondering if Python has its coverage part in your contents. Do you think using Hadoop with Python a good match?

Regards,
Mohamed
 
Alex Holmes
Author
Greenhorn
Posts: 21
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Mohamed,

The "Hadoop in Action" book covers streaming, which is how you'd integrate Python with MapReduce. This is actually a pretty common usage of Hadoop, and is a good way for Python programmers to work with Hadoop. Other tools worth considering would be Pig and Hive, which would be higher-level ways to work with Hadoop.

Thanks,
Alex
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Alex Holmes wrote:Hi Mohamed,

The "Hadoop in Action" book covers streaming, which is how you'd integrate Python with MapReduce. This is actually a pretty common usage of Hadoop, and is a good way for Python programmers to work with Hadoop. Other tools worth considering would be Pig and Hive, which would be higher-level ways to work with Hadoop.

Thanks,
Alex


I got it thanks. actually after I asked you the question, I searched google and found 'boto', an API that enable me to invoke the job workflow and mappers/reducers scripts ... it is wonderful and easy to use!

Regards,
Mohamed
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic