wood burning stoves 2.0*
The moose likes Hadoop and the fly likes Hadoop and Python Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Hadoop and Python" Watch "Hadoop and Python" New topic
Author

Hadoop and Python

Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
Hi Alex,

Currently, I am using python for some projects, and I am wondering if Python has its coverage part in your contents. Do you think using Hadoop with Python a good match?

Regards,
Mohamed


Best Regards, Mohamed El-Refaey
www.egyptcloudforum.com
Alex Holmes
Author
Greenhorn

Joined: Oct 19, 2012
Posts: 21
Hi Mohamed,

The "Hadoop in Action" book covers streaming, which is how you'd integrate Python with MapReduce. This is actually a pretty common usage of Hadoop, and is a good way for Python programmers to work with Hadoop. Other tools worth considering would be Pig and Hive, which would be higher-level ways to work with Hadoop.

Thanks,
Alex


Author, Hadoop in Practice, http://www.manning.com/holmes/
Blog at http://grepalex.com/
Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
Alex Holmes wrote:Hi Mohamed,

The "Hadoop in Action" book covers streaming, which is how you'd integrate Python with MapReduce. This is actually a pretty common usage of Hadoop, and is a good way for Python programmers to work with Hadoop. Other tools worth considering would be Pig and Hive, which would be higher-level ways to work with Hadoop.

Thanks,
Alex


I got it thanks. actually after I asked you the question, I searched google and found 'boto', an API that enable me to invoke the job workflow and mappers/reducers scripts ... it is wonderful and easy to use!

Regards,
Mohamed
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Hadoop and Python