• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Tim Cooke
  • paul wheaton
  • Jeanne Boyarsky
  • Ron McLeod
Sheriffs:
  • Paul Clapham
  • Liutauras Vilda
  • Devaka Cooray
Saloon Keepers:
  • Tim Holloway
  • Roland Mueller
Bartenders:

EMR and Hadoop

 
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi,
is there any area of the book that talks about Amazon EMR and Hadoop?

Regards,
Mohamed
 
author
Posts: 2
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi Mohamed,
Cloud Deployments: Using Hadoop on Cloud (Chapter 10) of Hadoop MapReduce Cookbook talks about using EMR for Hadoop/Pig/Hive/HBase computations. It also talks about using Apache Whirr to deploy your own Hadoop or HBase cluster on EC2. You can find an extract of that chapter in the following DZone article. http://architects.dzone.com/articles/cloud-deployments-using-hadoop

thanks,
Thilina
 
author
Posts: 15
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I also talk about EMR in the Hadoop Beginners Guide, particularly in the earlier chapters where there are examples of running code on a local cluster then doing the same on EMR.

My later chapters on topics such as cluster management, Sqoop and Flume don't really touch on EMR so if that is your interest look elsewhere.

Garry
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Ohh wonderful guys thanks for the references ! So the two books are covering it ...

Regards,
Mohamed
 
Ranch Hand
Posts: 221
Scala Python Java
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
You can also watch this video about how to use it.

http://youtu.be/kNsS9aDf6uE


There is also an extensive PDF in the AWS about how to use the EMR including the EMR through the CLI.

HTH,


Carlos
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Simple and very illustrative video! Thanks Carlos ...
 
It's just a flesh wound! Or a tiny ad:
Smokeless wood heat with a rocket mass heater
https://woodheat.net
reply
    Bookmark Topic Watch Topic
  • New Topic