Win a copy of Mastering Corda: Blockchain for Java Developers this week in the Cloud/Virtualization forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Paul Clapham
  • Ron McLeod
  • Bear Bibeault
  • Liutauras Vilda
Sheriffs:
  • Jeanne Boyarsky
  • Tim Cooke
  • Junilu Lacar
Saloon Keepers:
  • Tim Moores
  • Tim Holloway
  • Stephan van Hulst
  • Jj Roberts
  • Carey Brown
Bartenders:
  • salvin francis
  • Frits Walraven
  • Piet Souris

Should the Cloud Virtual Machines with Hadoop cluster be stopped after use or deleted and created

 
Ranch Foreman
Posts: 2343
12
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I have created a Hadoop cluster with 3 nodes. When the cluster is not in use (no hadoop or spark jobs running) , there are 3 ways. Keep the Virtual machines running all the time which will be and expensive option or shut down the Virtual Machines when not being used or to delete the virtual machines and create new machines and setup the cluster each time. The first option is the most expensive while the last one is cheapest one but difficult one. What is the recommended way?
thanks
 
Greenhorn
Posts: 22
2
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Thanks for posting a question for something I am currently taking a class on. Ha ha.  I think this person explains things better than I can.  See below link.  

https://read.acloud.guru/there-are-four-reasons-to-explain-how-using-aws-can-change-the-economic-model-of-the-it-services-850dcc8ea1aa

Also, here is an article from Amazon that seems to answer almost exactly what you are asking.

https://aws.amazon.com/emr/features/hadoop/
 
Monica Shiralkar
Ranch Foreman
Posts: 2343
12
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Matthew Keller wrote:
Also, here is an article from Amazon that seems to answer almost exactly what you are asking.

https://aws.amazon.com/emr/features/hadoop/



This talks about EMR , the managed service (PaaS). My question instead was on creating own cluster (IaaS - over EC2 machines).
 
what if we put solar panels on top of the semi truck trailer? That could power this tiny ad:
Building a Better World in your Backyard by Paul Wheaton and Shawn Klassen-Koop
https://coderanch.com/wiki/718759/books/Building-World-Backyard-Paul-Wheaton
reply
    Bookmark Topic Watch Topic
  • New Topic