• Post Reply Bookmark Topic Watch Topic
  • New Topic

MR/Hive/Pig - How do you migrate the code from Dev to Test to Produciton ?

prad remedy
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

I want to know how do you really migrated the MR Program/Pig Scripts/Hive from Dev to Test to Production instances ?
When we develop any application with any language like JAVA, MS.Net or Oracle Package we usually test in Dev and then go for UAT and then migrate the same to Production. The Dev and Test servers will be
different and Admin people will migrate the things from one instance to other instance. I want to know
how it works in Hadoop. Lets say we have got a log file and we want to process this and need to figure
out crawlers and bad ip addresses. We wrote the MR program in Dev and i need to know the steps involved
here through up to the production. Please let me know the configuration of Dev and Test clusters too. Who would migrate the scripts or MR programs?

Thank you
my overalls have superpowers - they repel people who think fashion is important. Tiny ad:
the new thread boost feature brings a LOT of attention to your favorite threads
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!