Win a copy of Java 9 Revealed this week in the Features new in Java 9 forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic

MR/Hive/Pig - How do you migrate the code from Dev to Test to Produciton ?  RSS feed

prad remedy
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

I want to know how do you really migrated the MR Program/Pig Scripts/Hive from Dev to Test to Production instances ?
When we develop any application with any language like JAVA, MS.Net or Oracle Package we usually test in Dev and then go for UAT and then migrate the same to Production. The Dev and Test servers will be
different and Admin people will migrate the things from one instance to other instance. I want to know
how it works in Hadoop. Lets say we have got a log file and we want to process this and need to figure
out crawlers and bad ip addresses. We wrote the MR program in Dev and i need to know the steps involved
here through up to the production. Please let me know the configuration of Dev and Test clusters too. Who would migrate the scripts or MR programs?

Thank you
With a little knowledge, a cast iron skillet is non-stick and lasts a lifetime.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!