MR/Hive/Pig - How do you migrate the code from Dev to Test to Produciton ?
posted 2 years ago
I want to know how do you really migrated the MR Program/Pig Scripts/Hive from Dev to Test to Production instances ?
When we develop any application with any language like JAVA, MS.Net or Oracle Package we usually test in Dev and then go for UAT and then migrate the same to Production. The Dev and Test servers will be
different and Admin people will migrate the things from one instance to other instance. I want to know
how it works in Hadoop. Lets say we have got a log file and we want to process this and need to figure
out crawlers and bad ip addresses. We wrote the MR program in Dev and i need to know the steps involved
here through up to the production. Please let me know the configuration of Dev and Test clusters too. Who would migrate the scripts or MR programs?