Win a copy of The Little Book of Impediments (e-book only) this week in the Agile and Other Processes forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Executing script from Hadoop

 
Madhumitha Baskaran
Ranch Hand
Posts: 66
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I have a requirement in hadoop and I am not able to get it right. I have to execute a UNIX script inside hadoop program and whatever is being echoed by UNIX scripts should be obtained in the hadoop program as output from Unix script. How will it be possible?

In ordinary JAVA program, I am able to execute JAVA program and get the output of unix script. But same is not working in hadoop. Can you please help?
 
Alex Holmes
Author
Greenhorn
Posts: 21
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Take a look at Hadoop Streaming: http://wiki.apache.org/hadoop/HadoopStreaming

It will allow you to use UNIX scripts in combination with MapReduce. Input records are supplied to stdin of your scripts, and output records are collected from stdout.
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic