• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

PIG - Is there online reference/shell?

 
Ranch Hand
Posts: 1609
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I am not able to understand the working of many pig operators like how they operate on data-set, is there any online material that discusses on this.
Also is there any place where I can create tuples/data-set and try running PIG commands/operators online?
 
Bartender
Posts: 1210
25
Android Python PHP C++ Java Linux
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Regarding trying out pig online, one option I can think of is Amazon's AWS EMR (Elastic Map Reduce). It's a pay-as-you-go web service.
There are public datasets available on their AWS S3 storage service, such as this one.

If you have never tried pig at all, then start off by running pig locally in a VM on your machine. Just download, extract and run in local mode with "pig -x local". Other than Java, nothing else is required (it already has hadoop embedded, so you don't even have to install hadoop in this mode).
Under the extracted directory, there's a /tutorial subdirectory with a simple dataset named excite.log. You can learn pig by trying it out on that dataset.

You can also find many CSV format datasets on the UCI ML Repository site.

 
Akhilesh Trivedi
Ranch Hand
Posts: 1609
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Thanks Karthik. I shall look at them.
 
reply
    Bookmark Topic Watch Topic
  • New Topic