I've been playing around with Apache Spark for a while now, mainly using Scala, but a couple of my colleagues are also interested in learning about Spark using Python. Happily, it turns out you can use IPython Notebook with a local Apache Spark installation, so I wrote a quick demo notebook to illustrate how you can use Spark to do the traditional
word count inside a notebook:
http://tirneb.blogspot.co.uk/2015/02/apache-spark-and-ipython-notebook.html