• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Liutauras Vilda
  • Tim Cooke
  • Jeanne Boyarsky
  • Bear Bibeault
Sheriffs:
  • Knute Snortum
  • paul wheaton
  • Devaka Cooray
Saloon Keepers:
  • Tim Moores
  • Stephan van Hulst
  • Ron McLeod
  • Piet Souris
  • Ganesh Patekar
Bartenders:
  • Tim Holloway
  • Carey Brown
  • salvin francis

Retrieve Apache Spark Shell output from a VM onto a local Java Project

 
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I'm running a Spark Shell connected to a Kafka Broker that retrieves lines printed on it and periodically prints out the word count. This is a slightly modified version of the WordCount example posted at http://spark.apache.org/docs/latest/streaming-programming-guide.html#a-quick-example.

The Spark Shell and the Kafka Broker are running on a Hortonworks Sandbox(HDP 2.4) VM and I want to retrieve the output from the Spark Shell onto a Java Play Framework application's console output running locally on my Mac.

Is there any proper way to do this? Any help is really reallyyy appreciated.

My Code:
 
It will give me the powers of the gods. Not bad for a tiny ad:
create, convert, edit or print DOC and DOCX in Java
https://products.aspose.com/words/java
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!