• Post Reply Bookmark Topic Watch Topic
  • New Topic

What dependency does Apache Spark have on Hadoop?  RSS feed

 
Monica Shiralkar
Ranch Hand
Posts: 914
1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Does Apache Spark has any dependency on Hadoop.If so What dependency does Apache Spark have on Hadoop?

thanks
 
Theo van Kraay
Ranch Hand
Posts: 51
1
Eclipse IDE Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Absolutely none. The fact that Spark is able to run over Hadoop was done merely for backwards compatibility as Hadoop was the 'big thing' in distributed processing at the time. In 'standalone mode', Spark can actually run over any distributed file system... it doesn't have to be Hadoop.
 
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!