This week's book giveaway is in the Artificial Intelligence and Machine Learning forum.
We're giving away four copies of TensorFlow 2.0 in Action and have Thushan Ganegedara on-line!
See this thread for details.
Win a copy of TensorFlow 2.0 in Action this week in the Artificial Intelligence and Machine Learning forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Liutauras Vilda
  • Paul Clapham
  • Bear Bibeault
  • Jeanne Boyarsky
Sheriffs:
  • Ron McLeod
  • Tim Cooke
  • Devaka Cooray
Saloon Keepers:
  • Tim Moores
  • Tim Holloway
  • Jj Roberts
  • Stephan van Hulst
  • Carey Brown
Bartenders:
  • salvin francis
  • Scott Selikoff
  • fred rosenberger

Does any big data technology belong to hadoop ecosystem if it uses hdfs?

 
Ranch Foreman
Posts: 1833
9
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hadoop ecosystem comprises of technologies like hdfs, map reduce , hbase ,hive etc . It also has technologies such as mahoot ,oozie ,impala,zookeeper.

How are big data technologies classified into belonging to hadoop ecosystem or not ? I can see one common factor that map reduce ,hive and hbase all use hdfs .Does that mean whichever big data technology uses hdfs comes under hadoop ecosystem ?
 
Ranch Hand
Posts: 45
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Both the words Hadoop ecosystem and Big data Technologies are quite interlinked and depend on each other for existence !

Theoretically, as you mentioned Hadoop ecosystem is an environment comprising of all technologies used in it, its a package all together like HDFS is way of how file can be stored, different than map-reduce which is how the processing can be done, and hive for query to HDFS and so on......

Big Data technology is anything that can store, retrieve and process volumetric data in speed, so at the moment Hadoop ecosystem is what can do it and thereby two are used interchangeably !  In future you may have some technology not Hadoop ecosystem which can deal with volumes of data then that would come under Big data although not Hadoop !!
 
Monica Shiralkar
Ranch Foreman
Posts: 1833
9
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

mayank jamindar wrote:Both the words Hadoop ecosystem and Big data Technologies are quite interlinked and depend on each other for existence !

Theoretically, as you mentioned Hadoop ecosystem is an environment comprising of all technologies used in it, its a package all together like HDFS is way of how file can be stored, different than map-reduce which is how the processing can be done, and hive for query to HDFS and so on......

Big Data technology is anything that can store, retrieve and process volumetric data in speed, so at the moment Hadoop ecosystem is what can do it and thereby two are used interchangeably !  In future you may have some technology not Hadoop ecosystem which can deal with volumes of data then that would come under Big data although not Hadoop !!


Thanks.
And What is the criteria for classifying whether any technology is under hadoop ecosystem.?

E.g Spark does not come under Hadoop.
Hbase comes under hadoop, so does  mahoot,kafka etc.

Is the criteria that if a technology uses HDFS then it comes under hadoop ?
 
30 seconds to difuse a loaf of bread ... here, use this tiny ad:
the value of filler advertising in 2020
https://coderanch.com/t/730886/filler-advertising
reply
    Bookmark Topic Watch Topic
  • New Topic