nawab wajid wrote:I have fair understanding of the hadooop and MapReduce concepts .but still I need to understand these concepts on a higher technical level. I know that NameNode stores the metadata information about the data and DataNode stores the actual data.BUT I am not understanding what makes the node as NameNode and Data Node? i mean what special things do we need to make it a NameNode and DataNode?
nawab wajid wrote:
2)What is the difference between HDFS and local file system in hadoop ? I have understood that the mapper output is stored in local file system and the reducer output is stored on the HDFS. Also if there is no reducer then the mapper output is stored directly on the HDFS .What I am not understanding is where is HDFS and where is local file system located? How do I differentiate between the two as far as hadoop is concerned?
Or do you mean that you don't want to buy that much idle hardware, and "borrow" it only when you need it?