posted 9 years ago
Hi All
I am bit confused about HDFS storage and Data node storage. Below are my doubts.
1. Map function output will be saved to data node local disk and reducer output will be sent to HDFS. As we all know that data blocks are stored in data nodes local disk is there any
other disk space available for HDFS in data node??
2. What is the physical storage location of reducer output file (part-nnnnn-r-00001) ? will it be stored in Name node hard disk?
So my assumption is data node is part is of HDFS i assume data node local disk is also part of HDFS.
Regards
Suresh