Win a copy of The Little Book of Impediments (e-book only) this week in the Agile and Other Processes forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Why in hadoop source code, he used function JobSplitWriter.createSplitFiles(...)?

 
sara ahmed
Greenhorn
Posts: 6
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
[b]Hi,,
while I am studying the part of splitting the input file into splits in hadoop code , I found that after he splits the input file he used that function :



and that function created 4 files in the harddisk : job.split , job.splitmetainfo , job.split.crc and job.splitmetainfo.crc

and when I open the class JobSplitWriter code, there is a comment : The class that is used by the Job clients to write splits (both the meta and the raw bytes parts)

I don't understand what is the use of this function ?

thanks,,[/b]
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic