• Post Reply Bookmark Topic Watch Topic
  • New Topic

Why in hadoop source code, he used function JobSplitWriter.createSplitFiles(...)?  RSS feed

sara ahmed
Posts: 6
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
while I am studying the part of splitting the input file into splits in hadoop code , I found that after he splits the input file he used that function :

and that function created 4 files in the harddisk : job.split , job.splitmetainfo , job.split.crc and job.splitmetainfo.crc

and when I open the class JobSplitWriter code, there is a comment : The class that is used by the Job clients to write splits (both the meta and the raw bytes parts)

I don't understand what is the use of this function ?

It is sorta covered in the JavaRanch Style Guide.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!