Win a copy of The Way of the Web Tester: A Beginner's Guide to Automating Tests this week in the Testing forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Hadoop problem with Custom RecordReader

marcin biczak
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi all

I am using Hadoop version 0.20.2003. I wanted to create my own InputFormat and Reader. I wanted to do it with the use of new org.apache.hadoop.mapreduce.* classes. Unfortunately I have encountered some problems.

Inside the visible line I have 3 strange problems:
1. cannot find symbol : variable COUNTER_GROUP
2 cannot find symbol : variable BYTES_READ
3. cannot find symbol : method getCounter(java.lang.String,java.lang.String)

I've checked the sources and all 3 "symbols" are there. Does anyone know what is the problem? Also I have came across interesting thing. Mainly according to hadoop javadoc org.apache.hadoop.mapreduce.TaskAttemptContext is:

While the src file defines it as:

For the record my "amazing" PatentLineRecordReder class is just a copy/paste from the org.apache.hadoop.mapreduce.lib.input.LineRecordReader, with minor changes in the initialize() method.

Does anyone came across similar problems, or rather should I ask "What am I doing wrong?".

For any help I will be grateful.
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic