Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Add new Counters to MapReduce Source

Highlighted

Add new Counters to MapReduce Source

New Contributor

0favorite

I want to measure the time taken by the MapReduce framework to read data from HDFS using counters. The current counters don't include that. I have looked at the MapReduce source code on Github but I am still unable to wrap my head around the whole flow. Looking at the source, I think read operation is done from the below java class and nextKeyValue() method.

org/apache/hadoop/mapreduce/lib/input/LineRecordReader.java 

I know I can have an empty Mapper approach to do this but since I will be running lot of experiments then that will not be very ideal.

Any pointers is highly appreciated.

1 REPLY 1

Re: Add new Counters to MapReduce Source

New Contributor

@Neeraj Sabharwal any ideas or pointers here?

Don't have an account?
Coming from Hortonworks? Activate your account here