Support Questions
Find answers, ask questions, and share your expertise

Why the values of mapsTotal and reducesTotal are different for rest responses of Jobs API and Job API

Explorer

Response of Jobs API : http://<history server http address:port>/ws/v1/history/mapreduce/jobs

{
"jobs": {
"job": [{
"submitTime": 1574157410876,
"startTime": 1574157419359,
"finishTime": 1574157459602,
"id": "job_1568869492319_0009",
"name": "word count",
"queue": "default",
"user": "hdfs",
"state": "FAILED",
"mapsTotal": 0,
"mapsCompleted": 0,
"reducesTotal": 0,
"reducesCompleted": 0
}]
}
}

 

Response of Job API : http://<history server http address:port>/ws/v1/history/mapreduce/jobs/{jobid}

{
"job": {
"submitTime": 1574157410876,
"startTime": 1574157419359,
"finishTime": 1574157459602,
"id": "job_1568869492319_0009",
"name": "word count",
"queue": "default",
"user": "hdfs",
"state": "FAILED",
"mapsTotal": 9,
"mapsCompleted": 0,
"reducesTotal": 1,
"reducesCompleted": 0,
"uberized": false,
"diagnostics": "Task failed task_1568869492319_0009_m_000006\nJob failed as tasks failed. failedMaps:1 failedReduces:0",
"avgMapTime": 0,
"avgReduceTime": 0,
"avgShuffleTime": 0,
"avgMergeTime": 0,
"failedReduceAttempts": 0,
"killedReduceAttempts": 0,
"successfulReduceAttempts": 0,
"failedMapAttempts": 17,
"killedMapAttempts": 7,
"successfulMapAttempts": 0
}
}

 

See the difference in the mapsTotal and reducesTotal values, Could anybody have idea whats happening here?

I'm running the jobs on HDP3.0 platform.

 

0 REPLIES 0