I was going to collect metrics on the waiting times for YARN applications and tried to pull this data from the ATS Rest API.
Then I noticed that the waiting time (defined as start time-submit time) was always zero which didn't seem to match what I knew from our cluster. When I looked more it really seems like these times are always the same.
My question is: Is this a bug or am I missing something?
The corresponding fields when pulled from the MapReduce JobHistoryServer seems more correct, with submit time being lesser than the start time.