Support Questions
Find answers, ask questions, and share your expertise

Hadoop Job Status from YARN after restart

New Contributor

Hello,

I want to get the list of all (successful, failed, or killed) the previous jobs launched with YARN and using the YARN REST API to collect this information. But, in case of YARN restart on I can see only successful jobs from past 7 days.

Any pointers on how to get this going?

I see that following param can be set to longer than 7 days to get that but still would not get me all the job.

mapreduce.jobhistory.max-age-ms

Thanks in advance!

2 REPLIES 2

New Contributor

@Sagar Shimpi

Thanks for the response. Please correct me, YARN history server only keeps data on finished MR jobs. While YARN timeline has information about another other framework using YARN.