Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What is Job History Server's Max Application Storage?

Highlighted

What is Job History Server's Max Application Storage?

Contributor

Hi All,

My cluster is on HDP 2.5.3 and we have multiple jobs running every 2-5 minutes frequency. So there will be 8-10 K job id's generated in a day with job history. Actually I wanted a log of job which was 3 days older & I was not able to find since MapReduce JHS was storing 20,000 Job ID's, how do I increase this to maximum number?

1 REPLY 1

Re: What is Job History Server's Max Application Storage?

Hi @Ram Charan Tej

This is specified through yarn.resourcemanager.max-completed-applications, which is 10K by default. It seems someone has already increased it to 20K on your environment. Keep in mind that 'this value impacts the RM recovery performance.Typically, a smaller value indicates better performance on RM recovery.' [source]

Don't have an account?
Coming from Hortonworks? Activate your account here