Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Completed YARN applications not visible in Cloudera Manager's YARN service page

Completed YARN applications not visible in Cloudera Manager's YARN service page

Hi community:

 

This seems like a stupid question, and maybe I am not seeing an obvious config option - but for some reason, I cannot see any finished jobs of any type in the CM's YARN application view.

 

In the Cloudera Manager -> YARN -> Applications tab, only currently running YARN applications (or those pending or recently killed) are visible. Otherwise the listing is blank. Any ideas?

 

Thanks!

9 REPLIES 9

Re: Completed YARN applications not visible in Cloudera Manager's YARN service page

Master Guru
This may be so cause of the time filter applied on top of your CM screen. Does widening it also not bring up any of the past completed jobs?

Re: Completed YARN applications not visible in Cloudera Manager's YARN service page

New Contributor

Did you ever get this resolved?  I'm having the same problem and widening the time filters has no effect.

Re: Completed YARN applications not visible in Cloudera Manager's YARN service page

Unfortunately no this issue has not been resolved. Widening the time window
doesn't change anything.

Highlighted

Re: Completed YARN applications not visible in Cloudera Manager's YARN service page

So, did you figure this one out?

Re: Completed YARN applications not visible in Cloudera Manager's YARN service page

Master Guru
Are you able to see the completed jobs (for MR2 for example) on the JHS UI? This typically serves on HTTP port 19888.

If even that UI does not show any completed MR jobs, then that may likely be the first thing you'll need to investigate and fix, as I believe the YARN Applications view pulls information out of the JHS API for completed jobs.

Re: Completed YARN applications not visible in Cloudera Manager's YARN service page

New Contributor

I just ran a job. As the job is running I can see the status while it's running the YARN service page, but when it's complete it no longer displays.  As you suggested I opened the Job history page on 19888.  I see the completed job listed in Job History.

cinRe: Completed YARN applications not visible in Cloudera Manager's YARN service page

New Contributor

I am facing the same problem. Can you please let us know the solution for this ?

Re: cinRe: Completed YARN applications not visible in Cloudera Manager's YARN service page

Expert Contributor

me too! I can see the application is running, the charts are available but the moment is done it will be gone for good. I can see the finished job (spark/hive) in Spark UI, Job UI and Hive UI but not in Cloudera Manager YARN applications.

 

CDH 5.13.1

 

Also, something that might help is all my jobs have a bizzare duration time under progress bar. Something like "17529d".

Re: cinRe: Completed YARN applications not visible in Cloudera Manager's YARN service page

Expert Contributor

Have you guys found any solution or hint? @doubleocherry @tuckerrogerd @HariKrishnan

I am facing some kind of a problem: http://community.cloudera.com/t5/Batch-Processing-and-Workflow/YARN-Applications-display-wrong-forma...

 

@Harsh J And if the widening of timeline will show the finished jobs, what could be the issue?

 

Many thanks

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here