Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

kileld application not showing up in history server

kileld application not showing up in history server

Explorer

rm_killed_application.png

 

I kiiled Yarn mapreduce application manually, after 50% mappers finished, I can see the mappers in Resource Manager UI while the job is in porgress, but after I killed application, I can not see the tasks window any more "Tracking URL: History"  not progressing to next window.

 

Same time this application not showing up in history server.

 

Using Cloudera enterprise 5.14.0

 

How can I diagnose issue, I ddin't see any exception in logs?

 

Also how can get rid of following message:

 

2019-05-03 04:58:32,835 INFO org.apache.hadoop.yarn.server.webproxy.WebAppProxyServlet: dr.who is accessing unchecked http://XXXm:44182/ws/v1/mapreduce/jobs/job_1551283647797_40054 which is the app master GUI of application_1551283647797_40054 owned by spothineni

4 REPLIES 4

Re: kileld application not showing up in history server

Guru
Hi,

Have you tried to get the logs from command line?

For secured cluster, run as "yarn" superuser:

yarn logs -applicationId {application_id} -appOwner {username}

For unsecured cluster, run as "root" superuser:

sudo -u yarn yarn logs -applicationId {application_id}

Will you get the result? Without seeing errors, it would be hard to tell why you don't see next page when clicking "History" button on that page, it can be caused by lots of factors.

Cheers
Eric
Highlighted

Re: kileld application not showing up in history server

Explorer

Thanks for the reply.

 

I already tried yarn cli, its giving only the AM container log, seems it couldn't aggregate the other containers.

 

 

when a job is killed from Hue, job State: KILLED, FinalStatus: KILLED, should it complete the log aggregation for killed application?

 

 

Re: kileld application not showing up in history server

Cloudera Employee

Hi,

 

Is the issue happens for only one particular job? 

 

Thx

AKR

Re: kileld application not showing up in history server

Explorer

Any "manually" killed application not showing up in the history server. In resource manager I am not able to browse the tasks. We care using Cloudera 5.14.X

 

Any application killed by yarn does show up in  history server and able to browse tasks in resource manager.