Support Questions

Find answers, ask questions, and share your expertise

Difference between yarn ui running applications and output from yarn cli

avatar
Explorer

Running hdp 2.6.2 

All appl shown in the yarn ui is from 13/12 2019 (that is more than 1 month old)

While 

yarn application -list

shows a different list of jobs. from now and back in time.

If I tries to access the log from a job from the yarn ui. It returns with the message

Failed to read the application application_1575679196937_21846.

If I try to access the same appl from the yarn cli: 

[yarn@wx2024 ~]$ yarn logs -applicationId application_1575679196937_21846
20/01/15 13:49:43 INFO client.AHSProxy: Connecting to Application History server at xxxxxx.danskenet.net/xx.xxx.xxx.xxx:10200
20/01/15 13:49:43 INFO client.RequestHedgingRMFailoverProxyProvider: Looking for the active RM in [rm1, rm2]...
20/01/15 13:49:43 WARN client.RequestHedgingRMFailoverProxyProvider: Invocation returned exception on [rm2] : org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1575679196937_21846' doesn't exist in RM. Please check that the job submission was successful.
at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:332)
at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:175)
at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:417)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2351)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2347)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2345)
, so propagating back to caller.
Unable to get ApplicationState. Attempting to fetch logs directly from the filesystem.
Can not find the appOwner. Please specify the correct appOwner
Could not locate application logs for application_1575679196937_21846

 

/Claus

1 REPLY 1

avatar
Rising Star

Hi @clvi, Try adding the --appOwner <username> to the yarn logs command. However,  I think the application states are erased from the RM state store, probably due to an RM State Restore.