Member since
06-01-2016
4
Posts
0
Kudos Received
0
Solutions
01-15-2020
05:06 AM
Running hdp 2.6.2
All appl shown in the yarn ui is from 13/12 2019 (that is more than 1 month old)
While
yarn application -list
shows a different list of jobs. from now and back in time.
If I tries to access the log from a job from the yarn ui. It returns with the message
Failed to read the application application_1575679196937_21846.
If I try to access the same appl from the yarn cli:
[yarn@wx2024 ~]$ yarn logs -applicationId application_1575679196937_21846 20/01/15 13:49:43 INFO client.AHSProxy: Connecting to Application History server at xxxxxx.danskenet.net/xx.xxx.xxx.xxx:10200 20/01/15 13:49:43 INFO client.RequestHedgingRMFailoverProxyProvider: Looking for the active RM in [rm1, rm2]... 20/01/15 13:49:43 WARN client.RequestHedgingRMFailoverProxyProvider: Invocation returned exception on [rm2] : org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1575679196937_21846' doesn't exist in RM. Please check that the job submission was successful. at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:332) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:175) at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:417) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2351) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2347) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2345) , so propagating back to caller. Unable to get ApplicationState. Attempting to fetch logs directly from the filesystem. Can not find the appOwner. Please specify the correct appOwner Could not locate application logs for application_1575679196937_21846
/Claus
... View more
Labels:
- Labels:
-
Apache YARN
01-04-2017
01:51 PM
Hi Sagar Do I need to generate new keytab files or can I copy and do what ?? /Claus
... View more
06-01-2016
12:20 PM
Thx @bsani We have sat HA on our name nodes while we don't want the cluster to be unawailable. So is there a best practice for doing patching on a cluster that is supposed to be available 24/7. How to avoid rebalancing during patching When upgrading datanodes in chuncks, is there a way to make sure that replica of a data block is available on one of the servers alive /Claus
... View more