On our cluster we setting up secure ldap.
for Ambari and Ranger it's working fine. Following the description of how to.
For knox gateway to webhdfs - also working fine.
But for gateway to ranger I am not even able to get an error message. Just password is not matching on the ranger login screen.
Any good a detailed descriptions out there.
What I've found so far is:
But I don't see any of them are really handling secure ldap
... View more
Running hdp 2.6.2
All appl shown in the yarn ui is from 13/12 2019 (that is more than 1 month old)
yarn application -list
shows a different list of jobs. from now and back in time.
If I tries to access the log from a job from the yarn ui. It returns with the message
Failed to read the application application_1575679196937_21846.
If I try to access the same appl from the yarn cli:
[yarn@wx2024 ~]$ yarn logs -applicationId application_1575679196937_21846 20/01/15 13:49:43 INFO client.AHSProxy: Connecting to Application History server at xxxxxx.danskenet.net/xx.xxx.xxx.xxx:10200 20/01/15 13:49:43 INFO client.RequestHedgingRMFailoverProxyProvider: Looking for the active RM in [rm1, rm2]... 20/01/15 13:49:43 WARN client.RequestHedgingRMFailoverProxyProvider: Invocation returned exception on [rm2] : org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1575679196937_21846' doesn't exist in RM. Please check that the job submission was successful. at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:332) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:175) at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:417) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2351) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2347) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2345) , so propagating back to caller. Unable to get ApplicationState. Attempting to fetch logs directly from the filesystem. Can not find the appOwner. Please specify the correct appOwner Could not locate application logs for application_1575679196937_21846
... View more
Thx @bsani We have sat HA on our name nodes while we don't want the cluster to be unawailable. So is there a best practice for doing patching on a cluster that is supposed to be available 24/7. How to avoid rebalancing during patching When upgrading datanodes in chuncks, is there a way to make sure that replica of a data block is available on one of the servers alive /Claus
... View more