On a perfectly running HDP3.1 cluster, one time the ATSv2 Timeline Reader stopped responding. Following some guide I've tried refreshing the service by cleaning the configs and restarting it by yarn app -destroy ats-hbase After this, restarting the service doesn't help, and starting the service by yarn app -start ats-hbase doesn't work, since the config json is missing: ERROR client.ApiServiceClient: File does not exist:  <>/user/yarn-ats/.yarn/services/ats-hbase/ats-hbase.json What is this .json and how do I get it running again? Where are some example templates of a working .json that I could use? I remember this file existing somewhere on a fresh install, but sadly reinstall of the cluster is not an option. Another thing, trying a fresh install on my laptop VM does not create such json file too -- I guess the reason is that the laptop is too small for enforcing hbase use? Didn't find anything in the official documentation, so would be thankful for any advice! @Geoffrey Shelton Okot ... View more

Hello all, I'm trying to kerberize the Ambari 2.7.3 cluster. However, during the setup, I get the following error: Caused by: org.apache.ambari.server.serveraction.kerberos.KerberosOperationException: Unexpected error condition executing the kadmin command. STDERR: kadmin: Matching credential not found (filename: /tmp/ambari_krb_142308985016794830cc) while initializing kadmin interface at org.apache.ambari.server.serveraction.kerberos.MITKerberosOperationHandler.invokeKAdmin(MITKerberosOperationHandler.java:323) at org.apache.ambari.server.serveraction.kerberos.MITKerberosOperationHandler.principalExists(MITKerberosOperationHandler.java:123) at org.apache.ambari.server.serveraction.kerberos.KerberosOperationHandler.testAdministratorCredentials(KerberosOperationHandler.java:314) at org.apache.ambari.server.controller.KerberosHelperImpl.validateKDCCredentials(KerberosHelperImpl.java:2133) All of the authentication settings are okay, because I am able to kinit and use the kadmin interface from shell. It seems that the problem is that Ambari tries to do the following: kinit -p admin/admin@EXAMPLE.COM kadmin -c /tmp/ambari_krb_... While it should be doing the following: kinit -S kadmin/admin@EXAMPLE.COM admin/admin@EXAMPLE.COM kadmin -c /tmp/ambari_krb... I've tried replicating the two settings and confirmed my guess. The second code works from the shell. Further, If I intercept the temporarily generated credentials by ambari with my own, the code works. How can I fix this behaviour? This seem like a bug in Ambari code -- which part should I edit to fix this? ... View more

Hello all, I'm trying to kerberize the Ambari 2.7.3 cluster. However, during the setup, I get the following error: Caused by: org.apache.ambari.server.serveraction.kerberos.KerberosOperationException: Unexpected error condition executing the kadmin command. STDERR: kadmin: Matching credential not found (filename: /tmp/ambari_krb_142308985016794830cc) while initializing kadmin interface at org.apache.ambari.server.serveraction.kerberos.MITKerberosOperationHandler.invokeKAdmin(MITKerberosOperationHandler.java:323) at org.apache.ambari.server.serveraction.kerberos.MITKerberosOperationHandler.principalExists(MITKerberosOperationHandler.java:123) at org.apache.ambari.server.serveraction.kerberos.KerberosOperationHandler.testAdministratorCredentials(KerberosOperationHandler.java:314) at org.apache.ambari.server.controller.KerberosHelperImpl.validateKDCCredentials(KerberosHelperImpl.java:2133) All of the authentication settings are okay, because I am able to kinit and use the kadmin interface from shell. It seems that the problem is that Ambari tries to do the following: kinit -p admin/admin@EXAMPLE.COM kadmin -c /tmp/ambari_krb_... While it should be doing the following: kinit -S kadmin/admin@EXAMPLE.COM admin/admin@EXAMPLE.COM kadmin -c /tmp/ambari_krb... I've tried replicating the two settings and confirmed my guess. The second code works from the shell. Further, If I intercept the temporarily generated credentials by ambari with my own, the code works. How can I fix this behaviour? This seem like a bug in Ambari code -- which part should I edit to fix this? ... View more