even the service wont start now
[root@hadoop1 etc]# service krb5kdc start Starting Kerberos 5 KDC: krb5kdc: cannot initialize realm TOLLS.DOT.SATE.FL.US - see log file for details [FAILED] tail -100f /var/log/krb5kdc.log Nov 30 10:50:36 hadoop1 krb5kdc(info): closing down fd 9 Nov 30 10:50:36 hadoop1 krb5kdc(info): closing down fd 7 Nov 30 10:50:36 hadoop1 krb5kdc(info): shutting down krb5kdc: Can not fetch master key (error: No such file or directory). - while fetching master key K/M for realm TOLLS.DOT.SATE.FL.USe
It seems like your KDC installation is all messed up. Can you remove the client and server packages as well as the /var/kerberos directory and its contents? Then try to reinstall it.
Here is a script that I use for Centos6. If you have a different OS, let me know and I might have a script for that. In any case the script creates a KDC with the realm of EXAMPLE.COM. You can edit the script to change this. It also creates an administrator principal - admin/admin@EXAMPLE.COM (password: admin).
ah there was a typo in the krb5.conf file . I typed "SATE" instead of "STATE" . so I can login into kadmin now and will try to re-install via ambari and report.