Kerberos ticket renewer failed to start.

[#1]

kerberos ticket renewer is not starting. see the below log file data.

Jul 23, 3:41:32 PM	INFO	__init__	
Couldn't import snappy. Support for snappy compression disabled.
Jul 23, 3:41:32 PM	INFO	kt_renewer	
Reinitting kerberos from keytab: /bin/kinit -k -t /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/hue.keytab -c /var/run/hue/hue_krb5_ccache hue/npmnru01l.vf-nz.internal.vodafone.com@NASA-UAT-VFNZ.COM
Jul 23, 3:41:32 PM	ERROR	kt_renewer	
Couldn't reinit from keytab! `kinit' exited with 1.

kinit: Failed to store credentials: Internal credentials cache error (filename: /var/run/hue/hue_krb5_ccache) while getting initial credentials

[23/Jul/2018 15:41:35 ] settings     INFO     Welcome to Hue 3.9.0

----- 

Below is from std error.

+ perl -pi -e 's#{{CDH_HADOOP_HOME}}#/var/opt/OPTIGO/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop#g' /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/core-site.xml /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/hadoop-env.sh /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/hdfs-site.xml /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/log4j.properties /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/mapred-site.xml /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/ssl-client.xml /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/topology.map /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/topology.py /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/yarn-conf/yarn-site.xml
+ replace_conf_dir
+ echo CONF_DIR=/run/cloudera-scm-agent/process/961-hue-KT_RENEWER
+ echo CMF_CONF_DIR=/etc/cloudera-scm-agent
+ EXCLUDE_CMF_FILES=('cloudera-config.sh' 'httpfs.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' '*.log' '*.keytab' '*jceks')
++ printf '! -name %s ' cloudera-config.sh httpfs.sh hue.sh impala.sh sqoop.sh supervisor.conf '*.log' hue.keytab creds.localjceks
+ find /run/cloudera-scm-agent/process/961-hue-KT_RENEWER -type f '!' -path '/run/cloudera-scm-agent/process/961-hue-KT_RENEWER/logs/*' '!' -name cloudera-config.sh '!' -name httpfs.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name '*.log' '!' -name hue.keytab '!' -name creds.localjceks -exec perl -pi -e 's#{{CMF_CONF_DIR}}#/run/cloudera-scm-agent/process/961-hue-KT_RENEWER#g' '{}' ';'
Can't open /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/config.zip: Permission denied.
Can't open /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/proc.json: Permission denied.
+ replace_conf_dir_env_vars KRB5_KTNAME
/usr/lib64/cmf/service/hue/hue.sh: line 123: replace_conf_dir_env_vars: command not found
+ make_scripts_executable
+ find /run/cloudera-scm-agent/process/961-hue-KT_RENEWER -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';'
+ '[' kt_renewer == beeswax_server ']'
+ set_classpath_in_var HADOOP_EXTRA_CLASSPATH_STRING
+ '[' -z HADOOP_EXTRA_CLASSPATH_STRING ']'
+ [[ -n /usr/share/cmf ]]
++ tr '\n' :

Regards Veera

[#2]

@proxim

The error of interest is in your kt_renwer log:

/bin/kinit -k -t /run/cloudera-scm-agent/process/961-hue-KT_RENEWER/hue.keytab -c /var/run/hue/hue_krb5_ccache hue/npmnru01l.vf-nz.internal.vodafone.com@NASA-UAT-VFNZ.COM

kinit: Failed to store credentials: Internal credentials cache error (filename: /var/run/hue/hue_krb5_ccache) while getting initial credentials

The error tells us there was a problem for kinit storing the credentials in the credentials cache located in /var/run/hue/hue_krb5_ccache

I would check that file and parent directory to make sure your hue process user can create the cache file there.

Try running kinit -c /var/run/hue/hue_krb5_ccache

Try running ls -la /var/run/hue

[#3]

Hello @proxim ,

Assign the valid ownership and permission for file.

chown user:user /var/run/hue/hue_krb5_ccache

chmod 755 /var/run/hue/hue_krb5_ccache

Thanks,

Pandurang