Spark in Yarn mode gives error when installed in kerberized cluster

[#1]

Hi ,

I am using CDH 5.2 on RHEL 6.5

I am trying to install spark in yarn mode in kerberized environment.

But it fails on the 3 rd step when it tries to upload the jars after creating history server and user dir.

+ echo 'Using /var/run/cloudera-scm-agent/process/295-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand as conf dir'
+ echo 'Using scripts/control.sh as process script'
+ export COMMON_SCRIPT=/usr/lib64/cmf/service/common/cloudera-config.sh
+ COMMON_SCRIPT=/usr/lib64/cmf/service/common/cloudera-config.sh
+ chmod u+x /var/run/cloudera-scm-agent/process/295-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/scripts/control.sh
+ exec /var/run/cloudera-scm-agent/process/295-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/scripts/control.sh upload_jar
Thu Jan 22 10:41:50 EST 2015
Thu Jan 22 10:41:50 EST 2015: Detected CDH_VERSION of [5]
Thu Jan 22 10:41:50 EST 2015: Uploading Spark assembly jar to '/user/spark/share/lib/spark-assembly.jar' on CDH 5 cluster
+ export SCM_KERBEROS_PRINCIPAL=spark/itsusmpl00512.xxx.com@CDH5.xxx.COM
+ SCM_KERBEROS_PRINCIPAL=spark/itsusmpl00512.xxx.com@CDH5.xxx.COM
+ acquire_kerberos_tgt spark_on_yarn.keytab
+ '[' -z spark_on_yarn.keytab ']'
+ '[' -n spark/itsusmpl00512.xxx.com@CDH5.xxx.COM ']'
+ '[' -d /usr/kerberos/bin ']'
+ which kinit
+ '[' 0 -ne 0 ']'
++ id -u
+ export KRB5CCNAME=/var/run/cloudera-scm-agent/process/295-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/krb5cc_481
+ KRB5CCNAME=/var/run/cloudera-scm-agent/process/295-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/krb5cc_481
+ echo 'using spark/itsusmpl00512.jnj.com@CDH5.JNJ.COM as Kerberos principal'
+ echo 'using /var/run/cloudera-scm-agent/process/295-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/krb5cc_481 as Kerberos ticket cache'
+ kinit -c /var/run/cloudera-scm-agent/process/295-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/krb5cc_481 -kt /var/run/cloudera-scm-agent/process/295-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/spark_on_yarn.keytab spark/itsusmpl00512.xxx.com@CDH5.xxx.COM
kinit: Cannot resolve network address for KDC in realm "CDH5.xxx.COM" while getting initial credentials
+ '[' 1 -ne 0 ']'
+ echo 'kinit was not successful.'
+ exit 1

[#2 · Accepted solution]

I was able to resolve this,

I changed a property in krb5.conf

dns_lookup_kdc=true

I was getting an error in creating KDC initial credentials.By changing this property from false to true i was able to install spark on secure kerberized with sentry cluster.

[#3]

Thank you for letting us know the solution.  🙂