I'm trying to investigate how to submit spark jobs in a kerberized cluster,
I understood that I need to user keytab file to authenticate when executing the job.
I submitted the job like that:
spark-submit --master yarn --conf spark.yarn.keytab=/tmp/cdhuser.keytab --conf spark.yarn.principal=cdhuser --class com.bezeqint.DNS_Loader.AppTest hdfs://masternode1:8020/path/to/jar_file.jar
and I get the following error:
org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS]
and that although I did authenticate with kerberos..
Did I miss something?