Member since
02-26-2019
1
Post
0
Kudos Received
0
Solutions
05-01-2019
04:42 AM
Hi, I'm trying to investigate how to submit spark jobs in a kerberized cluster, I understood that I need to user keytab file to authenticate when executing the job. I submitted the job like that: spark-submit --master yarn --conf spark.yarn.keytab=/tmp/cdhuser.keytab --conf spark.yarn.principal=cdhuser --class com.bezeqint.DNS_Loader.AppTest hdfs://masternode1:8020/path/to/jar_file.jar and I get the following error: org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS] and that although I did authenticate with kerberos.. Did I miss something? Thanks, Maor
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache YARN
-
Kerberos