Member since
11-12-2018
7
Posts
0
Kudos Received
0
Solutions
07-29-2022
08:31 AM
You can try to configure it like this inside Oozie Spark action: ...
<configuration>
<property>
<name>spark.yarn.keytab</name>
<value>path_to_keytab</value>
</property>
<property>
<name>spark.yarn.principal</name>
<value>principal@REALM.COM </value>
</property>
</configuration>
...
... View more
06-13-2019
05:44 PM
If we add jars in the lib directory of the application root directory, oozie automatically distributing the jars to it's distributed cache. In my case, I have tried to add the jar which is already in the lib directory. So, I just need to remove the below line from my workflow definition. <spark-opts>--jars ${workflowAppUri}/lib/${dependencyJar}</spark-opts> And also I have tested that if you want to attach the jars that are not available in your lib directory, you can mention like below in your workflow definition. <spark-opts>--jars ${nameNode}/tmp/{someJar}</spark-opts>
... View more