I was able to rebuild the Oozie job and make it work, although I really don't know what is different.   I built the job in sequence this time, so that the steps are listed in-sequence in the XML file.   I also built the job steps to reference the lib directory in the job's path. I had previously had success with explicit references, but these didn't seem necessary.   I moved the prepare steps to a point right before they were needed instead of all on the first step. I eliminated the output directory definition for TeraValidate because it doesn't seem to be used. Finally, I let Hue/Oozie choose the defaults for Master and Mode.  I played around with trying to use YARN and cluster, but these didn't work.   My resulting XML (that works) looks like this:   <workflow-app name="TeraGen-TeraSort-TeraValidate" xmlns="uri:oozie:workflow:0.5">   <start to="spark-27f0"/>   <kill name="Kill">     <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>   </kill>   <action name="spark-27f0">     <spark xmlns="uri:oozie:spark-action:0.1">       <job-tracker>${jobTracker}</job-tracker>       <name-node>${nameNode}</name-node>       <prepare>         <delete path="${nameNode}/user/davidw/terasort-benchmark.in"/>       </prepare>       <master>local[*]</master>       <mode>client</mode>       <name>TeraGen</name>         <class>com.github.ehiggs.spark.terasort.TeraGen</class>       <jar>lib/spark-terasort.jar</jar>         <arg>1g</arg>         <arg>/user/davidw/terasort-benchmark.in</arg>     </spark>     <ok to="spark-94fc"/>     <error to="Kill"/>   </action>   <action name="spark-94fc">     <spark xmlns="uri:oozie:spark-action:0.1">       <job-tracker>${jobTracker}</job-tracker>       <name-node>${nameNode}</name-node>       <prepare>         <delete path="${nameNode}/user/davidw/terasort-benchmark.out"/>       </prepare>       <master>local[*]</master>       <mode>client</mode>       <name>TeraSort</name>         <class>com.github.ehiggs.spark.terasort.TeraSort</class>       <jar>lib/spark-terasort.jar</jar>         <arg>/user/davidw/terasort-benchmark.in</arg>         <arg>/user/davidw/terasort-benchmark.out</arg>     </spark>     <ok to="spark-bcf9"/>     <error to="Kill"/>   </action>   <action name="spark-bcf9">     <spark xmlns="uri:oozie:spark-action:0.1">       <job-tracker>${jobTracker}</job-tracker>       <name-node>${nameNode}</name-node>       <master>local[*]</master>       <mode>client</mode>       <name>TeraValidate</name>         <class>com.github.ehiggs.spark.terasort.TeraValidate</class>       <jar>lib/spark-terasort.jar</jar>         <arg>/user/davidw/terasort-benchmark.out</arg>     </spark>     <ok to="End"/>     <error to="Kill"/>   </action>   <end name="End"/> </workflow-app>   ... View more