https://community.cloudera.com/t5/Support-Questions/how-to-trigger-sample-spark-and-pyspark-jobs-using-oozie/m-p/89613#M35170 Fri, 16 Sep 2022 14:20:35 GMT Harish19 2022-09-16T14:20:35Z https://community.cloudera.com/t5/Support-Questions/how-to-trigger-sample-spark-and-pyspark-jobs-using-oozie/m-p/89613#M35170 Fri, 16 Sep 2022 14:20:35 GMT https://community.cloudera.com/t5/Support-Questions/how-to-trigger-sample-spark-and-pyspark-jobs-using-oozie/m-p/89613#M35170 Harish19 2022-09-16T14:20:35Z https://community.cloudera.com/t5/Support-Questions/how-to-trigger-sample-spark-and-pyspark-jobs-using-oozie/m-p/89652#M35171 <P>You can use the Spark Action in Oozie to submit any spark applications:</P><P><A href="https://archive.cloudera.com/cdh5/cdh/5/oozie/DG_SparkActionExtension.html#Spark_Action" target="_blank">https://archive.cloudera.com/cdh5/cdh/5/oozie/DG_SparkActionExtension.html#Spark_Action</A></P><P>&nbsp;</P><P>If you are more familar with spark-submit tool,&nbsp; you can try to use oozie shell action as well:</P><P><A href="https://archive.cloudera.com/cdh5/cdh/5/oozie/DG_ShellActionExtension.html" target="_blank">https://archive.cloudera.com/cdh5/cdh/5/oozie/DG_ShellActionExtension.html</A></P><P>&nbsp;</P><P>You may need to make sure the spark gateway role is deployed on the oozie server and node manager nodes, so that the runtime env always have the depencies available.</P> Sun, 28 Apr 2019 07:12:32 GMT https://community.cloudera.com/t5/Support-Questions/how-to-trigger-sample-spark-and-pyspark-jobs-using-oozie/m-p/89652#M35171 Yuexin Zhang 2019-04-28T07:12:32Z