Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Schedule Spark2 job via Oozie at regular intervals in HDP2.6.4

New Contributor

I have gone through the scheduling spark2 submit action in oozie for HDP2.6.4 documentation (https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_spark-component-guide/content/ch_oozie-spark-action.html). Any idea how do I set the frequency in here, like trigger every 10 minutes etc, because I do not see any coordinator-apps tag

2 REPLIES 2

@S Ph

You could create and configure a coordinator to schedule recurring jobs manually. But there is an easier way to configure using the workflow management design tool. Please check the documentation here:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_workflow-management/content/sect_create_...

You access Workflow Manager (WFM) as an Ambari View. View is not available by default, you need to add it. You can review the steps to add it here:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_workflow-management/content/config_wfm_v...

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

@S Ph Please let me know the above has helped answer your question. Thanks.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.