Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark2 with Oozie on HDP 2.6

Highlighted

Spark2 with Oozie on HDP 2.6

New Contributor

I am referring to this link https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_spark-component-guide/content/ch_oozie-s... which states in the configuration for HDP 2.6 that "In HDP 2.6, Oozie works with either Spark 1 or Spark 2 (not side-by-side deployments), but Spark 2 support for Oozie Spark action is available as a technical preview; it is not ready for production deployment. Configuration is through manual steps (not Ambari)."

Any idea when this will be production ready as we are too cautious to do this configuration on our Cluster. Is there an alternative way to coordinate various inter-dependant spark 2 jobs apart from oozie workflow?

2 REPLIES 2

Re: Spark2 with Oozie on HDP 2.6

Expert Contributor

Details are not available when it will be production ready.

May be you can execute action in shell/python scripts.

Re: Spark2 with Oozie on HDP 2.6

Expert Contributor

@Guy Vorster, If above information helped you, Could you please accept answer?

Don't have an account?
Coming from Hortonworks? Activate your account here