Support Questions
Find answers, ask questions, and share your expertise

intergrate Livy with OOzie

intergrate Livy with OOzie

Explorer

Is it possible to integrate Livy with OOzie?

I would like to use the Livy commands to submit the job and also schedule the jobs in OOzie. Is it possible?

What is the difference between Livy and OOzie?

Please let me know,

Thanks,

Narender.

1 REPLY 1

Re: intergrate Livy with OOzie

@narender pasunooti

Have you seen Spark Action Extension in Oozie - https://oozie.apache.org/docs/4.2.0/DG_SparkActionExtension.html. This feature is still new and only a tech preview in HDP 2.5, but that should do what your asking.

Oozie is a workflow scheduler within a Hadoop cluster. Spark Livy is a REST interface for interacting with Apache Spark. There's a nice overview of Livy here - http://www.slideshare.net/HadoopSummit/apache-zeppelin-livy-bringing-multi-tenancy-to-interactive-da....