Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Different frameworks to automate Hadoop jobs

Highlighted

Different frameworks to automate Hadoop jobs

New Contributor

Hello

What are the different frameworks to automate Hadoop jobs? Which is the best?

Thanks

2 REPLIES 2

Re: Different frameworks to automate Hadoop jobs

Super Collaborator

Your open source options include

Oozie (included with HDP), Luigi, Airflow, and Azkaban.

https://www.bizety.com/2017/06/05/open-source-data-pipeline-luigi-vs-azkaban-vs-oozie-vs-airflow/

NiFi is also capable of scheduling tasks.

An enterprise option includes Stonebranch UAC

"Best" is relative to your needs and who will support it

Re: Different frameworks to automate Hadoop jobs

New Contributor
Don't have an account?
Coming from Hortonworks? Activate your account here