Support Questions

Find answers, ask questions, and share your expertise

Where can I test Apache Airflow without installing it locally?

avatar
New Contributor

I'm fascinated by Apache Airflow, but I can't operate it locally. Is there anywhere I can test it on the cloud? Almost all of the other posts in this sub are about Airflow/Dagster.

For example, we have replit to experiment with Python and other programming languages; is there a comparable infrastructure for Airflow/Dagster?

 

Thank You.

1 ACCEPTED SOLUTION

avatar
Super Collaborator

Hello @Rekha35 

 

Thanks for using Cloudera Community. First, I shall answer the Q from Cloudera's perspective. Cloudera Data Engineering offering (CDE) offers Airflow built-in without any manual intervention. CDE is available on Cloudera Public Cloud & Private Cloud offering. The integration with other Platform Services is Seamless & offers an immersive experience to End-Users looking to explore Airflow. Note that your Team can integrate with an External Airflow [2] as well. 

 

Considering your ask was with checking out Airflow, You may try out [3], wherein the "Astronomer Apache Airflow Fundamentals Certification" offers the best starting point (Including Installing Locally). The Course is led by the foremost Airflow Instructor Marc Lamberti & helps anyone delve into Airflow seamlessly. Additionally, You asked about checking Airflow on Cloud owing to having issues with deploying the same locally. Each Cloud Provider (AWS, Azure, GCP) offers a Managed Service for Airflow. 

 

Hope your Q has been addressed by us. Feel free to share any further ask. 

 

Regards, Smarak

 

 

[1] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-dag-pipeli... 

[2] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-provider.h... 

[3] https://www.astronomer.io/certification/ 

View solution in original post

2 REPLIES 2

avatar
Community Manager

@Rekha35, Welcome to our community! To help you get the best possible answer, I have tagged our Airflow experts @sunile_manjee  who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.



Regards,

Vidya Sargur,
Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:

avatar
Super Collaborator

Hello @Rekha35 

 

Thanks for using Cloudera Community. First, I shall answer the Q from Cloudera's perspective. Cloudera Data Engineering offering (CDE) offers Airflow built-in without any manual intervention. CDE is available on Cloudera Public Cloud & Private Cloud offering. The integration with other Platform Services is Seamless & offers an immersive experience to End-Users looking to explore Airflow. Note that your Team can integrate with an External Airflow [2] as well. 

 

Considering your ask was with checking out Airflow, You may try out [3], wherein the "Astronomer Apache Airflow Fundamentals Certification" offers the best starting point (Including Installing Locally). The Course is led by the foremost Airflow Instructor Marc Lamberti & helps anyone delve into Airflow seamlessly. Additionally, You asked about checking Airflow on Cloud owing to having issues with deploying the same locally. Each Cloud Provider (AWS, Azure, GCP) offers a Managed Service for Airflow. 

 

Hope your Q has been addressed by us. Feel free to share any further ask. 

 

Regards, Smarak

 

 

[1] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-dag-pipeli... 

[2] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-provider.h... 

[3] https://www.astronomer.io/certification/