question Re: Where can I test Apache Airflow without installing it locally? in Support Questions

Where can I test Apache Airflow without installing it locally?

Rekha35 — Wed, 17 May 2023 08:16:52 GMT

I'm fascinated by Apache Airflow, but I can't operate it locally. Is there anywhere I can test it on the cloud? Almost all of the other posts in this sub are about Airflow/Dagster.

For example, we have replit to experiment with Python and other programming languages; is there a comparable infrastructure for Airflow/Dagster?

Thank You.

Re: Where can I test Apache Airflow without installing it locally?

VidyaSargur — Wed, 17 May 2023 08:56:06 GMT

@Rekha35, Welcome to our community! To help you get the best possible answer, I have tagged our Airflow experts @sunile_manjee who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.

Re: Where can I test Apache Airflow without installing it locally?

smdas — Thu, 18 May 2023 05:41:30 GMT

Hello @Rekha35

Thanks for using Cloudera Community. First, I shall answer the Q from Cloudera's perspective. Cloudera Data Engineering offering (CDE) offers Airflow built-in without any manual intervention. CDE is available on Cloudera Public Cloud & Private Cloud offering. The integration with other Platform Services is Seamless & offers an immersive experience to End-Users looking to explore Airflow. Note that your Team can integrate with an External Airflow [2] as well.

Considering your ask was with checking out Airflow, You may try out [3], wherein the "Astronomer Apache Airflow Fundamentals Certification" offers the best starting point (Including Installing Locally). The Course is led by the foremost Airflow Instructor Marc Lamberti & helps anyone delve into Airflow seamlessly. Additionally, You asked about checking Airflow on Cloud owing to having issues with deploying the same locally. Each Cloud Provider (AWS, Azure, GCP) offers a Managed Service for Airflow.

Hope your Q has been addressed by us. Feel free to share any further ask.

Regards, Smarak

[1] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-dag-pipeline.html

[2] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-provider.html?

[3] https://www.astronomer.io/certification/