Created 05-17-2023 01:16 AM
I'm fascinated by Apache Airflow, but I can't operate it locally. Is there anywhere I can test it on the cloud? Almost all of the other posts in this sub are about Airflow/Dagster.
For example, we have replit to experiment with Python and other programming languages; is there a comparable infrastructure for Airflow/Dagster?
Thank You.
Created 05-17-2023 10:41 PM
Hello @Rekha35
Thanks for using Cloudera Community. First, I shall answer the Q from Cloudera's perspective. Cloudera Data Engineering offering (CDE) offers Airflow built-in without any manual intervention. CDE is available on Cloudera Public Cloud & Private Cloud offering. The integration with other Platform Services is Seamless & offers an immersive experience to End-Users looking to explore Airflow. Note that your Team can integrate with an External Airflow [2] as well.
Considering your ask was with checking out Airflow, You may try out [3], wherein the "Astronomer Apache Airflow Fundamentals Certification" offers the best starting point (Including Installing Locally). The Course is led by the foremost Airflow Instructor Marc Lamberti & helps anyone delve into Airflow seamlessly. Additionally, You asked about checking Airflow on Cloud owing to having issues with deploying the same locally. Each Cloud Provider (AWS, Azure, GCP) offers a Managed Service for Airflow.
Hope your Q has been addressed by us. Feel free to share any further ask.
Regards, Smarak
Created 05-17-2023 01:56 AM
@Rekha35, Welcome to our community! To help you get the best possible answer, I have tagged our Airflow experts @sunile_manjee who may be able to assist you further.
Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.
Regards,
Vidya Sargur,Created 05-17-2023 10:41 PM
Hello @Rekha35
Thanks for using Cloudera Community. First, I shall answer the Q from Cloudera's perspective. Cloudera Data Engineering offering (CDE) offers Airflow built-in without any manual intervention. CDE is available on Cloudera Public Cloud & Private Cloud offering. The integration with other Platform Services is Seamless & offers an immersive experience to End-Users looking to explore Airflow. Note that your Team can integrate with an External Airflow [2] as well.
Considering your ask was with checking out Airflow, You may try out [3], wherein the "Astronomer Apache Airflow Fundamentals Certification" offers the best starting point (Including Installing Locally). The Course is led by the foremost Airflow Instructor Marc Lamberti & helps anyone delve into Airflow seamlessly. Additionally, You asked about checking Airflow on Cloud owing to having issues with deploying the same locally. Each Cloud Provider (AWS, Azure, GCP) offers a Managed Service for Airflow.
Hope your Q has been addressed by us. Feel free to share any further ask.
Regards, Smarak