Hello @cirrus  Greetings from Cloudera Community. This is an Old Post, yet I am posting a response for Wider audiences. CML had a Bug causing PBJ Runtimes not respecting Timeout [1] & the Bug has no Workaround. This Bug is fixed in CML v2.0.47 [2].  Regards, Smarak [1] https://docs.cloudera.com/machine-learning/cloud/site-administration/topics/ml-web-session-timeouts.html  [2] https://docs.cloudera.com/machine-learning/cloud/release-notes/topics/ml-relnotes-2025-01-29.html  ... View more

Hello @AntoniOrdonez  Greetings from Cloudera Support. Kindly Note that EKS Upgrade is handled by the Data Services Upgrade itself. As such, DO NOT perform the EKS Upgrade via Cloud Console or Cloud CLI & allow the EKS Upgrade being managed by Data Services Upgrade. The EKS & CDW Mapping is available [1]. Regards, Smarak [1] https://docs.cloudera.com/data-warehouse/cloud/release-notes/topics/dw-version-map-supported-releases.html  ... View more

Hello @wert_1311  Greetings from Cloudera Support. Based on the Post, Your Team wish to capture the Airflow's DAG Run over the past 3 Months.  The Info is Captured in the Airflow mySQL DB (For Public Cloud). You can connect to the Airflow mySQL DB [1] & Capture the Info from the Metadata Tables for DAG Runs. Note that Caution is recommended while accessing the Metadata Tables to avoid any Undue Changes, which may break the CDE Setup. Regards, Smarak [1] https://community.cloudera.com/t5/Customer/How-to-connect-to-CDE-AirFlow-database-In-CDP-Public-Cloud/ta-p/324309  ... View more

Hello @Knowledgeknow  Thanks for using Cloudera Community. This is an Old Post, yet Wish to convey that Cloudera shall assist with Airflow Issues (Install, Upgrade, Maintenance) dealing with Airflow shipped by Cloudera. Currently, CDE (Cloudera Data Engineering) allows Airflow to be deployed on Public Cloud & Private Cloud with End-To-End Support offered by Cloudera. You haven't shared whether your Q deals with CDE Airflow or Standalone Airflow. If your Post deals with reviewing an Issue with Installing Standalone Airflow which isn't Supported per-se. Henceforth, our engagement would be Limited. For CDE Airflow, the AuthN for Airflow UI is managed implicitly via Single-SignOn (Once your Team is Authenticated to Cloudera Management Console) & doesn't require any manual intervention. For CLI, CDE offers Token Based & Key Based AuthN.  If your Team is interested in CDE Airflow, Let us know & we can get in touch with your Team. - Smarak   ... View more

Hello @mandychen  Thanks for using Cloudera Community. This is an Old Post, yet Wish to convey that Cloudera shall assist with Airflow Issues (Install, Upgrade, Maintenance) dealing with Airflow shipped by Cloudera. Currently, CDE (Cloudera Data Engineering) allows Airflow to be deployed on Public Cloud & Private Cloud with End-To-End Support offered by Cloudera. Your Post deals with reviewing an Issue with Installing Standalone Airflow, which isn't Supported per-se. Henceforth, our engagement would be Limited. However, the Issue is likely linked with JDBC Parsing as discussed in [1]. If your Team is interested in CDE Airflow, Let us know & we can get in touch with your Team.  - Smarak [1] https://github.com/apache/airflow/issues/33442  ... View more

Hello @Mdismaik  Thanks for using Cloudera Community. This is an Old Post, yet Wish to convey that Cloudera shall assist with Airflow Issues (Install, Upgrade, Maintenance) dealing with Airflow shipped by Cloudera. Currently, CDE (Cloudera Data Engineering) allows Airflow to be deployed on Public Cloud & Private Cloud with End-To-End Support offered by Cloudera. Your Post deals with reviewing an Issue with Installing Standalone Airflow on Cloudera Cluster, which isn't Supported per-se. Henceforth, our engagement would be Limited. We did a Sanity Check on the Error internally, yet no Conclusion arrived with few references indicating Possible DB concerns.  If your Team is interested in CDE Airflow, Let us know & we can get in touch with your Team.  - Smarak ... View more

Hello @Rafe  Thanks for engaging Cloudera Community. To your Q, Cloudera recommends Non-Cloud-VMs to be used for CDP Private Cloud Data Services yet your Team can deploy ECS on any Hardware as long as the Hardware/Software Requirement are met as described in our Doc. - Smarak ... View more