Hello @RamaClouder  Hope you have Synced with Cloudera Sales Team [0] & have no further ask. To Sum up of the Post, Cloudera offers Unified Governance within the Platform on Public, Private & Hybrid Cloud Setup. The Link [1] has relevant Doc/Videos Link for further Understanding.  If you have any further ask, Feel free to post in our Community & We shall get back to you accordingly.  - Smarak [0] https://www.cloudera.com/contact-sales.html [1] https://www.cloudera.com/products/cloudera-data-platform/sdx.html  ... View more

Hello @ipson  Thanks for using Cloudera Community.  To the Q, Kindly use "dfworkload" Commands [1]. The concerned Command has the Sub-Command to address the requirement of fetching Definition & Configurations. If any of the requirement isn't met via [1], Kindly Submit a Support Case for us to get the same included in the CLI with the Collaboration of DFX Engineering. - Smarak [1] https://cloudera.github.io/cdp-dev-docs/cli-docs/dfworkload/index.html  ... View more

Hello @Ging  Thanks for engaging Cloudera Community. Based on the Post, Your Team is seeing Resource Allocation Issues with Jobs remaining in Waiting State even if available resources & believe the Issue is linked with YuniKorn as the Issue is being observed after Upgrade to CDE v1.20.3.  To your Q, Please find the requested details below: (I) YuniKorn UI: YuniKorn UI is available via CDE UI > Administration > CDE Service "Service Details" > Resource Scheduler (II) For any assumed Issue with YuniKorn, Always Capture the YuniKorn StateDump [1] while the Issue is being Observed. This is Extremely Important as YuniKorn StateDump is Realtime & doesn't help, if the StateDump is captured while the Issue isn't being observed. (III) Collect the YuniKorn Scheduler & YuniKorn Admission Controller Pod Logs in YuniKorn Namespace while the Issue is happening. (IV) Attempt a Restart of YuniKorn Scheduler to confirm if the Issue persists after Capturing all above Info. If Yes i.e. Issue persists, Engage Cloudera Support with the StateDump, Pod Logs & Job Event Log, showing the Job being Stuck in Waiting. Hope the above answers your ask.  - Smarak [1] https://yunikorn.apache.org/docs/1.3.0/user_guide/troubleshooting/#obtain-full-state-dump  ... View more

Hello @Rekha35    Thanks for using Cloudera Community. First, I shall answer the Q from Cloudera's perspective. Cloudera Data Engineering offering (CDE) offers Airflow built-in without any manual intervention. CDE is available on Cloudera Public Cloud & Private Cloud offering. The integration with other Platform Services is Seamless & offers an immersive experience to End-Users looking to explore Airflow. Note that your Team can integrate with an External Airflow [2] as well.    Considering your ask was with checking out Airflow, You may try out [3], wherein the "Astronomer Apache Airflow Fundamentals Certification" offers the best starting point (Including Installing Locally). The Course is led by the foremost Airflow Instructor Marc Lamberti & helps anyone delve into Airflow seamlessly. Additionally, You asked about checking Airflow on Cloud owing to having issues with deploying the same locally. Each Cloud Provider (AWS, Azure, GCP) offers a Managed Service for Airflow.    Hope your Q has been addressed by us. Feel free to share any further ask.    Regards, Smarak     [1] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-dag-pipeline.html  [2] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-provider.html?  [3] https://www.astronomer.io/certification/  ... View more

Hello @RammiSE    Your Post is being replied a bit late, yet I am posting a response anyways. Assuming your Team has resolved the Issue, Appreciate your Team sharing the details in the Post for wider audience.    For HMaster to be Initialised, "hbase:meta" & "hbase:namespace" Table Region needs to be Online. In your previous thread, the HMaster is reporting "hbase:meta" isn't Online [1]. As such, Use the HBCK2 JAR to assign the "hbase:meta" Region "1588230740" first & review (Via HBase UI) whether Regions are being assigned successfully. It's feasible the "hbase:namespace" Table Region would also reporting similar tracing, in which case your Team needs to use HBCK2 JAR to assign the "hbase:namespace" Region. Restarting HMaster after manually performing HBCK2 Assign isn't required always, yet the same won't harm as well.    Regards, Smarak   [1]  2023-01-23 16:05:34,990 WARN [master/ctrlsu-hbaseMS:16000:becomeActiveMaster] master.HMaster: hbase:meta,,1.1588230740 is NOT online; state={1588230740 state=OPEN, ts=1674468867063, server=hadoop-datanode2,16020,1674362337687}; ServerCrashProcedures=true. Master startup cannot progress, in holding-pattern until region onlined   ... View more

Hello @moment    Thanks for using Cloudera Community. Based on the Post, CM Agent Setup fails with "Unsupported RHEL Release". The same is feasible if the OS used by Customer isn't Compatible or Supported with the Cloudera Manager/CDP Release. Review Support Matrix [1] & ensure the OS used is Compatible based on the Cloudera Manager/CDP Release being used by your Team.    Regards, Smarak   [1] https://supportmatrix.cloudera.com/  ... View more

Hello @Ivoz    Thanks for using Cloudera Community. Kindly refer [1] for PowerScale Compatibility with CDP Stack. As per [1], CDP v7.1.7SP1 would support PowerScale 9.2, 9.3. As such, Your team can proceed with 9.2 without any concerns.    Regards, Smarak   [1] Third-party filesystem support: Dell EMC PowerScale (cloudera.com)  ... View more

Hello @josr89    Thanks for using Cloudera Community. You have mentioned Hadoop 3.1.1 & I am assuming you aren't referring to any HDP/CDH (Legacy) or CDP Platforms.   The Steps to recover Knox Admin Password is more akin to reset of Knox Admin Password & does involve re-provisioning the Certificates and Credentials. This is a fairly risky Operation & we would recommend performing the same with Cloudera Support. The Doc [1] covers the same for your reference.    Regards, Smarak   [1]Change the Master Secret (cloudera.com)  ... View more