Member since
01-16-2018
602
Posts
46
Kudos Received
100
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
38 | 04-15-2024 12:28 AM | |
48 | 04-15-2024 12:17 AM | |
88 | 04-15-2024 12:04 AM | |
55 | 04-14-2024 11:54 PM | |
67 | 04-14-2024 11:45 PM |
04-16-2024
03:26 AM
1 Kudo
Hello @wert_1311 Thanks for using Cloudera Community. May I know if your Team have used the "--arg" Flags of CDE Job Run Command. The same would meet the requirement. You may run "cde job run --help" to fetch all available Flags. - Smarak
... View more
04-15-2024
06:17 AM
When I run this command via the cdp cli, it just returns a JSON like this: ``` { "archiveName": "[MY_FLOW_NAME].tar.gz" } ``` I want to get the actual flow definition.
... View more
04-15-2024
12:28 AM
1 Kudo
Hello @Faisal_555 @Hai1 The above Error happens for 2 Reasoning majorly: (I) Each Environment creates an Ozone Bucket (When the Environment is Created first) & CDE uses the concerned Ozone Bucket upon being Enabled within the Environment. 1 Top Reason is the Environment was Created when Ozone wasn't Installed or Ozone wasn't Healthy, upon which Ozone Bucket won't be Created. Hence, the Error [1] shows CDE isn't able to fetch the Ozone Info from Env (Wherein "aws_key_id" is reference to Ozone). (II) To rule out the above, Ensure Ozone is Healthy & Create a New Environment, followed by Enabling the CDE Service. This would rule out any issues with Ozone & Environment Bucket. (III) Next, Ensure the "hive" User has Ranger Permission to Create/List Ozone Bucket as documented in [2]. Even if Ozone is Healthy, the Bucket Creation is required & the same is facilitated via "hive" User & Ranger Permission may forbade the same. If the above Action Plan doesn't resolve the Issue, Best to engage Cloudera Support for us to Collaborate further. - Smarak [1] Log: unable to find logging configurations from environment, error: unable to retrieve aws_key_id from the env service [2] https://docs.cloudera.com/cdp-private-cloud-data-services/1.5.3/installation/topics/cdppvc-installation-cdp-data-center.html
... View more
04-15-2024
12:17 AM
1 Kudo
Hello @wert_1311 This is an Old Post, yet I am answering to ensure the Post can be used for future reference. Anytime your Team observe the above Issue, Capture the CDE Diagnostics Bundle covering the Timeframe of Issue (Example Is 2 days In The Screenshot). Next, Restart the Airflow Scheduler Pod by Deleting the Airflow Scheduler Pod, upon which the Airflow Scheduler Pod would be Recreated implicitly. Next, Engage Cloudera Support with the CDE Diagnostics Bundle captured above. Additionally, CDE Airflow has been significantly Scaled-Test in recent releases of CDE & your Team should consider Upgrading CDE to Latest Version as soon as possible. - Smarak [1] https://docs.cloudera.com/data-engineering/cloud/troubleshooting/topics/cde-download-diagnostic-bundle.html
... View more
04-15-2024
12:04 AM
2 Kudos
Hello @Hae AFAIK, Data Connections is a Public Cloud Concept & isn't available in Private Cloud yet. In Public Cloud, [1] shows the Steps to configure Data Connections, which allows you to access the HMS of the DataLake (Unified HMS Source For The Environment). In Private Cloud, You may use the [2] to use Spark on CML. The same has Example on using Spark-On-Yarn on Base Cluster as well as Spark-On-Kubernetes on CML. - Smarak [1] https://docs.cloudera.com/machine-learning/cloud/mlde/topics/ml-mlde-spark-data-connection.html [2] https://docs.cloudera.com/machine-learning/1.5.2/spark/topics/ml-apache-spark-overview.html
... View more
04-14-2024
11:58 PM
1 Kudo
Hello @cirrus Thanks for using Cloudera Community. Kindly share a Screenshot of the UI to help explain your Team's Observation & Confirm the Versioning (Public Vs Private Cloud, CML Version) for us to review internally & get back to you accordingly. - Smarak
... View more
04-14-2024
11:54 PM
1 Kudo
Hello @RamaClouder Hope you have Synced with Cloudera Sales Team [0] & have no further ask. To Sum up of the Post, Cloudera offers Unified Governance within the Platform on Public, Private & Hybrid Cloud Setup. The Link [1] has relevant Doc/Videos Link for further Understanding. If you have any further ask, Feel free to post in our Community & We shall get back to you accordingly. - Smarak [0] https://www.cloudera.com/contact-sales.html [1] https://www.cloudera.com/products/cloudera-data-platform/sdx.html
... View more
04-14-2024
11:47 PM
Hello @Ging We hope the above Post answers your Q. We shall mark the Post as Resolved now. If you have any further Q, Feel free to Comment & We shall get back to you on the same. - Smarak
... View more
10-20-2023
03:27 PM
@Tyrone As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks.
... View more
05-30-2023
03:28 AM
Sorry @Neil_1992 where could I find nifi.service file, to add this property ?
... View more