Member since
10-18-2018
137
Posts
34
Kudos Received
18
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1517 | 08-08-2024 03:03 AM | |
260 | 08-07-2024 12:57 PM | |
562 | 03-22-2024 08:04 AM | |
1501 | 03-20-2024 01:05 PM | |
1176 | 03-15-2024 03:36 AM |
09-10-2024
06:42 AM
2 Kudos
Below is a blog post for a flow i made using the nifi api, which will accept a template (XML), load the template, get template, then follow chain of api calls to get the appropriate flow definiton file (JSON). https://cldr-steven-matison.github.io/blog/dataflow-xml-to-json/ The concepts you need to understand are demonstrated with invokeHttp to execute the sample calls. Check the nifi api docs. You can do these calls with curl, etc., but i chose to do them in nifi. Be mindful that to start using the api from outside of nifi, you need to be following the initial api call for an access token to be used with the rest of the calls.
... View more
09-04-2024
07:38 AM
1 Kudo
HI @mfhanif, Please check if you have a subscription with us. Our support is accessible only to our subscribed customers. If you are not our customer, please get in touch with our sales team; they will be glad to help you.
... View more
08-23-2024
09:31 PM
2 Kudos
Hi, Welcome to the community. Can you elaborate more on how you want to flatten the input specially when you have multiple arrays with different cardinalities where sometimes you match by index and other (when the array count = 1) you seem to assign to all. Also your sample input seem to have some matching values which makes it ambiguous in figuring which value is being assigned to what array. When I look at the output all I see is two identical objects where all the values seem to match which makes it even more confusing.
... View more
08-19-2024
07:34 AM
1 Kudo
@hadoopranger I am circling back on this. Did you try the steps shared in my previous reply? If yes, let us know how did it go. If you find my reply helpful, You may mark it as the accepted solution. You can also say thanks by clicking on the thumbs up button. V
... View more
08-19-2024
07:28 AM
Hello @wert_1311 Thank you for bringing this to our Community. I see this has already by requested by you here: [0a]https://community.cloudera.com/t5/Support-Questions/Monitor-alert-long-running-Airflow-jobs/m-p/388314/highlight/true#M246627 Did it not help? If not, Please try the following: Airflow has the following metrics that can be used: [0b]https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/logging-monitoring/metrics.html#metric-descriptions For the integration, I'd suggest you explore the feasibility based on your use-case. For example, the Metrics configuration setup is given here for StatD and OpenTelemetry. [0c] https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/logging-monitoring/metrics.html#metrics-configuration Also, I am citing the third-party apps that may be helpful: [0d] https://github.com/search?q=airflow+prometheus&type=repositories Let us know how it goes. V
... View more
08-08-2024
05:15 AM
1 Kudo
@snm1523 Hello, Thank you for bringing this to our community. I am pleased to share the benefits of considering our CDP Private Cloud. https://docs.cloudera.com/cdp-private-cloud/latest/benefits.html It is unfortunate that I cannot share insights about HPE Ezmeral or make a comparison. However, I am very confident that our Presales-Engineers would love to discuss with you on how you can benefit by using CDP-PvC: https://www.cloudera.com/contact-sales.html Let me know your thoughts on this. Cheers V
... View more
08-08-2024
05:10 AM
1 Kudo
hi @hadoopranger, unfortunately there is no solution for this specific error, I had to use another connection method using another jdbc controller.
... View more
08-08-2024
04:50 AM
1 Kudo
@Alfa6 Excuse me for the delayed update. I am catching up to speed here: In the meantime we would like to be sure that we will have not any regression about our software developed on CDP 7.1.1. I hope you did get a chance to review the Component Versions page on the CDP 7.1.1 vs. 7.1.9. If not already, Please do: CDP 7.1.1 Components Version: https://docs.cloudera.com/runtime/7.1.1/release-notes/topics/rt-runtime-component-versions.html CDP 7.1.9 Components Version: https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/runtime-release-notes/topics/rt-pvc-runtime-component-versions.html Additionally, Since you are concerned about the Backward compatibility, You may want to read the deprecation notices for 7.1.9 too: https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/runtime-release-notes/topics/rt-pvc-deprecated.html Let us know how you plan your CDP upgrade. We are here to help for the hassle-upgrade experience on your CDP! Cheers V
... View more
08-07-2024
12:57 PM
@Shivakuk Thank you for bringing this to our Community. Did you get to review the following Docs for respective role instances. Managing Role Instances https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/managing-clusters/topics/cm-role-instances.html Yarn Resource Manager https://docs.cloudera.com/cdp-private-cloud-base/latest/yarn-high-availability/topics/yarn-resourcemanager-host-migration.html Moving HDFS Roles: https://docs.cloudera.com/documentation/enterprise/5-6-x/topics/admin_nn_migrate_roles.html#concept_w3h_m2l_2r Zookeeper https://docs.cloudera.com/documentation/enterprise/5-8-x/topics/cm_mc_zookeeper_service.html#ReplacingZkServerCM Spark on Yarn: Kindly make sure to take a backup of /etc/spark/conf folder and then proceed with the following: Deleting Role Instance: >Go to CM UI > Spark > Spark History Server Instance >Click Actions > Stop >Click Delete Adding/Configuring New Spark Instance: > Click on add role instances > Select on which host you want to install > Then start the role IMPORTANT: Please ensure to take backup of the working directories of concerned role instances, followed by re-deploying client configurations. Let us know how it goes. Cheers! V
... View more
07-11-2024
01:56 AM
1 Kudo
Hi, @pusintek Did you manage to solve the problem. I have the same message. Couldn't parse an alert list from Infrastructure Prometheus. This happens when the Prometheus is not available, the credentials are wrong or another error is returned. Status Summary Ecs Agent 1 Good Health Ecs Server 1 Good Health Hosts 2 Good Health
... View more