Member since
02-01-2022
273
Posts
97
Kudos Received
60
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
60 | 05-15-2025 05:45 AM | |
2765 | 06-12-2024 06:43 AM | |
4728 | 04-12-2024 06:05 AM | |
3106 | 12-07-2023 04:50 AM | |
1741 | 12-05-2023 06:22 AM |
05-15-2025
05:45 AM
1 Kudo
@brajs Yes, it is possible to make custom flow analysis rules. This is still tech preview in nifi 2.0 so documentation is limited. I would recommend to take a look at some existing rules, tear them down to source code, modify to suit, and build and package your custom rules. Once you have a new rules nar file, just deliver it to the nifi /lib location and it should be available to use.
... View more
02-20-2025
06:31 AM
I just know from many years of setting up ranger within ambari with usersync. I doubt current CDP docs will strictly call it out.
... View more
02-20-2025
06:00 AM
@drewski7 Yes, UserSync is Required. Please see docs: https://docs.cloudera.com/cdp-private-cloud-base/7.3.1/security-ranger-user-management/topics/security-ranger-configure-adv-usersync-freeipa.html You can take the top arrow on the version to make sure its your correct version.
... View more
12-03-2024
05:24 AM
1 Kudo
@mikecolux Can you include a screenshot of how the List/FetchSFTP processors are configured?
... View more
09-25-2024
07:46 AM
@jasonjojo Check out trycloudera.com... These are trials for CDP Public Cloud which will give you a great chance to see what the new Cloudera looks like. TL;DR; its not hadoop anymore.
... View more
09-10-2024
06:42 AM
2 Kudos
Below is a blog post for a flow i made using the nifi api, which will accept a template (XML), load the template, get template, then follow chain of api calls to get the appropriate flow definiton file (JSON). https://cldr-steven-matison.github.io/blog/dataflow-xml-to-json/ The concepts you need to understand are demonstrated with invokeHttp to execute the sample calls. Check the nifi api docs. You can do these calls with curl, etc., but i chose to do them in nifi. Be mindful that to start using the api from outside of nifi, you need to be following the initial api call for an access token to be used with the rest of the calls.
... View more
09-10-2024
05:52 AM
1 Kudo
@DataEngineer07 This seems like something external interrupting this process (ie:InterruptedException). I would try a separate nifi instance with updated version to test basic connectivty to Azure Event Hub. That will confirm if its something specific to that original host or nifi version/config. Considering the port difference you notice, i would also investigate that on the affected host as well (proxy or other).
... View more
08-29-2024
05:12 AM
1 Kudo
@moshell281 This is indeed a very tough solution to solve. The only thing that comes to mind is creating your own schema, versus inferring the schema. Creating that schema from scratch could be a long task. So one trick you can do would be to run the flow to infer the schema, and configure the controller service to write that schema to an attribute. Inspect a flowfile and grab that schema. Next modify the schema to suit your needs, and then modify and test the flow with the specified schema (no longer inferred). This should allow you control to specify the correct data type for "000" so it is not assumed to be "0".
... View more
07-08-2024
05:57 AM
@ehehtenandayo your Hive Metastore URI should look like "thirft://<Hive Metastore host>:9083." Note that hive meta store host is not the same as the hive server host. You can usually locate the correct thrift string in the hive-site.xml as such: <property> <name>hive.metastore.uris</name> <value>thrift://host1.cloudera.site:9083,thrift://host2.cloudera.site:9083</value> </property>
... View more
06-12-2024
07:49 AM
3 Kudos
Appreciate the positive feedback, but i differ to @MattWho. He had already reached out on your behalf. This is beauty of the community here, we are all friends working toward common goals. :high five: To be clear, 2.0 is not officially ready for prime time, so you need to be careful with expectations and vigilant with your own evaluation and testing. You also need to be ready with process to upgrade to the next version(s) as they come out.
... View more