Member since
04-08-2020
8
Posts
0
Kudos Received
0
Solutions
06-04-2021
10:11 AM
After following the instructions to setup a secured nifi connected to a secured nifi registry I was able to successfully create a single node setup following the instructions: Setting Up a Secure NiFi to Integrate with a Secure NiFi Registry However, now I need to do the same setup on a nifi cluster. Can anyone help to to understand how to do that? The part that says: "Copy the keystore, nifi.properties and trustore to the conf directory of your NiFi install." On a cluster, that means I need to copy the keystore and trustore files generated initially on the registry to each node? or each node will have its own truststore.jks, keystore.jks ? And what about if I need to setup 2 nifi cluster environments: dev and prod ? lets say 2 nodes each of them.. should copy those files to different environments as well ?
... View more
Labels:
- Labels:
-
NiFi Registry
03-29-2021
03:02 PM
Ok just found the solution: Stop processor -> right-click -> view state -> Clear State
... View more
03-27-2021
11:53 AM
I'm using this processor with "Tracking Timestamps" strategy. Is there a way to restart the listing from scratch, instead of listing from the last 'timestamp'? Thanks in advance
... View more
Labels:
- Labels:
-
Apache NiFi
03-27-2021
11:50 AM
No yet. We decided to move out ConsumeAzureEventhub because of this issue
... View more
12-29-2020
06:43 AM
Hi ! I was able to setup ConsumeAzureEventhub, and seems to work fine after a fresh configuration We have an azure eventhub with 4 partitions. The consumer is a nifi 2 node cluster, on which ConsumeAzureEventhub processor is set up to run on "primary node" After the initial setup with a fresh "Storage Container Name" all seems to work fine. All new events are processed, and if I manual start/stop the processor it works ok without repeating events, so connection to storage checkpoint seems to work as expected. However after several days, if nifi is restarted or primary node rotated, sometimes the ConsumeAzureEventhub do not reads new events from the queue. The only workaround we found is setting up a new container (or delete contents of the existing one) which it solves the initial problem but we get a set of events again (repeated) We are using nifi version 1.11.4 The current configuration looks like the attached screenshot I would appreciate any help with this setup Thanks in advance!
... View more
Labels:
- Labels:
-
Apache NiFi
04-08-2020
02:09 PM
After following those nice articles, I was able to setup nify + nifi-regristry secured by sharing (copying) the keystore, nifi.properties and truststore files from nifi to nifi-registry conf directory
https://community.cloudera.com/t5/Community-Articles/Setting-Up-a-Secure-NiFi-to-Integrate-with-a-Secure-NiFi/tac-p/293536#M5807
https://community.cloudera.com/t5/Community-Articles/Setting-Up-a-Secure-Apache-NiFi-Registry/ta-p/247753
Now I need to setup another nifi instance (testing environment) on a different server but connected to the same nifi registry. The idea is to create the flows on testing nifi and then commit and pull from prod. I generate the keystore and truststore files using the nifi-toolkit I will have other credentials so this nifi instance is not authenticated on nifi registry. How can I grant access to the new nifi installation ? Or should I copy the security output to the new nifi server and share the same credentials?
Thanks in advance !
... View more
Labels:
- Labels:
-
Apache NiFi
04-08-2020
11:36 AM
Very useful the blog post ! How is possible to connect multiple nifi environments (like dev, testing, prod) to a single (secured nifi-registry)? Based on this example you copied keystore, nifi.properties and trustore from nifi-registry to nify. How can I do if my different nifi instances are already configured and have different keystore / truststore ? Thanks !
... View more