Member since
07-30-2019
3471
Posts
1642
Kudos Received
1020
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 146 | 06-03-2026 06:06 PM | |
| 459 | 05-06-2026 09:16 AM | |
| 826 | 05-04-2026 05:20 AM | |
| 495 | 05-01-2026 10:15 AM | |
| 621 | 03-23-2026 05:44 AM |
01-17-2020
01:36 PM
@JamesE This is easy enough do using the splitContent processor: for the "Byte Sequence" property simply hit your spacebar to set a single space. If you found this answer addressed your question, please take a moment to accept to resolve this thread. Hope this helps, Matt
... View more
01-16-2020
10:23 AM
@JamesE The ExtractText processor is used to extract text from the content of the FlowFie using a Java Regular Expression and insert that extracted text in to FlowFile attributes. So using your FlowFile content example here: srcip=10.10.10.10 timestamp=152532431 action="denied" What is your desired end result? Three separate FlowFileAttributes? One for each "word" (srcip, timestamp, and action). Assuming above, you would add three new properties to the ExtractText processor (one for each extracted value) as follows: For each dynamic property added via the "+" icon, The property name becomes the FlowFile attribute name and the resulting string from capture group within the Java regular expression becomes the value assigned to that new FlowFile attribute. Hope this helps, Matt
... View more
01-16-2020
09:36 AM
@justenji That bug was actually introduced through a change that went in to NiFi 1.8 that pushed included the enabled/disabled state to registry. But NiFi registry shipping at that time had not yet been updated to store this new parameter. Do you still see the issue even after upgrading to NiFi-Registry 0.5?
... View more
01-10-2020
05:14 AM
@justenji What version of NiFi-Registry are you using? If the NiFi-Registry version is older then 0.5.0, you will encounter this bug. https://issues.apache.org/jira/browse/NIFI-6025 Hope this helps, Matt
... View more
01-08-2020
05:03 PM
2 Kudos
@VijaySankar Is there a full stack trace that follows the error message in the actual nifi-app.log? Is this a multi-node NiFi cluster that perhaps has multiple Nodes installed and running on the same server? If so, when you start the processor only one node is going to be able to bind to the configured port and the other nodes will throw the exception. Since both nodes are on the same host, the processor will appear as though it is working because the node that did bind will receive the requests. It is also possible that port 9099 is not unused on every host in your NiFi cluster. Since the bulletin you are sharing indicates a specific hostname:port, it is possible that port 9099 is already in use by some other process on that one host. But on your other host(s) it is not in use and binds successfully allowing those host(s) to receive request fine. I recommend stopping the HandleHttpRequest processor and then from command line check to see if there is anything still listening on port 9099. If so, you'll need to use another port that is available on all your NiFi nodes. Hope this helps, Matt
... View more
01-07-2020
01:49 PM
@venu413 If you open the NiFi summary UI (NiFi UI --> Global menu --> Summary), select the connections tab, locate this connection with the 54 queued flowfiles, and then click the cluster connection summary icon ( )to far right, Are all 54 queued FlowFiles on same node? Is anything being logged in the nifi-app.log on that node were these FlowFiles are queued? Any observed errors in nifi-app.log during startup if you restart this node? In your nifi.properties file, what values are configured for these properties: nifi.cluster.load.balance.comms.timeout= nifi.cluster.load.balance.connections.per.node= nifi.cluster.load.balance.host= nifi.cluster.load.balance.max.thread.count= nifi.cluster.load.balance.port= nifi.cluster.node.address= If recommend that both the "nifi.cluster.node.address=" and "nifi.cluster.load.balance.host=" have been configured uniquely per node in your cluster to the resolvable hostname for the given node. So if you node has a hostname of node1.mycompany.com, then this hostname should be used in both these properties in the NiFi running on that host. Restart is needed anytime you edit the nifi.properties file.
... View more
12-27-2019
02:42 PM
1 Kudo
Hello @Former Member Now that you have both NiFi and NiFi-Registry secured they will use TLS to authenticate with one another. NiFi-Registry does not initiate any connections to NiFi. NiFi will always act as the client talking to NiFi-Registry. 1. All 3 of your NiFi nodes must exist as users in the NiFi-Registry. 2. Any users who will be version controlling NiFi process Groups will need to exist as users in NiFi-Registry. 3. Your NiFi nodes must be authorized in NiFi-Registry for "Can proxy user requests" and read for "can manage buckets". Found by clicking on settings in NiFi-Regsitry UI, then selecting Users tab, and clicking pencil to right of each of your NiFi nodes. 4. You users must create a bucket(s) in NiFi-Registry and authorize your NiFi user(s) for read, write, delete on the bucket. From same setting UI click buckets tab, click "add bucket" then using pencil to left of bucket authorize your user(s). 5. From the NiFi UI, click on the global menu (upper right corner) --> Controller Settings --> Registry Clients tab. Click the "+" icon to add a new NiFi-Registry client. Provide the HTTPS://<nifi-regsitry-hostname:port> as the URL and a name of your choosing. Provide the keystores and truststores created for your NiFi and NiFi-Registry can support mutual authentication between these two services, you will be good to go. Otherwise check your nifi and nifi-registry app logs for any TLS handshake errors which would need to be resolved. Hope this helps you get going with NiFi-Registry, Matt
... View more
12-27-2019
02:25 PM
@stevenmatison I don't see any reason why you can not do this. Do NOT put the 1.10 nar in to NiFi's defualt lib directory. Instead create a new custom lib directory by adding a new property to the nifi.properties file: nifi.nar.library.directory.custom1=/<path>/custom-libs Copy the 1.10 parquet nars in to this directory and make sure the permissions and ownership are set correctly for this custom path and libs so that the NiFi service user can access them. Once NiFi is restarted, you should see both versions of the parquet processor available for adding to the NiFi canvas. Note: Adding additional versions of the same nars can make upgrading a bit more challenging. After copying the new nar in to custom nar lib, you now have both 1.9 and 1.10 versions of the NiFi components. Let's say later you upgrade to 1.11 when it becomes available for example. NIFi normally handles upgrading to new versions during startup (1.9 processors upgraded to 1.11), but in you case after upgrade you will have this custom lib nar 1.10 and 1.11 that cam with upgrade. Any 1.9 parquet components from your flow.xml.gz will become ghost processors on the canvas because NiFi does not have a version 1.9 and there are two options (1.10 and 1.11) so it picks neither. You would need to either drop ghost processors and add the 1.10 or 1.11 version in its place or manually edit the flow.xml.gz to change version number manually to desired available version. Hope this helps, Matt
... View more
12-27-2019
07:14 AM
@Former Member Since you are asking a new question unrelated to the question asked in the original subject, I kindly ask that you start a new question. Would be happy to help. Asking multiple questions in one thread makes a thread harder to follow for other users of this community forum. If you feel this question subject has been answered, please accept a solution provided to close out this thread. Thank you, Matt
... View more
12-26-2019
08:38 AM
1 Kudo
@Former Member Make sure you have configured "nifi.registry.security.needClientAuth=false". When not set it defaults to true. NeedClientAuth=true tells NiFi that in the TLS handshake it will "require" client to present a client side certificate. If one is not presented, the connection will just close and NiFi-Registry will never try any other authentication method. This property must be set to false in order for NiFi-Registry to support any authentication method other than TLS. Hope this gets you going, Matt
... View more