question Re: Is there a way to group nodes in a cluster and use it with a Remote Process Group? in Archives of Support Questions (Read Only)

Is there a way to group nodes in a cluster and use it with a Remote Process Group?

jfeoks-java — Fri, 16 Sep 2022 13:17:59 GMT

Hi!

Please advise for our case.
We have three separate networks that would perform SNMP integration with devices. The main limitation is that NiFi node in one network can't access to devices in another network. SNMP integration scheme is provided in the picture.
In our view, "Extract IP’s From Provided Ranges" is performing only on the Master node and then through Remote Process Groups would pass IP ranges to nodes in separated networks and then execute an extraction logic. Is there a way to send the task to particular node group?

Thank you!

Re: Is there a way to group nodes in a cluster and use it with a Remote Process Group?

MattWho — Tue, 05 Jun 2018 00:34:14 GMT

@Artem Anokhin

No matter which host URL(s) you use in the configuration of an Remote Process Group (RPG). the RPG will ned up retrieving site-to-site (S2S) details that include all the currently connected nodes in the target cluster.

Included in those S2S details are things like:

1. Hostname of each node - defined by "nifi.remote.input.host= " configured on each node.

2. If "Raw" transport protocol is supported - defined by this property "nifi.remote.input.socket.port=" being set.

3. if "HTTP" transport protocol is supported - defined by this property "nifi.remote.input.http.enabled=" being set to true or false

4. If S2S connection is secure - defined by "nifi.remote.input.secure=" being set to true or false

There is no way to create "node groups" that would only be returned to a source NiFi during the retrieve S2S details phase of communications.

Thank you,

Matt

Re: Is there a way to group nodes in a cluster and use it with a Remote Process Group?

jfeoks-java — Tue, 05 Jun 2018 15:29:29 GMT

Matt Clarke, Thank you!

Re: Is there a way to group nodes in a cluster and use it with a Remote Process Group?

MattWho — Tue, 05 Jun 2018 20:57:59 GMT

@Artem Anokhin

If you found this Answer addressed your original question, please take a moment to login and click "Accept" below the answer.

*** Forum tip: Pleasse try to avoid responding to an Answer by starting a new answer. Instead use the "add comment" tp respond to en existing answer. There is no guaranteed order to different answers which can make following a response thread difficult especially when multiple people are trying to assist you.