Created 06-29-2018 03:09 PM
Hi guys, Im trying to set up site to site communication using RAW transport, can the nifi.remote.input.host property be set to multiple values i.e a comma seperated list? If not, is there any other way to specify multiple hosts for RAW communication?
Thanks in advance!
Created 07-02-2018 02:24 PM
The remote input host is the hostname that current node will advertise when another NiFi instance asks for information about the cluster, so it can only be one value.
As an example NiFi cluster #1 sending data to NiFi cluster #2... the remote input host is only relevant on cluster #2 here. There will be an Remote Process Group (RPG) on cluster #1 with a URL (or comma separated list of URLS) for cluster #2, it will then ask cluster #2 for cluster information, and cluster #2 will respond with hostnames of the nodes in cluster #2, which will be based off the value of remote input host on each node in cluster #2.
Created 07-02-2018 02:24 PM
The remote input host is the hostname that current node will advertise when another NiFi instance asks for information about the cluster, so it can only be one value.
As an example NiFi cluster #1 sending data to NiFi cluster #2... the remote input host is only relevant on cluster #2 here. There will be an Remote Process Group (RPG) on cluster #1 with a URL (or comma separated list of URLS) for cluster #2, it will then ask cluster #2 for cluster information, and cluster #2 will respond with hostnames of the nodes in cluster #2, which will be based off the value of remote input host on each node in cluster #2.
Created on 07-03-2018 12:54 PM - edited 08-17-2019 05:08 PM
-
Ambari has built in variables for server hostnames. So in NiFi configs within Ambari you would configure the property as follows:
The above will set the hostname properly to the correct unique hostname in the nifi.properties file on each NiFi node.
-
The hostname used should always be for a hostname assigned to the server where NiFi is running.
-
Thanks,
Matt
-
*** Forum tip: Please try to avoid responding to an Answer by starting a new answer. Instead use the "add comment" to respond to en existing answer. There is no guaranteed order to different answers which can make following a response thread difficult especially when multiple people are trying to assist you.
Created 07-03-2018 01:08 PM
perfect, thanks guys!
Created 07-03-2018 08:01 AM
So setting the value for cluster #2, node1 nifi.remote.input.host = node1.hostname, node2 nifi.remote.input.host = node2.hostname etc.. or would it be node1 nifi.remote.input.host = node1.hostname, node2 nifi.remote.input.host = node1.hostname? If its the first case, how do you set this from Ambari UI, as doing so locally gets overwritten by Ambari on Nifi restart
Thanks for your time