Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Nifi remote process group RAW transport: Can nifi.remote.input.host be set to multiple values?

avatar

Hi guys, Im trying to set up site to site communication using RAW transport, can the nifi.remote.input.host property be set to multiple values i.e a comma seperated list? If not, is there any other way to specify multiple hosts for RAW communication?

Thanks in advance!

1 ACCEPTED SOLUTION

avatar
Master Guru

The remote input host is the hostname that current node will advertise when another NiFi instance asks for information about the cluster, so it can only be one value.

As an example NiFi cluster #1 sending data to NiFi cluster #2... the remote input host is only relevant on cluster #2 here. There will be an Remote Process Group (RPG) on cluster #1 with a URL (or comma separated list of URLS) for cluster #2, it will then ask cluster #2 for cluster information, and cluster #2 will respond with hostnames of the nodes in cluster #2, which will be based off the value of remote input host on each node in cluster #2.

View solution in original post

4 REPLIES 4

avatar
Master Guru

The remote input host is the hostname that current node will advertise when another NiFi instance asks for information about the cluster, so it can only be one value.

As an example NiFi cluster #1 sending data to NiFi cluster #2... the remote input host is only relevant on cluster #2 here. There will be an Remote Process Group (RPG) on cluster #1 with a URL (or comma separated list of URLS) for cluster #2, it will then ask cluster #2 for cluster information, and cluster #2 will respond with hostnames of the nodes in cluster #2, which will be based off the value of remote input host on each node in cluster #2.

avatar
Super Mentor

@philip carey

-

Ambari has built in variables for server hostnames. So in NiFi configs within Ambari you would configure the property as follows:

79384-screen-shot-2018-07-03-at-85032-am.png

The above will set the hostname properly to the correct unique hostname in the nifi.properties file on each NiFi node.

-

The hostname used should always be for a hostname assigned to the server where NiFi is running.

-

Thanks,

Matt

-

*** Forum tip: Please try to avoid responding to an Answer by starting a new answer. Instead use the "add comment" to respond to en existing answer. There is no guaranteed order to different answers which can make following a response thread difficult especially when multiple people are trying to assist you.

avatar

perfect, thanks guys!

avatar

So setting the value for cluster #2, node1 nifi.remote.input.host = node1.hostname, node2 nifi.remote.input.host = node2.hostname etc.. or would it be node1 nifi.remote.input.host = node1.hostname, node2 nifi.remote.input.host = node1.hostname? If its the first case, how do you set this from Ambari UI, as doing so locally gets overwritten by Ambari on Nifi restart

Thanks for your time