How MINIFI receive data from nifi

[#1]

Dears,

How Minifi can receive data from nifi.

Thank you in advance.

Best Regards,

Bilel.

[#2 · Accepted solution]

@Bilel Boubakri

NiFi's Site-To-Site (S2S) Protocol is most typically used to send data between Nifi instances (This includes between NiFi and MiNiFi).

The below links provide more detail on S2S and how to configure it within NiFi.

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#site-to-site

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Remote_Group_Transmission

https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#site_to_site_properties

If you found that this answer addressed your question, please take a moment to click "Accept" below.

Thank you,

Matt

[#3]

Thank you for your response, but if we have many servers on each server minifi installed (all those minifi instances communicate with the same nifi) (one nifi instance).

is-it possible to use the S2S protocol with this architecture?

[#4]

@Bilel Boubakri

If I am understanding correctly, you have many servers that will have MiNiFi installed on them. You then wish to have each of those MiNiFi instances transmit NiFI FlowFiles to a single NiFi instance/cluster. Correct?

If so, this is very doable using NiFI S2S.

The dataflow you build for use on your MiNiFi instances would need an "Remote Process Group" (RPG) configured to send data to a remote input port located on your NiFi instance/cluster.

So in your MiNiFi dataflow you will send your NiFi Flowfiles to a RPG as follows:

On your NiFi instance/cluster, you will have a remote input port that will accept FlowFiles from these RPGs of all your MiNiFi instances as follows:

Thank you,

Matt

[#5]

Thanks, but this solution is for sending data from minifi to nifi, but i would like sending information from nifi to minifi.

[#6]

@Bilel Boubakri

The same concept applies for sending from NiFi to MiNiFi. The RPG can be used to push Flowfiles (as shown in the above screenshots), but can also be used to pull FlowFiles from a Remote Output port.

Thanks,

Matt