Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How MINIFI receive data from nifi

avatar

Dears,

How Minifi can receive data from nifi.

Thank you in advance.

Best Regards,

Bilel.

1 ACCEPTED SOLUTION

avatar
Super Mentor
@Bilel Boubakri

NiFi's Site-To-Site (S2S) Protocol is most typically used to send data between Nifi instances (This includes between NiFi and MiNiFi).

The below links provide more detail on S2S and how to configure it within NiFi.

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#site-to-site

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Remote_Group_Transmission

https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#site_to_site_properties

If you found that this answer addressed your question, please take a moment to click "Accept" below.

Thank you,

Matt

View solution in original post

5 REPLIES 5

avatar
Super Mentor
@Bilel Boubakri

NiFi's Site-To-Site (S2S) Protocol is most typically used to send data between Nifi instances (This includes between NiFi and MiNiFi).

The below links provide more detail on S2S and how to configure it within NiFi.

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#site-to-site

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Remote_Group_Transmission

https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#site_to_site_properties

If you found that this answer addressed your question, please take a moment to click "Accept" below.

Thank you,

Matt

avatar

Thank you for your response, but if we have many servers on each server minifi installed (all those minifi instances communicate with the same nifi) (one nifi instance).

is-it possible to use the S2S protocol with this architecture?

avatar
Super Mentor

@Bilel Boubakri

If I am understanding correctly, you have many servers that will have MiNiFi installed on them. You then wish to have each of those MiNiFi instances transmit NiFI FlowFiles to a single NiFi instance/cluster. Correct?

If so, this is very doable using NiFI S2S.

The dataflow you build for use on your MiNiFi instances would need an "Remote Process Group" (RPG) configured to send data to a remote input port located on your NiFi instance/cluster.

So in your MiNiFi dataflow you will send your NiFi Flowfiles to a RPG as follows:

39879-screen-shot-2017-10-19-at-94733-am.png

On your NiFi instance/cluster, you will have a remote input port that will accept FlowFiles from these RPGs of all your MiNiFi instances as follows:

39880-screen-shot-2017-10-19-at-94917-am.png

Thank you,

Matt

avatar

Thanks, but this solution is for sending data from minifi to nifi, but i would like sending information from nifi to minifi.

avatar
Super Mentor

@Bilel Boubakri

The same concept applies for sending from NiFi to MiNiFi. The RPG can be used to push Flowfiles (as shown in the above screenshots), but can also be used to pull FlowFiles from a Remote Output port.

39908-screen-shot-2017-10-20-at-123302-pm.png

Thanks,

Matt