question Re: multiple Nifi dataflows together in Archives of Support Questions (Read Only)

multiple Nifi dataflows together

aliyesami — Thu, 01 Sep 2016 03:28:26 GMT

I have a working Nifi dataflow that is pulling the log files and parsing them. Now I want to create a new one doing something else , I don't see any option to save the dataflow , how is it done ? I want to be able to switch between different data flows turning them off when not used.

Re: multiple Nifi dataflows together

bbende — Thu, 01 Sep 2016 03:33:12 GMT

There is only one canvas that can have many logical dataflows. Typically you can organize each logical dataflow into a process group, and then start and stop the whole process group.

Re: multiple Nifi dataflows together

aliyesami — Thu, 01 Sep 2016 03:40:51 GMT

how can I create these "process groups" ?

Re: multiple Nifi dataflows together

MattWho — Mon, 19 Aug 2019 09:43:02 GMT

@Sami Ahmad

Every change you make to the NiFi canvas is immediately saved to the flow.xml.gz file. No need to manually initiate a save.

Each installation of NiFi provides you with a single UI for building a dataflow. You can build as many different dataflow as you want on this canvas. These different dataflows do not need to be connected in any way.

The most common approach to what you are doing is to create a different process group for each of your unique dataflows. To add a new process group to the canvas, drag the process group icon on to the canvas and give it unique name that identifies the dataflow it contains. If you double click on that process group, you will enter it giving you a blank canvas to work with.

So here you can see I have two process groups that are not connected in any way. One contains a dataflow that consists of 6 processors while the other has 89. I can right click on either of these process groups and select either start or stop from the context menu.

That start or stop action is applied against every processor within that process group. so this gives you an easy way to stop one dataflow and start another. You could even have both running at the same time.

Matt

Re: multiple Nifi dataflows together

MattWho — Mon, 19 Aug 2019 09:42:43 GMT

You can also save portions or all of you dataflow in a to NiFi templates that can be exported for use on other NiFi installations. To create a template simply highlight all the components you want in your template (If you highlight a process group, all components within that process group will be added to the template). Then click on the

"create template" icon in the upper middle create your template. The Templates manager UI can be used to export and import these templates from your NiFi. It can be access via this icon in the upper right corner of the NiFi UI. *** Note: NiFi templates are sanitized of any sensitive properties values (A sensitive property value would be any value that would be encrypted. In NiFi that would be any passwords) Matt

Re: multiple Nifi dataflows together

aliyesami — Thu, 01 Sep 2016 03:52:54 GMT

Thanks !

that was helpful . I don't see anywhere "Accept"