Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Multiple processes in minifi on Windows

Multiple processes in minifi on Windows

Contributor

It appears from what I've looked at so far that we can convert only one process group to a YAML file and have minifi process it. We are planning on trying to use minifi to run a few different custom build conversion applications that are unrelated to one another and then ship the data to nifi. Is it possible to have multiple process groups being processed by minifi (or multiple minifi instances running on the same server)? Or do I just bundle process groups into one larger process group convert that and have it run on minifi on Windows?

4 REPLIES 4

Re: Multiple processes in minifi on Windows

Contributor

Well, perhaps I should read the quick start guide that happy indicates that minifi doesn't support process groups. So, where does that leave me? Only one process group to run a few unrelated applications in one massive scary mess? I get that minifi isn't supposed to be nifi....but....now what?

Highlighted

Re: Multiple processes in minifi on Windows

Super Collaborator

@Jeff Watson

I do not see why you cannot create the single process group that contains all of your processors necessary for windows. You just need to build the data flows and paste them together into one. Also try using a group inside of a group. Then just export the parent group. I also recommend using a common output and input port into NiFI where possible as this will make it more uniform. I can see where one might think a bunch of processors, multiple data flows, multiple input and outputs for minifi in a single group can be messy, but there is nothing wrong with this if it works.

Re: Multiple processes in minifi on Windows

Contributor

When I finally started building it last night that idea finally dawned on me. Thanks for the confirmation. And pretty colored boxes (labels) to segregate the flows visually to make it a little less confusing.

Re: Multiple processes in minifi on Windows

Super Collaborator

accept answer pls...

When you get deep into nifi, its possible to have hundreds of processors, have fun with it, and be happy not writing code to do the same jobs...

Don't have an account?
Coming from Hortonworks? Activate your account here