question Re: Generateflow file not genarating flow files in Support Questions

Generateflow file not genarating flow files

bhara — Fri, 30 Jun 2017 21:58:49 GMT

Hi ,

I am trying to generate a sample flow file using generateflowfile processor . i have scheduled it for 5 secs . i don't see any file getting generated . Does this need any additional grants . please find the screenshot of the properties .

sample flow :-

Re: Generateflow file not genarating flow files

Schandhok — Fri, 30 Jun 2017 22:09:48 GMT

@Bharadwaj Bhimavarapu There are no attachments to the question. Can you please check again? Do you see any error message on the processor or in the bulletin board, or in nifi-app.log?

Re: Generateflow file not genarating flow files

bhara — Fri, 30 Jun 2017 22:18:30 GMT

@Shashank Chandhok for some reason i am not able to upload . But its an simple generateflowfile processor . I don't see any errors neither in bulliton board nor in app logs .

Re: Generateflow file not genarating flow files

bhara — Fri, 30 Jun 2017 22:21:50 GMT

capture.png capture1.png

Re: Generateflow file not genarating flow files

MattWho — Fri, 30 Jun 2017 22:43:51 GMT

@Bharadwaj Bhimavarapu

Can you also share a screenshot of your GenerateFlowFile "scheduling" and "settings" tabs as well. Is this the only flow on your graph? Anything odd in the nifi-app.log when you start the processor?

Re: Generateflow file not genarating flow files

bhara — Fri, 30 Jun 2017 22:59:26 GMT

@Matt Clarke

Please find the screen shots attached. I don'tcapture3.png capture4.png see any thing in app.logs about this processor .

Re: Generateflow file not genarating flow files

Wynner — Sun, 18 Aug 2019 00:52:41 GMT

@Bharadwaj Bhimavarapu

If you want to have the processor run every 5 seconds, then you would set that using property "Run Schedule" under the Schedule tab like this

Re: Generateflow file not genarating flow files

bhara — Fri, 30 Jun 2017 23:57:38 GMT

@Wynner after making the change also .. i dont see any flowfiles getting genarated .

Re: Generateflow file not genarating flow files

MattWho — Sun, 18 Aug 2019 00:52:33 GMT

@Bharadwaj Bhimavarapu

Along the menu bar at the top of the NiFi UI is there is a field that shows the current number of active threads in your NiFi.

Is this a standalone NIFi install or a multi-node NIFi cluster?

Under "Controller Settings" found within the hamburger menu in the upper right corner of the UI, What do you have configured for "Maximum Timer Driven Thread Count" and " Maximum Event Driven Thread Count"?

I am wondering if you have some other processors in your NIFi holding all your available threads so this processor cannot get one.

Thanks,

Matt

Re: Generateflow file not genarating flow files

bhara — Tue, 04 Jul 2017 02:46:22 GMT

@Matt Clarke

Do we have any caluclation on how to set those numbers .

Re: Generateflow file not genarating flow files

MattWho — Thu, 06 Jul 2017 01:48:58 GMT

@Bharadwaj Bhimavarapu

General guidance here is these values should be set to 2 times the number of available cores and no more then 4 times the number of available cores on a single instance of NiFi. If you are running a NiFi cluster, these values are enforced per node. So a setting of 16 in a 4 node cluster equates to a total of 64 threads cross the cluster. Setting values to high just results in many more threads in cpu wait and will not help performance at all.

Beyond increasing these value you need to be mindful of how many concurrent task you assign each of your processors. Some processor are more cpu intensive then others (meaning they take longer to complete a job holding the thread much longer). You can look at the "tasks/time =: stats on a processor to see if it thread are long or short running. For processors that have long running threads you want to be extra careful on how many concurrent tasks you assign them.

Thanks,

Matt