Created 05-06-2018 09:03 AM
Dears,
I'm using HFD 3.1.0 ,
I ran into a situation in which the processors are running and there are no processed flowfiles between processors
Created on 05-07-2018 03:00 PM - edited 08-18-2019 01:30 AM
thanks @Matt Clarke for your quick response
kindly find my comments :
1-
2-Was the queued data actually on the node from which you provide thread dump? yes
3-How many nodes in your cluster? I have a cluster with one node
4-
Created on 05-07-2018 04:02 PM - edited 08-18-2019 01:30 AM
Still seeing issue now that you restarted with "WriteAheadProvenance" repo?
Are you seeing any log output in the nifi-app.log from your invokeHTTP processor?
How many active threads do you see on the status bar above the canvas in the NiFi UI:
if it is sitting at or close to 20, what does your CPU load look like on your host? If CPU utilization is low, try pushing your Max Timer Driven thread count settings higher. Then check if that change resulted in this thread usage number above for canvas jumped higher.
Created 06-06-2018 07:56 PM
Just wanted to follow-up to see how things are progressing. Still seeing issue?
Did you try any of my suggestions above?
I see no reason for having your invokeHTTP processor scheduled to execute on primary node only since it is being triggered by incoming FlowFiles. If you switch it to "all nodes", do you still see issue?
What do you see when you perform a "List queue" action on the connection feeding your invokeHTTP processor?
Within the "Cluster" UI found under the global menu, who is currently elected as the primary node? Does the data listed when you ran "List queue" belong to that same node?
-
Thank you,
Matt
Created 05-07-2018 12:50 PM
Please do not forget to login and click "accept" at the bottom of whichever answer provided was able to address your original question. This helps user of this forum focus in on the working solutions.
Thank you,
Matt