Member since
04-10-2017
3
Posts
0
Kudos Received
0
Solutions
08-08-2018
09:46 AM
I didn't want to resurrect the old forum thread so I thought it best to make a new one. This relates to this thread: https://community.hortonworks.com/questions/89214/nifi-weird-situation-about-data-provenance.html Wherein the user describes the situation of having multiple provenance events appearing. However, I am right clicking the processor and selecting data provenance from there and still see multiple events. Has anyone seen this behaviour before? It suggests that the component ID is not being applied to the provenance query. I can apply an extra filter manually through the UI to find the specific event I need but I was curious if anyone has experienced this before. Our version of NiFi is 1.4.
... View more
- Tags:
- data
- events
- provenance
04-11-2017
12:52 PM
1 Kudo
@Peter Murray That is one way to configure it. The batching of 50 flow files is how the MonitorActivity processor works, no matter what Scheduling Strategy is implemented. I would change the Scheduling Strategy to Timer driven, and have it run once a minute, with the Threshold Duration to 24 hours, as you suggested.
... View more