- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Nifi does not schedule Processor itself.
- Labels:
-
Apache NiFi
Created on ‎02-27-2017 12:07 PM - edited ‎08-19-2019 02:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We have to read a text file and transfer rows to kafka.
TailFile SCHEDULING like following ;
Scheduling Strategy => Timer driven
Run Schedule => 10 sec ( also we have tried 1 min )
When we stop and start TailFile processor works fine.
Nifi does not schedule TailFile job ( maybe all processors ) itself.
Where schould be controlled ?
Created ‎02-27-2017 11:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello @Faruk Berksoz
In the screenshot, TailFile Task/Time is shown as 30 (times) in the last 5 min (300 secs). If you scheduled TailFile to run every 10 sec, I think the stats is correct. It seems TailFile is scheduled correctly but there hasn't been new lines found so no FlowFile is produced by TailFile.
When new lines are added to the file that being watched by the TailFile, those will be picked up by TailFile and passed to PublishKafka.
If you're sure that new lines are appended but not seeing any data is ingested to NiFi, then please elaborate the issue.
Regards,
Koji
Created ‎02-27-2017 11:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello @Faruk Berksoz
In the screenshot, TailFile Task/Time is shown as 30 (times) in the last 5 min (300 secs). If you scheduled TailFile to run every 10 sec, I think the stats is correct. It seems TailFile is scheduled correctly but there hasn't been new lines found so no FlowFile is produced by TailFile.
When new lines are added to the file that being watched by the TailFile, those will be picked up by TailFile and passed to PublishKafka.
If you're sure that new lines are appended but not seeing any data is ingested to NiFi, then please elaborate the issue.
Regards,
Koji
