Created on 02-27-2017 12:07 PM - edited 08-19-2019 02:57 AM
We have to read a text file and transfer rows to kafka.
TailFile SCHEDULING like following ;
Scheduling Strategy => Timer driven
Run Schedule => 10 sec ( also we have tried 1 min )
When we stop and start TailFile processor works fine.
Nifi does not schedule TailFile job ( maybe all processors ) itself.
Where schould be controlled ?
Created 02-27-2017 11:41 PM
Hello @Faruk Berksoz
In the screenshot, TailFile Task/Time is shown as 30 (times) in the last 5 min (300 secs). If you scheduled TailFile to run every 10 sec, I think the stats is correct. It seems TailFile is scheduled correctly but there hasn't been new lines found so no FlowFile is produced by TailFile.
When new lines are added to the file that being watched by the TailFile, those will be picked up by TailFile and passed to PublishKafka.
If you're sure that new lines are appended but not seeing any data is ingested to NiFi, then please elaborate the issue.
Regards,
Koji
Created 02-27-2017 11:41 PM
Hello @Faruk Berksoz
In the screenshot, TailFile Task/Time is shown as 30 (times) in the last 5 min (300 secs). If you scheduled TailFile to run every 10 sec, I think the stats is correct. It seems TailFile is scheduled correctly but there hasn't been new lines found so no FlowFile is produced by TailFile.
When new lines are added to the file that being watched by the TailFile, those will be picked up by TailFile and passed to PublishKafka.
If you're sure that new lines are appended but not seeing any data is ingested to NiFi, then please elaborate the issue.
Regards,
Koji