Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Nifi does not schedule Processor itself.

avatar
Contributor

We have to read a text file and transfer rows to kafka.

13012-kafka-pic-01.png

TailFile SCHEDULING like following ;

Scheduling Strategy => Timer driven

Run Schedule => 10 sec ( also we have tried 1 min )

13013-kafka-pic-02.png

When we stop and start TailFile processor works fine.

Nifi does not schedule TailFile job ( maybe all processors ) itself.

Where schould be controlled ?

1 ACCEPTED SOLUTION

avatar

Hello @Faruk Berksoz

In the screenshot, TailFile Task/Time is shown as 30 (times) in the last 5 min (300 secs). If you scheduled TailFile to run every 10 sec, I think the stats is correct. It seems TailFile is scheduled correctly but there hasn't been new lines found so no FlowFile is produced by TailFile.

When new lines are added to the file that being watched by the TailFile, those will be picked up by TailFile and passed to PublishKafka.

If you're sure that new lines are appended but not seeing any data is ingested to NiFi, then please elaborate the issue.

Regards,

Koji

View solution in original post

1 REPLY 1

avatar

Hello @Faruk Berksoz

In the screenshot, TailFile Task/Time is shown as 30 (times) in the last 5 min (300 secs). If you scheduled TailFile to run every 10 sec, I think the stats is correct. It seems TailFile is scheduled correctly but there hasn't been new lines found so no FlowFile is produced by TailFile.

When new lines are added to the file that being watched by the TailFile, those will be picked up by TailFile and passed to PublishKafka.

If you're sure that new lines are appended but not seeing any data is ingested to NiFi, then please elaborate the issue.

Regards,

Koji