Support Questions

Find answers, ask questions, and share your expertise

TailFile with multiple files

New Contributor

In the following path, i have the following logs:

When 10MB are reached for metricbeat file, it will go to write on metricbeat.1 and when this file size exceeds also, it will write to metricbeat.2 etc

[root@ metricbeat]# ls -lorth
total 4.1M
-rwxrwxrwx 1 nifi   10 Aug 17 11:17 metricbeat.2
-rwxrwxrwx 1 nifi   10 Aug 17 11:17 metricbeat.1
-rwxrwxrwx 1 nifi 4.1M Aug 17 11:47 metricbeat

In NiFi (no cluster) I want to tail all the files that are stored on path


I am using TailFile Processor with the following Configuration:

TailFile NiFi Processor Configuration


But, the main problem is that i am getting the following error:

'File to Tail' is invalid because There is no file to tail. Files must exist when starting this processor.


If i select the "Single Line" it gets the file "metricbeat"

Could you please tell me what i am doing wrong? Or how can i read all the "metricbeat" files from that path?


@Octavian Duta

In TailFile set the following Attributes:

File(s) to Tail: /logs/metricbeat

Rolling FileName Pattern: metricbeat.*

Base Directory: No value Set (leave it EMPTY)

If this answer is helpful please choose Accept to mark your question as answered.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.