Support Questions
Find answers, ask questions, and share your expertise

How to add tail file to a pipeline build with listfile ,fetchfile

How to add tail file to a pipeline build with listfile ,fetchfile

New Contributor

I have a working pipeline which is bringing data from log file to database.. list file->fetch file->convert-charecter->putdatabase.. if i want to add tail file for constantly changing log files.. how i need to change it? I am only two months in nifi. 

log file changing pattern in source.. its changing from x_06042020.log, x_06042020_V1.log and its constantly writing in current file. it creating new version after current file is 10 MB.

1 REPLY 1
Highlighted

Re: How to add tail file to a pipeline build with listfile ,fetchfile

Cloudera Employee

We can configure TailFile processor for single or multiple file and configure the Rolling Filename Pattern property, as explained in TailFile processor documentation:

 

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache...

 

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache...