Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to write TailFile (Multiple File) with NiFi

Highlighted

How to write TailFile (Multiple File) with NiFi

New Contributor

We want to acquire IIS access log with Tail and store it in HDFS

It works if you specify a file with Single File on the TailFile processor, but it does not work for Multiple File.

And no error.

The log file is located below and is output as "u_ex [date] [hour]. Log". (UTC)

c:\inetpub\logs\LogFiles\W3SVC1\u_ex18061501.log
c:\inetpub\logs\LogFiles\W3SVC1\u_ex18061502.log

Please tell me how to write [Files (s) to Tail], [Rolling Filename Pattern], [Base directory] in the case of [Multiple files] in the properties of Tail Files.

3 REPLIES 3
Highlighted

Re: How to write TailFile (Multiple File) with NiFi

New Contributor

The server on which NiFi runs and the server on which IIS runs are the same.

Highlighted

Re: How to write TailFile (Multiple File) with NiFi

Super Guru

Why not create multiple processors and join the content via merge?

Highlighted

Re: How to write TailFile (Multiple File) with NiFi

New Contributor

Thank you everyone

I solved this problem as follows.
We were able to detect files updated with [ListFile] and only output files updated with [FetchFile] and [PutHDFS] to HDFS.

It seems that we can not get updated files and only Tail, so we will solve this with now

Don't have an account?
Coming from Hortonworks? Activate your account here