We want to acquire IIS access log with Tail and store it in HDFS
It works if you specify a file with Single File on the TailFile processor, but it does not work for Multiple File.
And no error.
The log file is located below and is output as "u_ex [date] [hour]. Log". (UTC)
Please tell me how to write [Files (s) to Tail], [Rolling Filename Pattern], [Base directory] in the case of [Multiple files] in the properties of Tail Files.
Thank you everyone
I solved this problem as follows.
We were able to detect files updated with [ListFile] and only output files updated with [FetchFile] and [PutHDFS] to HDFS.
It seems that we can not get updated files and only Tail, so we will solve this with now