question prefix or suffix in NIFI tailFile Processor in Archives of Support Questions (Read Only)

prefix or suffix in NIFI tailFile Processor

Biswajit16 — Fri, 22 Sep 2017 14:23:56 GMT

Hi ,

In my project I am using Nifi to read log file from tomcat and process those data in a spark application , after that insert those process data in DB.

But my problem is that , at app server level , I have 4 tomcat cluster(4 different log file) in 2 different box and I have mark out which data is from which cluster at spark level. In my present set up I have 2 tailFile processor in Nifi which pointing to single outport , in per box but not able to identify which data is from which cluster at spark level.

Is there any option in tailFile processor to add some suffix or prefix or file name(or any attribute) in each record ? so that I can identify each record is coming from which cluster and persist in db in that way?

Any help will be highly appreciated ....

Thanks in advance

Re: prefix or suffix in NIFI tailFile Processor

ldaluz — Sun, 18 Aug 2019 07:15:07 GMT

@Biswajit Chakraborty

A simple way to do this is to use a ReplaceText processor after the TailFile.

ReplaceText gives you the option to configure which Replacement Strategy to use. Using 'Prepend' will insert the replacement value at the start of each file or line (depending on what you've configured 'Evaluation Mode' to be):

So a ReplaceText with the following configs will give you what you need:

Replacement Value: <set your hostname or filename>
Replacement Strategy: Prepend
Evaluation Mode: Line-by-Line

Re: prefix or suffix in NIFI tailFile Processor

Biswajit16 — Sun, 24 Sep 2017 00:17:06 GMT

Thanks a lot for your help , you saved my day ... thanks again .....