NIFI - link 3 columns

jricogar — Fri, 28 Sep 2018 10:15:45 GMT

Hello, I need link 3 column in all rows of the file, for example:

column1;column2;column3;2018;09;27

column1_1;column2_1;column3_1;2018;09;27

column1_2;column2_2;column3_2;2018;09;27

the output file must contains only 4 columns:

column1;column2;column3;20180927

column1_1;column2_1;column3_1;20180927

column1_2;column2_2;column3_2;20180927

The input file is .txt and the output file should be .txt

Thaks!!

Re: NIFI - link 3 columns

Shu_ashu — Sun, 18 Aug 2019 06:38:19 GMT

@Pepelu Rico

You can achieve this by using ReplaceText processor (or) UpdateRecord processor

Method1:Using UpdateRecord processor:

If you are working on larger number of rows then use UpdateRecord processor and define CSV Reader controller service with ; as value seperator.

Define CSV writer controller service add new property in the Processor as

/link3column as

concat(/col_4,/col5,/col6)

Refer to this link for configure/Usage of UpdateRecord processor.

Method2:Using ReplaceText processor:

Use this method if you are dealing with less number of records

Search Value

^((?:[^;]+;\s*){3})(.*)

Replacement Value

$1${'$2':replace(";","")}

Character Set

UTF-8

Maximum Buffer Size

1 MB //change this value according to your flowfile size

Replacement Strategy

Regex Replace

Evaluation Mode

Line-by-Line

In this method we are using regex to match until third ; to first capture group($1) and rest of the data into $2 capture group.

Making use of NiFi expression language we are replacing ";" in $2 capture group with ""

OutputFlowfile:

column1;column2;column3;20180927column1_1;column2_1;column3_1;20180927column1_2;column2_2;column3_2;20180927

If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.

Re: NIFI - link 3 columns

jricogar — Mon, 01 Oct 2018 15:19:01 GMT

Thanks @Shu , It has been very helpful!!

question NIFI - link 3 columns in Archives of Support Questions (Read Only)

NIFI - link 3 columns

Re: NIFI - link 3 columns

Re: NIFI - link 3 columns