Skip to main content
budati
Silver ⭐️⭐️⭐️
September 18, 2019
Solved

Pivot one column to rows from CSV file along with other fields

Hi,

 

I have a CSV file where the last column has pipe-delimited text which needs to be split up on pipe and I have to pivot it into rows. The last column can have any number of values with pipe-delimited and it varies by each row. How can we accomplish this in NIFI?

 

Ex: 

 

A, B,  C|D

X, Y,  X|Y|Z|B

 

The above file has to be converted to 

 

A, B, C

A, B, D

X, Y, X

X, Y, Y

X, Y, Z

X, Y, B

DennisJaheruddi
Platinum ⭐️
September 23, 2019

For this usecase the most natural solution is probably as follows:

1. Send message to a script for processing

2. Let the script turn your 1 row into an output of N rows 

3. Optional: Split the rows in Nifi

 

- Dennis Jaheruddin If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.

1 reply

DennisJaheruddi
Platinum ⭐️
Platinum ⭐️
September 23, 2019

For this usecase the most natural solution is probably as follows:

1. Send message to a script for processing

2. Let the script turn your 1 row into an output of N rows 

3. Optional: Split the rows in Nifi

 

Translate
- Dennis Jaheruddin If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.