Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Pivot one column to rows from CSV file along with other fields

avatar
Explorer

Hi,

 

I have a CSV file where the last column has pipe-delimited text which needs to be split up on pipe and I have to pivot it into rows. The last column can have any number of values with pipe-delimited and it varies by each row. How can we accomplish this in NIFI?

 

Ex: 

 

A, B,  C|D

X, Y,  X|Y|Z|B

 

The above file has to be converted to 

 

A, B, C

A, B, D

X, Y, X

X, Y, Y

X, Y, Z

X, Y, B

1 ACCEPTED SOLUTION

avatar

For this usecase the most natural solution is probably as follows:

1. Send message to a script for processing

2. Let the script turn your 1 row into an output of N rows 

3. Optional: Split the rows in Nifi

 


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.

View solution in original post

1 REPLY 1

avatar

For this usecase the most natural solution is probably as follows:

1. Send message to a script for processing

2. Let the script turn your 1 row into an output of N rows 

3. Optional: Split the rows in Nifi

 


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.