Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Pivot one column to rows from CSV file along with other fields

Solved Go to solution

Pivot one column to rows from CSV file along with other fields

Explorer

Hi,

 

I have a CSV file where the last column has pipe-delimited text which needs to be split up on pipe and I have to pivot it into rows. The last column can have any number of values with pipe-delimited and it varies by each row. How can we accomplish this in NIFI?

 

Ex: 

 

A, B,  C|D

X, Y,  X|Y|Z|B

 

The above file has to be converted to 

 

A, B, C

A, B, D

X, Y, X

X, Y, Y

X, Y, Z

X, Y, B

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Pivot one column to rows from CSV file along with other fields

Expert Contributor

For this usecase the most natural solution is probably as follows:

1. Send message to a script for processing

2. Let the script turn your 1 row into an output of N rows 

3. Optional: Split the rows in Nifi

 


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.

View solution in original post

1 REPLY 1
Highlighted

Re: Pivot one column to rows from CSV file along with other fields

Expert Contributor

For this usecase the most natural solution is probably as follows:

1. Send message to a script for processing

2. Let the script turn your 1 row into an output of N rows 

3. Optional: Split the rows in Nifi

 


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here