question Re: I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI in Support Questions

I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI

Abhiram-4455 — Tue, 26 Sep 2023 12:42:16 GMT

output file:

{
"name" : "name",
"class" : "a",
"grade" : "A",
"address" : "state"
"url" :{

"first url":"url",

"second url":"url"

}

Re: I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI

DianaTorres — Tue, 26 Sep 2023 15:39:24 GMT

@Abhiram-4455 Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi experts @MattWho @cotopaul who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI

drewski7 — Tue, 26 Sep 2023 18:24:47 GMT

@Abhiram-4455

What's the input look like?

Re: I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI

SAMSAL — Tue, 26 Sep 2023 18:44:02 GMT

Hi @Abhiram-4455 ,

The easiest way to do such transformation is to use ConvertRecord to convert the format from CSV format to JSON format, then you can use JoltTransformation processor to do the proper transformation to the final format that you need. To see an example of this please refer to the following post: https://community.cloudera.com/t5/Support-Questions/want-to-convert-csv-to-nested-json-using-nifi/td-p/224954

If that helps please accept solution.

Thanks

Re: I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI

Abhiram-4455 — Wed, 27 Sep 2023 05:48:20 GMT

Name, class, grade, address, first_url, second_url

John, 10th,A,New York,uhttps://www.facebook.com,/brnds-coupons/offers

Re: I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI

Abhiram-4455 — Wed, 27 Sep 2023 05:50:55 GMT

I have tried this example but getting errors like: unable to pares incoming data. Lot of errors... So can you help to get step by step process for which processor need to use and and configuration

Re: I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI

SAMSAL — Wed, 27 Sep 2023 14:20:40 GMT

@Abhiram-4455,

Assuming you have the following input where you can have multiple records per CSV input:

Name,class,grade,address,first_url,second_url John,10th,A,New York,https://www.facebook.com,/brnds-coupons/offers sam,9th,A,Dallas,www.google.com,www.amazon.com

You can use the following processors to do your transformation:

Where each processor is configured as the following:

- ConvertRecord: is to convert from CSV format to JSON

CSVReader: (use default settings)

Note: you can adjust the "Value Separator" in case the CSV delimiter is different from ",".

JSONRecorSertWriter: (use default settings)

- JoltTransformationJSON:

where "Jolt Specification" is set to the following:

[ { "operation": "shift", "spec": { "*": { "*": "[&1].&", "first_url": "[&1].url.&", "second_url": "[&1].url.&" } } } ]

The output shouldlook like the following:

[ { "Name": "John", "class": "10th", "grade": "A", "address": "New York", "url": { "first_url": "https://www.facebook.com", "second_url": "/brnds-coupons/offers" } }, { "Name": "sam", "class": "9th", "grade": "A", "address": "Dallas", "url": { "first_url": "www.google.com", "second_url": "www.amazon.com" } } ]

if you need to process each record separately you can use SplitJson processor:

Use the "split" relationship to get the split records.

Hope that helps.

Re: I have to convert csv file to nested json can you help me out with flow file configuration .I am new to NIFI

Abhiram-4455 — Thu, 28 Sep 2023 07:55:03 GMT

Thank you so much SAMSAL it's working