Support Questions
Find answers, ask questions, and share your expertise

nifi - incorrect json format correction

Highlighted

nifi - incorrect json format correction

78518-1.jpg

78521-3.jpg

Hello,

I am taking data in xml format using SOAP-Request.

78524-4.jpg

stylesheet.zip

I convert the incoming xml data to json format through the Stylesheet XML file using the TransformXML processor.

but in the json file that is created after the conversion, I am getting the wrong json format warning because I am marked as yellow ".

incorrect

78522-2.jpg

{ "soap:Envelope": { "soap:Body": { "Musteri_Hiyerarsi_TablosuResponse": { "Musteri_Hiyerarsi_TablosuResult": "[ { "UNIQ_KEY": 740281.0, "TTALT": 112.0, "TTAD": "TEST" } ]" } } } }

"sign cleared

78523-3.jpg

{ "soap:Envelope": { "soap:Body": { "Musteri_Hiyerarsi_TablosuResponse": { "Musteri_Hiyerarsi_TablosuResult": [ { "UNIQ_KEY": 740281.0, "TTALT": 112.0, "TTAD": "TEST" } ] } } } }

I ask you for your help on how to remove the character.

ek'te

thank you.

7 REPLIES 7
Highlighted

Re: nifi - incorrect json format correction

Super Guru
@Murat Menteşe

You can use ReplaceText processor after TransformXml processor then add the matching regex excluding "(quotes) before/after array [].

ReplaceText Configs:-

Search Value

(.*)"(\[.*\])"(.*)

Replacement Value

$1$2$3

Character Set

UTF-8

Maximum Buffer Size

1 MB //increase the size according to your flowfile size

Replacement Strategy

Regex Replace

Evaluation Mode

Entire text

78526-replacetext.png

Input:-

{ "soap:Envelope": { "soap:Body": { "Musteri_Hiyerarsi_TablosuResponse": { "Musteri_Hiyerarsi_TablosuResult": "[ { "UNIQ_KEY": 740281.0, "TTALT": 112.0, "TTAD": "TEST" } ]" } } } }

Output: valid json

{ "soap:Envelope": { "soap:Body": { "Musteri_Hiyerarsi_TablosuResponse": { "Musteri_Hiyerarsi_TablosuResult": [ { "UNIQ_KEY": 740281.0, "TTALT": 112.0, "TTAD": "TEST" } ] } } } }
Highlighted

Re: nifi - incorrect json format correction

Super Guru
@Murat Menteşe

Could you share your sample xml file data so that i can reproduce the issue on my side by converting to json format?

Highlighted

Re: nifi - incorrect json format correction

@Shu

hello,

ReplaceText process data did not work on large data.

I am posting a larger example of the data in the attachment. If you can help it very much but very much.xml-to-json.zip

Highlighted

Re: nifi - incorrect json format correction

Super Guru
@Murat Menteşe

As your xml doc having array [] in it and i'm not sure how to write matching xslt. As the current xslt converts the array xml into object/element and adding "" for array[].

In case of large data you have to increase the

Maximum Buffer Size

1 MB //increase based on your flowfile size

as this processor works takes the whole flowfile into memory and does all replacing based on our configs.

Re: nifi - incorrect json format correction

thank you for your help. it worked. but as an example I rolled this json format. Normally it will be over 100mb. the error is still the same.But this solution can be a quick solution. can not you do anything to correct this problem in the incoming xml file Stylesheet? note: I have not been able to experiment on large data yet because it is in the test phase.

Highlighted

Re: nifi - incorrect json format correction

Of course, you can find the work file as an attachment. thank you so much.

xml-to-json.xml

style.zip

Highlighted

Re: nifi - incorrect json format correction

New Contributor

This is the best steps to resolve the problem with the XML. you can resolve the problem in nifi. And if you are using any home appliances like fridge and washing machine then you can coordinate with geek squad support UK 24*7.