Created on 08-24-2018 04:13 AM - edited 09-16-2022 06:37 AM
Unable to solve this issue.
The process works with the Advance editor
The JOLT
[{ "operation": "shift", "spec": { "@.source": "header.source", "@.author": "header.author", "@.publishedAt": "header.date", "@.title": "header.title", "@.description": "header.description", "@.urlToImage": "header.image", "@.url": "header.url", "@": "source" } }, { "operation": "default", "spec": { "triples":{}, "header": { "id":"${uuid}", "type": "News", "ingestMethod": "NiFi", "injestionMethod" : "${methodName}", "injestionUrl" : "${url}${searchQuery}${apiKey}${fromDate}${domains}", "injestDate":"${now()}" } } } ]
the feed coming from a JsonSplit
{ "source": { "id": "abc-news-au", "name": "ABC News (AU)" }, "author": "ABC Radio National", "title": "The Talented Mr Daly", "description": "Peter Daly projects confidence and success. He wears gold rings, gold cufflinks, and a gold watch. The market, he says, is his backyard and he knows it \"damn well\". But the 59-year-old is actually in a world of trouble. The corporate watchdog, ASIC, accuses h…", "url": "http://www.abc.net.au/radionational/programs/backgroundbriefing/the-talented-mr-daly/10158316", "urlToImage": "http://www.abc.net.au/radionational/image/10158320-1x1-700x700.jpg", "publishedAt": "2018-08-25T22:05:00Z" }
Created 05-08-2019 06:59 PM
Hey Lee, did you figure something out with this. I am having the exact same issue on version 1.6.x . Thanks
Created 05-08-2019 08:56 PM
Lee, all,
We tracked down the issue to an attribute variable I was using to put into the json. It had unescaped/hidden characters (\n) that where causing the JOLT processor to fail; however like you, it would work via the "Advance Editor". I used escapeJson() on the attribute it works it also makes the \n are visible in the flowfile.
https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#escapejson
Simple Example:
[
{
"operation": "default",
"spec": {
"content": "${ext_content:escapeJson()}", <- ext_content attribute contained the issue
"date": "${ext_date}",
"updateDate": "${ext_updateDate}"
}
}
]
Hope this this helps and saves someone else some time!
JF