I am scraping a page for multiple links. I use extract Text from the HTML and have the Enable Repeating Capture set to true. I get the following attributes associated to the flow file URl.0, URL.1...URL.n I want to process this individually. How do I either make these attributes the new flow? Convert into something that will allow for accessing each one? The number of links found is not a fixed number. I did try ExecuteScript but it killed Nifi. Was my first attemp at using the executescript. var OutputStreamCallback = Java.type("org.apache.nifi.processor.io.OutputStreamCallback"); var IOUtils = Java.type("org.apache.commons.io.IOUtils"); var StandardCharsets = Java.type("java.nio.charset.StandardCharsets"); var flowFiles =[]; var flowFile = session.get() if (flowFile != null) { var myAttr = flowFile.getAttribute('urls').split("|"); if(myAttr.length>0) { for(var i=0;i<myAttr.length;i++) { var newflowFile = session.create(flowFile); newflowFile =session.write(newflowFile , new OutputStreamCallback(function(outputStream) { outputStream.write(myAttr[i].getBytes(StandardCharsets.UTF_8)) })); flowFiles .push(newflowFile ); } session.transfer(flowFiles , REL_SUCCESS); session.remove(flowFile); session.commit(); } } ... View more

I Have two separate processor groups access two separate database on the same SQLServer instance. I have created two DBCPConnectionPool with the only real difference being the Database name in the SQLServer connection string. One works the other when trying to enable stays enabling all the time. I am sure this relates to something can only be used once but I am unsure. Help appreciated. Lee ... View more

I wish to convert three variables to a specific json. I am unsure of best method. The Attributes fromDate, toDate, id to JSON { "start":"fromDate.value", "end":"endDate.value" "where":{ "myid": "id.value" } } ... View more

Unable to solve this issue. The process works with the Advance editor The JOLT [{ "operation": "shift", "spec": { "@.source": "header.source", "@.author": "header.author", "@.publishedAt": "header.date", "@.title": "header.title", "@.description": "header.description", "@.urlToImage": "header.image", "@.url": "header.url", "@": "source" } }, { "operation": "default", "spec": { "triples":{}, "header": { "id":"${uuid}", "type": "News", "ingestMethod": "NiFi", "injestionMethod" : "${methodName}", "injestionUrl" : "${url}${searchQuery}${apiKey}${fromDate}${domains}", "injestDate":"${now()}" } } } ] the feed coming from a JsonSplit { "source": { "id": "abc-news-au", "name": "ABC News (AU)" }, "author": "ABC Radio National", "title": "The Talented Mr Daly", "description": "Peter Daly projects confidence and success. He wears gold rings, gold cufflinks, and a gold watch. The market, he says, is his backyard and he knows it \"damn well\". But the 59-year-old is actually in a world of trouble. The corporate watchdog, ASIC, accuses h…", "url": "http://www.abc.net.au/radionational/programs/backgroundbriefing/the-talented-mr-daly/10158316", "urlToImage": "http://www.abc.net.au/radionational/image/10158320-1x1-700x700.jpg", "publishedAt": "2018-08-25T22:05:00Z" } ... View more