Yes that's the requirement. Thank you so much @SAMSAL , it worked. perfectly, Could you please help me any sources to get used to these xml scripts.     ... View more

Not sure I understand the question, which processor/property are you taking about? Basically if you want to access a flowfile attribute value in expression language you can use ${A} in case you have an attribute called A ... View more

I am an absolute newbie and was following other tutorials. 😂 I thought it was necessary to convert it to JSON to store the data into Postgresql. Thanks a lot for the help !  ... View more

Marfill, If backpressure is applied when the total number of flowfiles in a given queue has reached (#nodes * the limit per node) for example if you have a cluster of 3 nodes and the threshold is set to 10,000 then the backpressure will be applied when total # of flow files = 30,000 and so on. Regarding the Control Rate I believe its done per node statistics, for example if you have a control rate that allows 1 flow file per hour and the control rate processor is set part of load balancing on 3 nodes cluster, let say you receive total of 3 files for the first time  one on each node then the 3 will be get processed immediately. ... View more

Hi @SAMSAL ,   thank you for your help, but you're absoluty right in your second post - the first one seems very "uncomfortable".   @MattWho: I really don't care about the content, i've created backup-files in the stages before mailing and only the consumed filenames are relevant for mail. Last time there was 350 files and 35MB for backup 😉 ... View more

Hi, If your configurations are similar to mine then I would suggest that you test it on version 1.16.0 to see if its a bug with version  1.16.2 which in this case needs to be reported. Another option for you is to write custom code using ExecuteScript processor that will generate a different flowfile  for each json record since the ExecuteProcess wont have this option and would write everything in the output steam into one flowfile. you can refer to the following post to help you generate multiple flowfiles: https://community.cloudera.com/t5/Support-Questions/Split-one-Nifi-flow-file-into-Multiple-flow-file-based-on/m-p/203387 Another option you can try incase there is a problem with the SplitContent processor is to create every json record in a different line and then try to split them using SplitText processor and set the property "Split Line Count" to 1 ... View more

@araujothe next step is with InvokeHTTP processor to update the stocks of products via Rest Endpoint ... View more

Thanks. Using examples from that cookbook, I could make it work. Here is my code which works:   from org.apache.commons.io import IOUtils from java.nio.charset import StandardCharsets from org.apache.nifi.processor.io import OutputStreamCallback class PyOutputStreamCallback(OutputStreamCallback): def __init__(self): pass def process(self, outputStream): with open("D:\\Work\\nifi test\\custom processor input\\random_json.json") as f: file_content = f.read() outputStream.write(bytearray(file_content.encode('utf-8'))) flowFile = session.create() if(flowFile != None): flowFile = session.write(flowFile, PyOutputStreamCallback()) flowFile = session.putAttribute(flowFile, "filename", 'input_file.json') session.transfer(flowFile, REL_SUCCESS) session.commit()   Next, I will figure out if I can add the local directory path as a property and read that, instead of hardcoding it in the script. ... View more