Hello everyone, I have a problem with using nifi 'GenerateFlowFile' and 'PutLambda' processors. My flow is very simple: GenerateFlowFile -> PutLambda First I want to generate exactly one flow file and than I want to invoke a lambda function exactly one time. However, for some reason, the GenerateFlowFile processor creates 2 flow files instead of one, even though it is configured to run only on the primary node with one concurrent task. This causes the lambda to be invoked 2 times. Furthermore, I also changed the configuration of the PutLambda processor to run only on the primary node with one concurrent task, but it still invokes 2 lambdas at the same time which is causing errors. It's important to say that this happens on a regular basis on two different clusters. Can anyone tell me how can I fix this problem? I thought about adding a MergeContent processor after the GenerateFlowFile, but I hope you guys will have a better idea. thanks! ... View more

Hi, I'm working with nifi and I need to merge orc files. I get the files from s3 bucket. The flow goes like that: List s3 -> Fetch s3 objects -> merge content(output as avro) -> convert Avro to orc -> put s3 object. (I also tried only the merge content without outputing as Avro and converting to orc but it didn't work - The merged file was not valid). I get an error at the MergeContent processor: ERROR MergeContent[id=XXXX] Failed to process bundle of 2 files due to org.apache.nifi.processor.exception.ProcessException: IO thrown from MergeContent[id=XXXX]: java.io.IOException: Not a data file. ... View more