We have a similar problem. A MergeContent processor giving out 'is not the most recent version of thisFlowFile within this session' and 'is not known in this session' errors. Also we have the 'phantom' queue that you describe. A large queue that the processor does not process. But when we restart NiFi the queue drops the zero. ... View more

Check the getPropertyDescriptor() and getPropertyDescriptors() methods from the example in the mailing list (link above). You have to look up the descriptor by name in the former, and return a List of the PropertyDescriptors in the latter. ... View more

You can put sqljdbc42.jar somewhere else and point to it in the Database Driver Location property. There might be issues with backslashes and/or Windows pathnames, I think there are other HCC questions/answers that address this. ... View more

Hi @Ryan Cicak, I checked the metastore URI, it was not correct, so I fixed that, but now I'm getting a different error; no Kerberos on my setup; and our HDP is HA This error is similar to what @Matt Burgess pointed to as an issue at onetime in the past - NIFI-2873, but that issue should be resolved in NiFi 1.1.0 and above; I am trying this in NiFi 1.1.2, but still same issue as pre-1.1.0 Any thoughts ?? ... View more

You need to keep the NIFi copy of the data even after writing a copy of it out via the putSFTP? If you need to retain a local copy of the data, route success twice form your putSFTP processor. So you should be able to do this with..... The UpdateAttribute processor can be used to update the filename by adding the following new property to its configuration: The Local copy of your Files remain unchanged down the success relationship to the left. The copy sent down the path to the right will have its content cleared, filename changed, and then sent via another PutSFTP. Thanks, Matt ... View more

Using commons-collections-3.2.1 solved the issue.Thanks, @Matt Burgess. ... View more

Correct, SelectHiveQL is for statements that return ResultSets (like SELECT *), those results are converted to Avro records. PutHiveQL is for executing statements (except callable statements like stored procedures) that do not return results, such as your ALTER TABLE example. ... View more

Thanks, now I can load from local ... View more

Hi, Matt! very useful and informative articles. Thank you veru much! Could you tell me how do I read content of a flowFile, transform it the way I like, and write the output to a new flowFile attribute (not back to the content)? I was trying to return transformation result from the callback but caught the error: None required for void return which is fairly expected behaviour - callback returns to the session.read function, but the latter does not return anything, I assume. So we get the flowFile itself and its content residing in different namespaces and I can't figure out how can I use content of the flowFile to place it into the attribute. Could you kindly help me, Matt? ... View more