ListSFTP extends ListFileTransfer and that class has performListing() which does: final FileTransfer transfer = getFileTransfer(context); final List<FileInfo> listing; try { listing = transfer.getListing(); } finally { IOUtils.closeQuietly(transfer); } The FileTransfer here is the SFTPTransfer, so it is being closed in a finally block every time. ... View more

Your getLogger.info(...) statement is inside a for loop over "statuses" and I don't see a variable called statuses so it is hard to say what is in the variable, but if that is an empty collection then you might not be executing your for loop. I would try putting a logging statement right at the beginning of onTrigger to see if the reporting task is even executed. ... View more

Yes, to be completely safe you should stop NiFi Registry, copy the database directory and flow storage directory somewhere, then start back up. ... View more

You can change the Run Schedule on the scheduling tab of the processor config. ... View more

HBase is actually not a JSON store... the row id, column family, column qualifiers, and values are all stored as byte[] so it can be whatever you want. In NiFi there is PutHBaseJson which is one way of using NiFi to get data into HBase because it is a common way to represents the columns of a row as key/value pairs in JSON, but it is NiFi that is choosing to use JSON here, not HBase. There is another processor PutHBaseCell which writes the byte contents of a flow file to a cell value in HBase, so this would make sense if you had a GetFile pick up a PDF from a directory and then wanted to store the PDF as the value of a cell in HBase. Solr and ES are both text-indexing systems so they aren't really made to store binary data, although I believe they do have a a binary field type. Most likely you would use them to index the text content of the PDF which would be extracted with something like Tika, an example of that would be this: https://community.hortonworks.com/articles/42210/using-solrs-extracting-request-handler-with-apache.html There is a pull request up for an issue that might be related to the ArrayIndexOutOfBounds exceptions... https://github.com/apache/nifi/pull/2718 ... View more