Both of the above answers are correct. Just to provide a full picture of what is happening... GetFile picks up the file from directory and brings it into NiFI's content_repository, which as milind pointed out is by default located under {nifi_install_dir}/content_repository. This directory is not meant to be used by the user, it is for NiFi's internal purposes. The FlowFile is then transferred to LogAttribute which logs information, and I assume if that is the end of your flow then you must have marked the success relationship on LogAttribute as auto-terminated. At this point the flow file is removed from NiFi and the content in the content repository will eventually be removed. NiFi is not meant to be a storage system where you bring data in and then leave it there, your flow would have to send the data somewhere after GetFile. ... View more

Yes NiFi supports LDAP authentication. It is described in the admin guide here: https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#lightweight-directory-access-protocol-ldap ... View more

@Shishir Saxena Unfortunately I can't think of too many good work arounds using out of the box functionality, but I guess it depends what you are doing with the Avro after ExecuteSQL, are you landing it in HDFS? or are you converting it to some other format and doing something else? ... View more

https://issues.apache.org/jira/browse/NIFI-2048 ... View more

Actually, was just reading this: https://docs.oracle.com/cd/B19306_01/java.102/b14188/datamap.htm One of the rows says: DEC , DECIMAL , NUMBER , NUMERIC oracle.sql.NUMBER java.math.BigDecimal So if that is true then Oracle is returning BigDecimal for your NUMBER columns, and then NiFi's code is turning BigDecimal and BigInteger into Strings. Based on this, it looks like there may be a way to represent BigDecimal in Avro: https://issues.apache.org/jira/browse/AVRO-1402 https://avro.apache.org/docs/1.7.7/spec.html#Logical+Types We should look into using the decimal logical type in NiFi. ... View more

I'm wondering if it is related to the oracle driver... the code in NiFi that I linked to above shows how we convert the fields to Avro. It starts by get the value from the ResultSet like this: final Object value = rs.getObject(i); Then it checks what type value is, in the case of a number it does this: else if (value instanceof Number || value instanceof Boolean) { rec.put(i - 1, value); } So if the Oracle driver returns any sub-class of Number, then that is what is given to Avro. I think a good test would be to write a simple Java program using JDBC and the same driver you are using with NiFI, and query your table and see what getObject(i) returns from the ResultSet for your number columns. If it doesn't return Numbers then that is the problem, if it does then something else is happening after that. ... View more

NiFi processors have their own transaction concept called a session. Each processor starts a session, performs one or more operations, and then commits or rolls back the session. You can see the general idea in the AbstractProcessor that many processors extends from: https://github.com/apache/nifi/blob/master/nifi-api/src/main/java/org/apache/nifi/processor/AbstractProcessor.java ... View more