https://community.cloudera.com/t5/Support-Questions/Apache-NiFi-Reconciliation-flow/m-p/239911#M201717 <P>If you are not obtaining keys from the database, not using fragmented transactions, and not rolling back on failure, then you should see the failed flow files in a batch being routed to the failure relationship. If you must configure the processor differently, then the flow files will be treated as a single transaction. In that case, in order to handle individual failures you'll want to not use batches, meaning set PutSQL's Batch Size property to 1.</P> Tue, 07 May 2019 20:30:27 GMT mburgess 2019-05-07T20:30:27Z https://community.cloudera.com/t5/Support-Questions/Apache-NiFi-Reconciliation-flow/m-p/239910#M201716 <P>Good Afternoon,</P><P><BR /></P><P>I am creating an apache nifi flow in which I want to flow files from Oracle DB to IBM/DB2, I have completed that part of the flow.</P><P><BR /></P><P><STRONG> I need help with configuring a way to reconcile failed files, I want to know exactly which files failed and the error which caused it. I'm considering using a PUTHDFS to put the failed files into a HIVE TABLE that way I can capture the flow file error. I would then re-enter the failure files back into the flow via GETHDFS.</STRONG></P><P>So, I'm curious is this possible?</P><P> Also is there a mechanism in NiFi to identify the singular file that fails in a batch?</P> Tue, 07 May 2019 00:18:02 GMT https://community.cloudera.com/t5/Support-Questions/Apache-NiFi-Reconciliation-flow/m-p/239910#M201716 fowler7878 2019-05-07T00:18:02Z https://community.cloudera.com/t5/Support-Questions/Apache-NiFi-Reconciliation-flow/m-p/239911#M201717 <P>If you are not obtaining keys from the database, not using fragmented transactions, and not rolling back on failure, then you should see the failed flow files in a batch being routed to the failure relationship. If you must configure the processor differently, then the flow files will be treated as a single transaction. In that case, in order to handle individual failures you'll want to not use batches, meaning set PutSQL's Batch Size property to 1.</P> Tue, 07 May 2019 20:30:27 GMT https://community.cloudera.com/t5/Support-Questions/Apache-NiFi-Reconciliation-flow/m-p/239911#M201717 mburgess 2019-05-07T20:30:27Z