Hi @MattWho    1) Initially, I faced the "NiFi PutSFTP failed to rename dot file issue" only when the child processor was configured with "Outbound Policy = Batch Output". It worked without the child processor group. 2) I modified the PutSFTP failure retry attempt to 3, and it fixed the issue. 3) Later, I introduced a RouteOnAttribute after the FetchHDFS processor for some internal logic implementation, and the PutSFTP error started again.  4) This time, I updated the "Run Schedule" of the PutSFTP processor from 0Sec to 3 Sec, and it again fixed the issue.  5) I have a requirement to transfer stats of each file (with file name, row count, file size) etc. So, I introduced one more PutSFTP processor, and the issue popped up again.  6) Finally, I made the following changes to both of my PutSFTP processors:        a) Added PutSFTP failure retry attempt to 3.        b) Modified the "Run Schedule" of the first PutSFTP Processor to "7 Sec".        c) Modified the "Run Schedule" of the second PutSFTP Processor to "10 Sec".   Now it is working fine. Are we getting this issue because of 20 flowfiles processing at a time ?  Could you please suggest if this is the right way to fix the "NiFi PutSFTP failed to rename dot file issue"? ... View more

@darkcoffeelake Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks. ... View more

@Adhitya, Did the response assist in resolving your query? If it did, kindly mark the relevant reply as the solution, as it will aid others in locating the answer more easily in the future.  ... View more

Connecting Salesforce with Hortonworks Data Flow (powered by Apache NiFi) unlocks powerful data integration. Here's how: NiFi Processors: Utilize processors like "InvokeHTTP" to call Salesforce APIs and retrieve data. Real-Time or Batch: Move data bi-directionally (Salesforce to NiFi or vice versa) in real-time or batches. Data Transformation: Cleanse, transform, and enrich data using NiFi's processors before storing it in your data lake. This salesforce integration helps you leverage valuable Salesforce data for analytics, reporting, and deeper customer insights.  ... View more

Thank you for the detailed explanation, Matt ... View more

Yes the controller service was working before aks version upgrade ... View more

Thanks a lot @MattWho  ... View more

 I have try something like below which worked. Once Dim1 is completed  Dim2:- 1: Attribute to capture StartDate - UpdateAttribute 2: Create Log table in database which will maintain the LastRunTime 3: Custom SQL where updateddate>=$LastRunTime using   ExecuteSQL 4: Insert the records in database 5: Update the log file with StartTime attribute from step one1 ... View more