Member since
03-19-2026
21
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 182 | 04-28-2026 06:18 AM |
05-07-2026
11:57 AM
We have VM server on which we have NiFi installed within the container. When we try to connect using sftp command from within the docker it connects fine. docker exec -it nifi bash However when we try from NiFi PutSFTP processor, it fails with below error Routing to failure since unable to transfer FlowFile[filename=TGT_TEST28042026.csv] to remote host sftp.AAAAA.com: net. schmizz. sshj. transport. TransportException: Connection reset - Caused by: java.net.SocketException: Connection How and where do I get more details logs ? Also, is sftp command and NiFi PutSFTP works differently ? This is similar to my previous post https://community.cloudera.com/t5/Support-Questions/SFTP-CLI-works-but-PutSFTP-fails/td-p/413903 But this time vendor has whitelisted the IP and we are able to connect from within docker on which Nifi is running. Thanks Gautam P
... View more
Labels:
- Labels:
-
Apache NiFi
05-04-2026
05:20 AM
@nisaar I expect that retry set on the Success relationship out of ListSMB is impacting your scheduling. I suspect that retry is blocking "successful" attempts by until both retry have been made which aligns with the skip twice you are seeing in scheduling. As I mentioned before, you should not be setting "retry" on any success relationships. This is an anti-pattern that will delay processing of any successful execution for the duration of the retry (Each retry would occur at the processors scheduled execution times). Note: Scheduling of a NiFi component does not mean immediate execution. That execution depends on availability of threads to service the execution. NiFi has a "max timer driven thread count" configuration that establishes the thread pool from which all scheduled component threads come from. So things like number of running components, number of concurrent tasks set on a given component, CPU insensitive components, etc can impact when a "scheduled" component is given a thread from the thread pool to execute. I Thread pool does not impact scheduler unless the processor has been scheduled and never executes until within the 1.5 hours since it was initially scheduled (which I doubt in this case). The more logical cause because of the consistent behavior is the "retry" you have set on Success from ListSMB. Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
04-28-2026
06:18 AM
1 Kudo
Issue is resolved after the vendor whitelisted the IP's Thanks
... View more
03-31-2026
07:18 AM
Sorry for the delayed response. We were able to kind of resolve the issue by adding a retry on ListSMB and FetchSMB processors. Number of Attempts : 2 Retry Back Off Policy: Penalize Retry maximum backoff period : 1 minute To test the working we have scheduled it to run every 30 min. However, we are observing that whenever a retry happens the scheduler won't run on scheduled time. Not sure how retry is affecting scheduler. Thanks!
... View more