About AnkushKoul

AnkushKoul · ‎04-28-2021

I have a NIFI flow that moves files from one FTP server to another. The flow starts with ListSFTP processor and ends with the PutSFTP processor. The password required to authenticate with the PutSFTP processor is stored inside another application that exposes REST endpoints to get the password. I want to get the password once and use the same to put all fetched files into the destination SFTP server. Please advise where/how i can use the InvokeHTTP processor in this case so that it doesnt get invoked for each flow file (It doesnt make sense to fetch the password on a per flowfile basis).

AnkushKoul · ‎04-13-2021

How to do error handling for ListSFTP processor (eg. if it fails to connect to SFTP server due to any reason)? The only connection it shows is "Success".

AnkushKoul · ‎04-08-2021

Thanks Matt for your helpful and prompt response! So if I understand you correctly, with a Run schedule of 30 seconds & 1 concurrent task configured if the 1st execution takes takes 40 seconds then the 2nd execution will start only at 60 seconds. The processor will be idle from t-40 sec to t-60 sec. Is this correct?

AnkushKoul · ‎04-08-2021

Thanks Matt! Since with RunSchedule set to "30 sec" NiFi schedules the component to execute every 30 seconds, what happens if task 1 takes say 40 seconds to complete (more than the schedule interval)? When will the 2nd execution happen (Task 2)?

AnkushKoul · ‎04-08-2021

Hello, I have a processor scheduling setup as below - Run Schedule - 30 sec Run Duration - 0 ms Concurrent Tasks - 1 In this case, assuming that each task takes more than 30 secs to complete once it starts, can 2 (or more than 2) processor tasks run at the same time? 0s - Task1 starts 30s - Task2 starts (Task 1 is still running) Is there any way to prevent overlapping task runs i,e Task 2 should start at 30s only if Task1 that started at 0s is complete? Thanks!

Online	Offline
Last Visited	‎05-25-2021 05:11 AM

Member Since	‎04-08-2021 01:38 AM
Last Visited	‎05-25-2021 05:11 AM
Posts	5

Cloudera Community

Getting API token once during a NIFI flow

Error handling ListSFTP

Re: Run Schedule - New task execution while previo...

Re: Run Schedule - New task execution while previo...

Run Schedule - New task execution while previous i...