question Re: how to list files in Nifi from a different timezone using ListSFTP processor? in Support Questions

how to list files in Nifi from a different timezone using ListSFTP processor?

GowthamiK — Wed, 10 Apr 2024 19:02:19 GMT

My Nifi server uses PDT timings and i want to list files from a source server which uses UTC timing. While using ListSFTP processor, only files available till current PDT timings are getting listed. (since UTC timing is ahead, many latest files from source end are not getting listed )

I don't want to change my Nifi server timezone to UTC as it would effect other existing flows.

i dont have an option to change timezone directly in my ListSFTP processor either 😞

How i can fix this and list all the files directly using ListSFTP processor?

Re: how to list files in Nifi from a different timezone using ListSFTP processor?

DianaTorres — Wed, 10 Apr 2024 20:22:11 GMT

@GowthamiK Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi experts @mburgess @MattWho who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: how to list files in Nifi from a different timezone using ListSFTP processor?

mburgess — Thu, 11 Apr 2024 17:31:55 GMT

How is your ListSFTP processor configured? Can you increase the Entity Tracking Window to include the difference in timezones?

Re: how to list files in Nifi from a different timezone using ListSFTP processor?

DianaTorres — Wed, 17 Apr 2024 01:27:37 GMT

@GowthamiK Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information @mburgess has requested? Thanks.

Re: how to list files in Nifi from a different timezone using ListSFTP processor?

GowthamiK — Fri, 26 Apr 2024 09:01:30 GMT

Hi @mburgess , tried increasing the Entity time tracking window to 8 hours (the time difference is 7hrs here from PDT to UTC), but still could see the same files getting listed, not the latest ones from source server as expected.

Attached the Nifi ListSFTP configuration i'm using.