Created 11-29-2016 10:20 AM
I want to monitoring directory in ftp server becuase files were sometimes changed and added.
I added ListFTP processer and then execute.
I want to get file list repeatly and diff filename and modification date however listftp was only one time execute. It wasn't execute again.
please advices me what to do.
Created 11-30-2016 02:32 PM
Are you using DistributedMapCache along with ListSFTP?
Same file won't be listed by ListSFTP and that may be reason to think it executed only once. If you just "touch" existing file then it is again listed. If there is continuous feed of different files then ListSFTP will list all new files coming into directory.
Created 11-29-2016 12:46 PM
How was the ListSFTP processor scheduler set? See this doc for scheduling: https://docs.hortonworks.com/HDPDocuments/HDF1/HDF-1.2/bk_UserGuide/content/scheduling-tab.html
Suggestion is to have it every 5 sec or so.
Let me know how it goes.
Created on 11-30-2016 01:22 AM - edited 08-19-2019 02:59 AM
I changed Run Schedule but it wasn't execute again.
what should I check?
Created 11-30-2016 02:32 PM
Are you using DistributedMapCache along with ListSFTP?
Same file won't be listed by ListSFTP and that may be reason to think it executed only once. If you just "touch" existing file then it is again listed. If there is continuous feed of different files then ListSFTP will list all new files coming into directory.
Created 12-01-2016 09:59 AM
I sloved the problem.
when new file added to ftp. it modification date is before listing.timestamp
Thanks you for helping me