Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 11-29-2016 10:20 AM
I want to monitoring directory in ftp server becuase files were sometimes changed and added.
I added ListFTP processer and then execute.
I want to get file list repeatly and diff filename and modification date however listftp was only one time execute. It wasn't execute again.
please advices me what to do.
Created 11-30-2016 02:32 PM
Are you using DistributedMapCache along with ListSFTP?
Same file won't be listed by ListSFTP and that may be reason to think it executed only once. If you just "touch" existing file then it is again listed. If there is continuous feed of different files then ListSFTP will list all new files coming into directory.
Created 11-29-2016 12:46 PM
How was the ListSFTP processor scheduler set? See this doc for scheduling: https://docs.hortonworks.com/HDPDocuments/HDF1/HDF-1.2/bk_UserGuide/content/scheduling-tab.html
Suggestion is to have it every 5 sec or so.
Let me know how it goes.
Created on 11-30-2016 01:22 AM - edited 08-19-2019 02:59 AM
I changed Run Schedule but it wasn't execute again.
what should I check?
Created 11-30-2016 02:32 PM
Are you using DistributedMapCache along with ListSFTP?
Same file won't be listed by ListSFTP and that may be reason to think it executed only once. If you just "touch" existing file then it is again listed. If there is continuous feed of different files then ListSFTP will list all new files coming into directory.
Created 12-01-2016 09:59 AM
I sloved the problem.
when new file added to ftp. it modification date is before listing.timestamp
Thanks you for helping me